-- Logs begin at Thu 2022-09-22 21:30:50 UTC, end at Thu 2022-09-22 22:28:51 UTC. -- Sep 22 21:55:39.174422 dv-cinder-849143-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 22 21:55:39.182568 dv-cinder-849143-6-smb devstack@keystone.service[81629]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 22 21:55:39.185142 dv-cinder-849143-6-smb devstack@keystone.service[81629]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 21:55:39 2022] *** Sep 22 21:55:39.185265 dv-cinder-849143-6-smb devstack@keystone.service[81629]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 21:55:39.185382 dv-cinder-849143-6-smb devstack@keystone.service[81629]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 21:55:39.185487 dv-cinder-849143-6-smb devstack@keystone.service[81629]: nodename: dv-cinder-849143-6-smb Sep 22 21:55:39.185589 dv-cinder-849143-6-smb devstack@keystone.service[81629]: machine: x86_64 Sep 22 21:55:39.185692 dv-cinder-849143-6-smb devstack@keystone.service[81629]: clock source: unix Sep 22 21:55:39.185788 dv-cinder-849143-6-smb devstack@keystone.service[81629]: pcre jit disabled Sep 22 21:55:39.185898 dv-cinder-849143-6-smb devstack@keystone.service[81629]: detected number of CPU cores: 4 Sep 22 21:55:39.186007 dv-cinder-849143-6-smb devstack@keystone.service[81629]: current working directory: / Sep 22 21:55:39.186106 dv-cinder-849143-6-smb devstack@keystone.service[81629]: detected binary path: /usr/bin/uwsgi-core Sep 22 21:55:39.186209 dv-cinder-849143-6-smb devstack@keystone.service[81629]: your processes number limit is 47680 Sep 22 21:55:39.186309 dv-cinder-849143-6-smb devstack@keystone.service[81629]: your memory page size is 4096 bytes Sep 22 21:55:39.186408 dv-cinder-849143-6-smb devstack@keystone.service[81629]: detected max file descriptor number: 2048 Sep 22 21:55:39.186514 dv-cinder-849143-6-smb devstack@keystone.service[81629]: lock engine: pthread robust mutexes Sep 22 21:55:39.186767 dv-cinder-849143-6-smb devstack@keystone.service[81629]: thunder lock: enabled Sep 22 21:55:39.187101 dv-cinder-849143-6-smb devstack@keystone.service[81629]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 22 21:55:39.187227 dv-cinder-849143-6-smb devstack@keystone.service[81629]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 21:55:39.225467 dv-cinder-849143-6-smb devstack@keystone.service[81629]: Python main interpreter initialized at 0x56230c8d89c0 Sep 22 21:55:39.225467 dv-cinder-849143-6-smb devstack@keystone.service[81629]: python threads support enabled Sep 22 21:55:39.225467 dv-cinder-849143-6-smb devstack@keystone.service[81629]: your server socket listen backlog is limited to 100 connections Sep 22 21:55:39.225467 dv-cinder-849143-6-smb devstack@keystone.service[81629]: your mercy for graceful operations on workers is 90 seconds Sep 22 21:55:39.225802 dv-cinder-849143-6-smb devstack@keystone.service[81629]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 21:55:39.225912 dv-cinder-849143-6-smb devstack@keystone.service[81629]: *** Operational MODE: preforking *** Sep 22 21:55:39.226144 dv-cinder-849143-6-smb devstack@keystone.service[81629]: *** uWSGI is running in multiple interpreter mode *** Sep 22 21:55:39.226144 dv-cinder-849143-6-smb devstack@keystone.service[81629]: spawned uWSGI master process (pid: 81629) Sep 22 21:55:39.226356 dv-cinder-849143-6-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 22 21:55:39.230531 dv-cinder-849143-6-smb devstack@keystone.service[81629]: spawned uWSGI worker 1 (pid: 81638, cores: 1) Sep 22 21:55:39.230531 dv-cinder-849143-6-smb devstack@keystone.service[81629]: spawned uWSGI worker 2 (pid: 81639, cores: 1) Sep 22 21:55:39.230531 dv-cinder-849143-6-smb devstack@keystone.service[81629]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 21:55:43.436826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 21:55:43.436826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: from cryptography.utils import int_from_bytes Sep 22 21:55:43.437667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 21:55:43.437667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: from cryptography.utils import int_from_bytes Sep 22 21:55:43.438939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 21:55:43.438939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: from cryptography.utils import int_from_bytes Sep 22 21:55:43.439451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 21:55:43.439451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: from cryptography.utils import int_from_bytes Sep 22 21:55:43.487179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 21:55:43.487391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 21:55:43.487550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] command line args: [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 21:55:43.487813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 21:55:43.487943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ================================================================================ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 21:55:43.488231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] admin_token = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.488476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] config_dir = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.488611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.488832 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] config_source = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.488979 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] debug = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.489204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.490416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.490416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.490606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 21:55:43.490606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 21:55:43.490721 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.490784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] command line args: [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 21:55:43.490849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.490914 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 21:55:43.490972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ================================================================================ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 21:55:43.491119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_config_append = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] admin_token = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_dir = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] config_dir = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491422 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491545 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] config_source = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] debug = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.491929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.492012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.492082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.492142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.492355 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.492438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.492536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.492617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.492764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.492850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.492944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_config_append = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.493096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.493182 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.493258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.493319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_dir = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.493431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.493533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.493659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.493752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.493922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.494028 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.494167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.494258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.494405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.494502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.494572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.494846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.494966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.495146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] publish_errors = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.495222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.495380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.495609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.495694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.495775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.495845 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.496012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.496092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.496247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.496336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.496481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] standard_threads = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.496572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.496709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.496787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.496949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.497033 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.497116 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.497220 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.497321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] use_journal = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.497443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] use_json = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.497617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] use_stderr = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.497695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.497789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] use_syslog = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.497888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] publish_errors = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.498048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.498128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.498305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.498383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.498477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.498554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.498721 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.498808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.498949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.499065 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.499179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] standard_threads = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.499257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.499404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.499483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.499642 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.499720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.499797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.499932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.500033 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] use_journal = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.500113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] use_json = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.500194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.500286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] use_stderr = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.500409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.500486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] use_syslog = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.500662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.500740 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 21:55:43.500897 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.500974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.501132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.501208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.501366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.501449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.501608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.501690 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.501870 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.502005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.502087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.502150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.502337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.502463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.502569 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.502646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.502811 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.502891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.503045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.503120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.503289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.503371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.503520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.503598 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.503760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.503843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.503989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.504066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.504220 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.504294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.504452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.504535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.504679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.504768 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.504912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.504994 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.505159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.505237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.505397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.505481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.505623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.505700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.505879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.505968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.506130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.506224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.506373 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.506460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.506604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.506684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.506828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.506913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.507053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.507131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.507277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.507352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.507508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.507594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.507737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.507814 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.507966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.508048 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.508187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.508274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.508412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.508490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.508646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.508729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.508882 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.508968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.509110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.509187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.509342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.509424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.509565 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.509717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.509791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.509898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.510036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.510126 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.510285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.510398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.510550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.510634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.510780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.510917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.511000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.511084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.511225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.511352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.511456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.511533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.511679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.511764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.511905 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.511989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.512127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.512266 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.512341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.512421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.512573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.512651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.512833 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.512948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.513054 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.513256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.513378 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.513517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.513651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.513782 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.513892 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.513973 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.514049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.514178 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.514257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.514328 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.514451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.514528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.514610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.514683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.514802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.514918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.515019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.515155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.515248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.515390 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.515478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.515628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.515705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.515872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.515963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.516110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.516189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.516349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.516436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.516592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.516680 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.516826 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.516910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.517073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.517211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.517335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.517420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.517530 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.517651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.517760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.517898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.518015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.518108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.518251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.518368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.518481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.518597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.518711 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.518801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.518948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.519026 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.519177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.519255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.519419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.519507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.519649 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.519727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.519879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.519957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.520109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.520195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.520341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.520418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.520571 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.520649 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.520802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.520956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.521031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.521101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.521257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.521334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.521487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.521576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.521715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.521794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.521975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.522054 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.522206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.522283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.522437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.522518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.522665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.522742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.522890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.522967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.523114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.523193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.523343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.523421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.external = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.523576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.523653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.523801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.523880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.524036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.524122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.524265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.524370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.password = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.524505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.524594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.token = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.524737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.524817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.524983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.525060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.525231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.525310 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.525464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.525543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.525690 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.external = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.525774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.525986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.526156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.526254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.526329 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.526519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.526622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.526744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.password = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.526877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.526965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.token = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.527128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.527207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.527378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.527458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.527624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.527712 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.527846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.527925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.528088 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.528166 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.528328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.528418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.528550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.528635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.528779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.528858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.529020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.529106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.529260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.529340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.529501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.529579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.529738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.529825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.530257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.530369 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.530444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.530526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.530601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.530693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.530767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.530838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.530908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.530985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.531128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.531216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.531408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.531487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.531650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.531728 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.531884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.531971 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.532132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.532209 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.532362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.532447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.532600 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.532686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.532831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.532910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.533072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.533150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.533307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.533393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.533536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.533613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.533778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.533886 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.534036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.534117 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.534273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.534350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.534502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.534579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.534730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.534805 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.534959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.535038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.535198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.535282 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.535430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.535509 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.535661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.535740 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.535891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.535969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.536120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.536200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.536348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.536426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.536588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.536666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.536815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.536895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.537044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.537121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.537285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.537363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.537529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.537609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.537755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.537859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.538005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.538084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.538231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.538312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.538470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.538548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.538700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.538778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.538938 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.539017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.539174 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.539252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.539411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.539490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.539659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.539749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.539889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.539973 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.540119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.540197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.540343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.540424 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.540573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.540653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.540796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.540874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.541025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.541106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.541259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.541338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.541530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.541620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.541752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.541827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.542006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.542141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.542251 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.542385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.542480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.542625 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.542704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.542861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.542939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.543098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.543178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.543346 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.543425 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.543604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.543702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.543827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.543938 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.544059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.544170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.544290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.544418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.544526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.544668 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.544748 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.544907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.544992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.545145 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.545232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.545382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.545468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.545614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.545693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.545867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.545960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.546137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.546216 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.546371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.546470 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.546617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.546705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.546867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.546946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.547114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.547194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.547350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.547438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.547580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.547660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.547815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.547894 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.548051 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.548137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.548283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.548361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.548512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.548590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.548757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.548844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.548989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.549066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.549219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.549296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.549451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.549538 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.549683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.549762 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.549937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.550018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.550165 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.550257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.550410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.550489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.550641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.550719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.550876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.550963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.551111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.551189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.551349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.551428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.551577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.551664 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.551819 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.551897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.552047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.552125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.552279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.552366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.552511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.552589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.552742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.552820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.552977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.553064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.553210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.553289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.553444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.553528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.553681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.553768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.553920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.553985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.554157 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.554235 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.554387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.554478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.554617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.554697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.554849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.554927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.555086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.555172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.555321 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.555398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.555547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.555628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.555779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.555870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.556016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.556095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.556249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.556327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.556489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.556575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.556716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.556795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] role.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.556959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.557038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] role.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.557236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.557397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.557474 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.557546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.557722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.557802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.557991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.558074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.558238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.558317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.558471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] role.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.558548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.558713 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] role.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.558793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.558942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.559019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.559188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.559267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.559420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.559508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.559664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.559742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.559907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.559985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.560150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.560230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.560389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.560466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.560632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.560778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.560884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.561017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.561100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.561264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.561344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.561528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.561622 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.561762 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.561860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.562028 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.562106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.562259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.562413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.562494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.562644 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.562729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.562889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.562977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.563139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.563218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.563382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.563468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.563616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.563702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.563846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.563923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.564093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.564172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.564337 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.564424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.564570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.564649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.564798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.564876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.565023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.565108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.565246 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.565324 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.565479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.565556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.565722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.565809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.565984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.566066 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.566215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.566292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.566446 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.566534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.566671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.566770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.566901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.566979 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.567132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.567218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.567373 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.567452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.567605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.567683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.567841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.567928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.568076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.568155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.568306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.568383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.568542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.568630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.568781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.568860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.569023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.569111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.569255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.569337 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.569486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.569567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.569718 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.569795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.569983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.570063 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.570236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.570317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.570471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.570558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.570701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.570781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.570935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.571013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.571167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.571256 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.571399 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.571478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.571641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.571719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.571872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.571951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.572108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.572187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.572340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.572418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.572568 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.572647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.572846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.572989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.573080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.573176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.573406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.573486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.573647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.573732 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.573903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.573986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.574067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 21:55:43.574142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.574367 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.574599 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.574838 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.575064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.575301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.575531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 21:55:43.575696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 21:55:43.603383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.603645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.603845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.604053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.604493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.604708 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.612225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.612845 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.640469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.640675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.640801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.640871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.693116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.693488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.741677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.741930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.742536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.742744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.899768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.899979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.900073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.900162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.900264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.900342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.900405 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.900564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.900697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.900767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.901064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.901064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.923647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.923848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.924104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.924251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.924325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.924404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.924480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.924554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.924718 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.924845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.924915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.924993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.925113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.925341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.936093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.936242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.948864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.949000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.949070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.949240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.949366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.949436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.949498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.949660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.949801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.949902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.949976 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.950050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.950113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.950280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 21:55:43.967011 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.967190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 21:55:43.967560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.967682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.967752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 21:55:43.967835 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 21:55:43.967988 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.968194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.968295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.968360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 21:55:43.968507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.968633 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.968730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.968929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.969117 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.969375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.978318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.978592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.978859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.978985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.979198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.979349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.979560 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.979840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.986072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:43.986778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:43.988925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:43.989210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.989485 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.989610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:43.989765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.989913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.990022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.990213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.990342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.990490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.990615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.990776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.990916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.990985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.991047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.991288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.991427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.991510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.991572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.991811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.992059 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:43.992353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.013853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.014875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.015300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.015580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.016331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.016613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.020165 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.020443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.020723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.021238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.021520 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.021793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.027031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.027309 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.028147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.028436 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.032863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.033157 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.033439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.033719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.034010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.034154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.034257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.034347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.034553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.034680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.034794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.034884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.035137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.035419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.035689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.035940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.050174 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.050461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.051344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.051622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.054206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.055413 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.057429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.057755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.058674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.058968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.061807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.063111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.064878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.066319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.068075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.068367 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.068647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.068924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.069195 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.069481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.069621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.069825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.070144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.070425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.070700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.070966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.085095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.085380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.086005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.086282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.087159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.087448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.087695 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.087981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.093201 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.094748 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.094966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.096256 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.096510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.096636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.098055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.098331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.099137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.099421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.099698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.099969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.100356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.101080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.101363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.101632 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.101941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.102337 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.111494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.111759 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.112040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.112345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.112728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.113010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.113277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.113372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.113648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.113953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.114233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.114611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.114906 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.115186 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.128520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.130479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.131503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.133353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.134342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.135925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.136285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.137363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.137643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.137766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.138090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.139213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.139497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.139886 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.144328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.145765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.146174 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.147621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.148610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.148999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.149279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.149552 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.150507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.150939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.151274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.151684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.157336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.157625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.157923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.159460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.159760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.160040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.164683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.164961 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.165240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.165522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.165790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.166084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.166356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.166631 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.166937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.167202 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.167326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 21:55:44.167484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.167606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.167694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.167975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.168100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.168197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.168274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.168529 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.168789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.169063 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.169359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.169628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.169924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.170203 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.170481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.170752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.171044 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 21:55:44.201913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56230c8d89c0 pid: 81639 (default app) Sep 22 21:55:44.205039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56230c8d89c0 pid: 81638 (default app) Sep 22 21:55:44.205163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aa946-1214-42ff-9621-f6216ce814fe None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:44.205398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aa946-1214-42ff-9621-f6216ce814fe None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:44.205664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aa946-1214-42ff-9621-f6216ce814fe None None] PATH_INFO: `/v3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:44.209763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Thu Sep 22 21:55:44 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:55:51.097037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53fb90-ca0e-4240-bf4a-b252f23f9b56 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:51.097895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53fb90-ca0e-4240-bf4a-b252f23f9b56 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:51.097895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53fb90-ca0e-4240-bf4a-b252f23f9b56 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:51.105255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:55:51 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:55:51.110630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4bcda-3452-4e0d-81d4-013dbf231b03 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:51.111093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4bcda-3452-4e0d-81d4-013dbf231b03 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:51.111232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4bcda-3452-4e0d-81d4-013dbf231b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:51.183824 dv-cinder-849143-6-smb devstack@keystone.service[81639]: INFO dbcounter [None req-a5c4bcda-3452-4e0d-81d4-013dbf231b03 None None] Registered counter for database keystone Sep 22 21:55:51.204973 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c4bcda-3452-4e0d-81d4-013dbf231b03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 21:55:51.215890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writer thread running {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 21:55:51.415038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG passlib.handlers.bcrypt [None req-a5c4bcda-3452-4e0d-81d4-013dbf231b03 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81639) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 21:55:51.415312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG passlib.handlers.bcrypt [None req-a5c4bcda-3452-4e0d-81d4-013dbf231b03 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81639) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 21:55:51.480482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a5c4bcda-3452-4e0d-81d4-013dbf231b03 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:55:51.482130 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a5c4bcda-3452-4e0d-81d4-013dbf231b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:55:51.615738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:55:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 22 21:55:52.091333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53fb90-ca0e-4240-bf4a-b252f23f9b56 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:52.165868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: INFO dbcounter [None req-6f53fb90-ca0e-4240-bf4a-b252f23f9b56 None None] Registered counter for database keystone Sep 22 21:55:52.191125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG oslo_db.sqlalchemy.engines [None req-6f53fb90-ca0e-4240-bf4a-b252f23f9b56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 21:55:52.201335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writer thread running {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 21:55:52.321173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53fb90-ca0e-4240-bf4a-b252f23f9b56 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:52.326646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027aa761-0ba3-448d-b217-1f00d541a5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:52.327271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aa761-0ba3-448d-b217-1f00d541a5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:52.327546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aa761-0ba3-448d-b217-1f00d541a5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:52.327815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aa761-0ba3-448d-b217-1f00d541a5b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:52.337341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aa761-0ba3-448d-b217-1f00d541a5b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:55:52.389327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: WARNING keystone.common.rbac_enforcer.enforcer [None req-027aa761-0ba3-448d-b217-1f00d541a5b6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 21:55:52.389591 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aa761-0ba3-448d-b217-1f00d541a5b6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:55:52.399643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Sep 22 21:55:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 21:55:52.406848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4bcda-3452-4e0d-81d4-013dbf231b03 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:52.434805 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4bcda-3452-4e0d-81d4-013dbf231b03 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:52.440571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42cf51-480a-491c-b0d4-5fbb5f8ef0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:52.441708 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42cf51-480a-491c-b0d4-5fbb5f8ef0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:52.442016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42cf51-480a-491c-b0d4-5fbb5f8ef0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:52.442287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42cf51-480a-491c-b0d4-5fbb5f8ef0e3 admin admin] PATH_INFO: `/v3/projects/1af96ba5f937450aabed914f12909978` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:52.444024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42cf51-480a-491c-b0d4-5fbb5f8ef0e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=1af96ba5f937450aabed914f12909978)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:55:52.498127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: WARNING keystone.common.rbac_enforcer.enforcer [None req-be42cf51-480a-491c-b0d4-5fbb5f8ef0e3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 21:55:52.498468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42cf51-480a-491c-b0d4-5fbb5f8ef0e3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:55:52.503020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Sep 22 21:55:52 2022] GET /identity/v3/projects/1af96ba5f937450aabed914f12909978 => generated 344 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:55:54.638992 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50e201-48da-4914-b022-43432bd7b420 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:54.639877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50e201-48da-4914-b022-43432bd7b420 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:54.639877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50e201-48da-4914-b022-43432bd7b420 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:54.646673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:55:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:55:54.652530 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646c937-c30b-44bd-8740-1a07ab948048 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:54.652957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646c937-c30b-44bd-8740-1a07ab948048 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:54.653047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646c937-c30b-44bd-8740-1a07ab948048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:54.676893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a646c937-c30b-44bd-8740-1a07ab948048 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:55:54.678445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a646c937-c30b-44bd-8740-1a07ab948048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:55:54.687449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:55:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 22 21:55:54.955309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50e201-48da-4914-b022-43432bd7b420 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:54.970050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50e201-48da-4914-b022-43432bd7b420 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:54.975426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fb885-84c9-4aa5-bd78-e5354e81b62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:54.976019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb885-84c9-4aa5-bd78-e5354e81b62c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:54.976293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb885-84c9-4aa5-bd78-e5354e81b62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:54.976552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb885-84c9-4aa5-bd78-e5354e81b62c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:54.984757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fb885-84c9-4aa5-bd78-e5354e81b62c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:55:54.986565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fb885-84c9-4aa5-bd78-e5354e81b62c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:55:54.995384 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Sep 22 21:55:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 21:55:55.000775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646c937-c30b-44bd-8740-1a07ab948048 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:55.009946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646c937-c30b-44bd-8740-1a07ab948048 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:55.015448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebee3a5-131b-438b-9a55-1dbc52f1ad60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:55.016070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee3a5-131b-438b-9a55-1dbc52f1ad60 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:55.016344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee3a5-131b-438b-9a55-1dbc52f1ad60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:55.016609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee3a5-131b-438b-9a55-1dbc52f1ad60 admin admin] PATH_INFO: `/v3/users/55aadc9862fd4d0e93e5113dacf48de6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:55.018077 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebee3a5-131b-438b-9a55-1dbc52f1ad60 admin admin] RBAC: Authorizing `identity:get_user(user_id=55aadc9862fd4d0e93e5113dacf48de6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:55:55.019889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebee3a5-131b-438b-9a55-1dbc52f1ad60 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:55:55.021407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Thu Sep 22 21:55:54 2022] GET /identity/v3/users/55aadc9862fd4d0e93e5113dacf48de6 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:55:57.203700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3eb3d-cfab-4613-9d9a-4153395c0646 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:57.204278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3eb3d-cfab-4613-9d9a-4153395c0646 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:57.204278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3eb3d-cfab-4613-9d9a-4153395c0646 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:57.205581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:55:57.211321 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcce6-ca15-4349-a244-770d6e391277 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:57.211753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcce6-ca15-4349-a244-770d6e391277 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:57.211937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcce6-ca15-4349-a244-770d6e391277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:57.230423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-611fcce6-ca15-4349-a244-770d6e391277 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:55:57.231588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-611fcce6-ca15-4349-a244-770d6e391277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:55:57.255457 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c65f3-5738-475a-bc0e-fd2094cd2062 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:57.255827 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c65f3-5738-475a-bc0e-fd2094cd2062 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:57.256146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c65f3-5738-475a-bc0e-fd2094cd2062 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:57.257483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:55:57.263021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb505-b8a6-42ba-a1e1-17eeea3284fa None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:57.263305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb505-b8a6-42ba-a1e1-17eeea3284fa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:57.263578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb505-b8a6-42ba-a1e1-17eeea3284fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:57.311004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG passlib.handlers.bcrypt [None req-890cb505-b8a6-42ba-a1e1-17eeea3284fa None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81638) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 21:55:57.311400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG passlib.handlers.bcrypt [None req-890cb505-b8a6-42ba-a1e1-17eeea3284fa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81638) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 21:55:57.315854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:55:57.360798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-890cb505-b8a6-42ba-a1e1-17eeea3284fa None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:55:57.362441 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-890cb505-b8a6-42ba-a1e1-17eeea3284fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:55:57.467197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:55:57.579632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fcce6-ca15-4349-a244-770d6e391277 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:57.606477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:55:57.704997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fcce6-ca15-4349-a244-770d6e391277 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:57.732259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cb505-b8a6-42ba-a1e1-17eeea3284fa None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:57.743053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb286ea-6841-4a1a-91e8-693e15072ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:57.743706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb286ea-6841-4a1a-91e8-693e15072ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:57.743980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb286ea-6841-4a1a-91e8-693e15072ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:57.744255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb286ea-6841-4a1a-91e8-693e15072ec4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:57.756380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb286ea-6841-4a1a-91e8-693e15072ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-6bb286ea-6841-4a1a-91e8-693e15072ec4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:55:57.765859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:55:57.766922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:55:57.767757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:55:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:55:57.772774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb286ea-6841-4a1a-91e8-693e15072ec4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:57.839389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cb505-b8a6-42ba-a1e1-17eeea3284fa None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:57.841737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:55:57.854944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:55:57.874011 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb286ea-6841-4a1a-91e8-693e15072ec4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:57.879062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740762-dbb5-4487-bd2d-d3b76ddf03ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:57.879950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740762-dbb5-4487-bd2d-d3b76ddf03ac None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:57.880233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740762-dbb5-4487-bd2d-d3b76ddf03ac None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:57.880511 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740762-dbb5-4487-bd2d-d3b76ddf03ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:57.907192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362dac2-0358-47fb-bdf9-9ed843e0ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:57.907894 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362dac2-0358-47fb-bdf9-9ed843e0ff7c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:57.908227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362dac2-0358-47fb-bdf9-9ed843e0ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:57.908556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362dac2-0358-47fb-bdf9-9ed843e0ff7c None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:57.909288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362dac2-0358-47fb-bdf9-9ed843e0ff7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:55:57.909590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362dac2-0358-47fb-bdf9-9ed843e0ff7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:55:57.911024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362dac2-0358-47fb-bdf9-9ed843e0ff7c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:55:57.922836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:55:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:55:57.928599 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362dac2-0358-47fb-bdf9-9ed843e0ff7c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:57.946910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740762-dbb5-4487-bd2d-d3b76ddf03ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:55:57.948547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740762-dbb5-4487-bd2d-d3b76ddf03ac None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:55:58.030563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362dac2-0358-47fb-bdf9-9ed843e0ff7c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:58.050039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:55:58.055857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740762-dbb5-4487-bd2d-d3b76ddf03ac None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:58.058900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:55:58.069132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2924b3-6396-4e52-8aaa-6090ba3bf9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:58.069772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2924b3-6396-4e52-8aaa-6090ba3bf9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:58.070064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2924b3-6396-4e52-8aaa-6090ba3bf9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:58.070331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2924b3-6396-4e52-8aaa-6090ba3bf9f2 None admin] PATH_INFO: `/v3/users/55aadc9862fd4d0e93e5113dacf48de6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:58.071575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2924b3-6396-4e52-8aaa-6090ba3bf9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=55aadc9862fd4d0e93e5113dacf48de6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:55:58.073213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2924b3-6396-4e52-8aaa-6090ba3bf9f2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:55:58.075010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:55:57 2022] GET /identity/v3/users/55aadc9862fd4d0e93e5113dacf48de6 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:55:58.080441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2924b3-6396-4e52-8aaa-6090ba3bf9f2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:58.097310 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:55:58.155034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740762-dbb5-4487-bd2d-d3b76ddf03ac None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:58.184185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2924b3-6396-4e52-8aaa-6090ba3bf9f2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:58.188935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb36ef8-4ba0-4d13-b407-5dc7ed63b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:58.189794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb36ef8-4ba0-4d13-b407-5dc7ed63b7db None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:58.190097 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb36ef8-4ba0-4d13-b407-5dc7ed63b7db None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:58.190359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb36ef8-4ba0-4d13-b407-5dc7ed63b7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:58.208357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb36ef8-4ba0-4d13-b407-5dc7ed63b7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:55:58.209829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb36ef8-4ba0-4d13-b407-5dc7ed63b7db None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:55:58.217580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575853a-ae36-4e56-9fe4-3ea1170f6e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:58.218248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575853a-ae36-4e56-9fe4-3ea1170f6e96 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:58.218526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575853a-ae36-4e56-9fe4-3ea1170f6e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:58.218793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575853a-ae36-4e56-9fe4-3ea1170f6e96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:58.219930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575853a-ae36-4e56-9fe4-3ea1170f6e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:55:58.221380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575853a-ae36-4e56-9fe4-3ea1170f6e96 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:55:58.222982 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:55:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7cb36ef8-4ba0-4d13-b407-5dc7ed63b7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:55:58.227900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:55:58.228851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:55:58.230416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:55:58.230416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:55:58.230416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:55:58.230416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:55:58.230641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575853a-ae36-4e56-9fe4-3ea1170f6e96 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:58.234615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb36ef8-4ba0-4d13-b407-5dc7ed63b7db None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:55:58.291263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:55:58.308549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:55:58.328304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575853a-ae36-4e56-9fe4-3ea1170f6e96 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:58.338228 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb36ef8-4ba0-4d13-b407-5dc7ed63b7db None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:55:58.363337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca5b65-fbda-47c8-8588-f63559c4b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:58.363958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5b65-fbda-47c8-8588-f63559c4b3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:58.364233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5b65-fbda-47c8-8588-f63559c4b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:58.364520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5b65-fbda-47c8-8588-f63559c4b3a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:58.365228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca5b65-fbda-47c8-8588-f63559c4b3a8 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.domain.id=default, user.id=55aadc9862fd4d0e93e5113dacf48de6) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:55:58.365537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca5b65-fbda-47c8-8588-f63559c4b3a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:55:58.367038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca5b65-fbda-47c8-8588-f63559c4b3a8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:55:58.372846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06333fd-0400-45ea-bc40-186f01b3c690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:55:58.373469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06333fd-0400-45ea-bc40-186f01b3c690 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:55:58.373748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06333fd-0400-45ea-bc40-186f01b3c690 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:55:58.374048 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Sep 22 21:55:58 2022] GET /identity/v3/role_assignments?user.id=55aadc9862fd4d0e93e5113dacf48de6&scope.domain.id=default&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:55:58.374140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06333fd-0400-45ea-bc40-186f01b3c690 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:55:58.374784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06333fd-0400-45ea-bc40-186f01b3c690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:55:58.375088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06333fd-0400-45ea-bc40-186f01b3c690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:55:58.376535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06333fd-0400-45ea-bc40-186f01b3c690 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:55:58.396832 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:00.842964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3033f-1c0e-4b40-945d-68d0ae74c9d8 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:00.843482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3033f-1c0e-4b40-945d-68d0ae74c9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:00.843587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3033f-1c0e-4b40-945d-68d0ae74c9d8 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:00.845085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:00.855670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1e3b-dca1-4cc4-880d-b92d7febf091 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:00.856195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1e3b-dca1-4cc4-880d-b92d7febf091 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:00.856195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1e3b-dca1-4cc4-880d-b92d7febf091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:00.883812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-700f1e3b-dca1-4cc4-880d-b92d7febf091 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:00.885033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-700f1e3b-dca1-4cc4-880d-b92d7febf091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:00.950706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c65866-2184-450d-a9df-404f28b6ca81 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:00.951004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c65866-2184-450d-a9df-404f28b6ca81 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:00.951243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c65866-2184-450d-a9df-404f28b6ca81 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:00.952827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 13/23] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:00.964102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7100f8-a699-48e2-ab10-6ad7b5181d20 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:00.964474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7100f8-a699-48e2-ab10-6ad7b5181d20 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:00.964647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7100f8-a699-48e2-ab10-6ad7b5181d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:01.005264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1f7100f8-a699-48e2-ab10-6ad7b5181d20 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:01.006554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1f7100f8-a699-48e2-ab10-6ad7b5181d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:01.015080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:01.116229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:01.567722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f1e3b-dca1-4cc4-880d-b92d7febf091 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:01.627010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:01.649378 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0736d-7f77-423e-b0e7-42c1b4b1510f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:01.649705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0736d-7f77-423e-b0e7-42c1b4b1510f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:01.649998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0736d-7f77-423e-b0e7-42c1b4b1510f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:01.651895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 15/26] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:01.657719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6b20-bcaf-4fe3-af04-8a32ed62bab4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:01.658000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6b20-bcaf-4fe3-af04-8a32ed62bab4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:01.658298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6b20-bcaf-4fe3-af04-8a32ed62bab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:01.693288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fefb6b20-bcaf-4fe3-af04-8a32ed62bab4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:01.694538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fefb6b20-bcaf-4fe3-af04-8a32ed62bab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:01.722547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f1e3b-dca1-4cc4-880d-b92d7febf091 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:01.763260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd858a81-3004-4224-bef4-d13d5f4f6ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:01.763919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd858a81-3004-4224-bef4-d13d5f4f6ddd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:01.764192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd858a81-3004-4224-bef4-d13d5f4f6ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:01.764463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd858a81-3004-4224-bef4-d13d5f4f6ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:01.778338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd858a81-3004-4224-bef4-d13d5f4f6ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:01.779862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd858a81-3004-4224-bef4-d13d5f4f6ddd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:01.797999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 16/27] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:01.797999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb6b20-bcaf-4fe3-af04-8a32ed62bab4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:01.805875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fd858a81-3004-4224-bef4-d13d5f4f6ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:56:01.819592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:01.821102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:56:01.823711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:56:01.823711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:56:01.823711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:01.823711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 12/28] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:56:01.824078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5abc84-a5c6-4687-bba2-7a05f9dad21b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:01.824194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5abc84-a5c6-4687-bba2-7a05f9dad21b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:01.824700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5abc84-a5c6-4687-bba2-7a05f9dad21b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:01.826396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 13/29] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:01.839536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe2d59-b0ce-4741-898d-13ff99de0ccb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:01.839823 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe2d59-b0ce-4741-898d-13ff99de0ccb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:01.840082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe2d59-b0ce-4741-898d-13ff99de0ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:01.879329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-eabe2d59-b0ce-4741-898d-13ff99de0ccb None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:01.880543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-eabe2d59-b0ce-4741-898d-13ff99de0ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:01.938206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb6b20-bcaf-4fe3-af04-8a32ed62bab4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:01.976227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c607d-aadd-48f9-866f-0e5c2a486ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:01.977225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c607d-aadd-48f9-866f-0e5c2a486ffb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:01.977698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c607d-aadd-48f9-866f-0e5c2a486ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:01.978225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c607d-aadd-48f9-866f-0e5c2a486ffb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:01.989689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c607d-aadd-48f9-866f-0e5c2a486ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2e5c607d-aadd-48f9-866f-0e5c2a486ffb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:01.995117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:01.995942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:01.996686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:01.999087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 17/30] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:56:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:02.000313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c607d-aadd-48f9-866f-0e5c2a486ffb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:02.010441 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 14/31] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:02.011219 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe2d59-b0ce-4741-898d-13ff99de0ccb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:02.044465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:02.090013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:02.121763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe2d59-b0ce-4741-898d-13ff99de0ccb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:02.157464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492c12a-4a93-40ff-b6c1-88b4dbff086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:02.158330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c12a-4a93-40ff-b6c1-88b4dbff086e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:02.158611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c12a-4a93-40ff-b6c1-88b4dbff086e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:02.159064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c12a-4a93-40ff-b6c1-88b4dbff086e None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:02.159810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492c12a-4a93-40ff-b6c1-88b4dbff086e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:02.160113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492c12a-4a93-40ff-b6c1-88b4dbff086e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:02.161515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492c12a-4a93-40ff-b6c1-88b4dbff086e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:02.162170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c607d-aadd-48f9-866f-0e5c2a486ffb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:02.174952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 15/32] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:02.183072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492c12a-4a93-40ff-b6c1-88b4dbff086e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:02.246144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfe657-b542-410f-b22f-bd8bbe489980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:02.247047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfe657-b542-410f-b22f-bd8bbe489980 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:02.247477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfe657-b542-410f-b22f-bd8bbe489980 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:02.247897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfe657-b542-410f-b22f-bd8bbe489980 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:02.248697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfe657-b542-410f-b22f-bd8bbe489980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:02.249139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfe657-b542-410f-b22f-bd8bbe489980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:02.250724 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfe657-b542-410f-b22f-bd8bbe489980 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:02.294030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 18/33] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:02.295261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfe657-b542-410f-b22f-bd8bbe489980 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:02.352845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:02.372918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492c12a-4a93-40ff-b6c1-88b4dbff086e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:02.431825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b8b78-87f6-48aa-895e-1a5558e3b639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:02.432578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8b78-87f6-48aa-895e-1a5558e3b639 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:02.432868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8b78-87f6-48aa-895e-1a5558e3b639 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:02.433124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8b78-87f6-48aa-895e-1a5558e3b639 None admin] PATH_INFO: `/v3/users/55aadc9862fd4d0e93e5113dacf48de6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:02.434775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b8b78-87f6-48aa-895e-1a5558e3b639 None admin] RBAC: Authorizing `identity:get_user(user_id=55aadc9862fd4d0e93e5113dacf48de6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:02.436343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b8b78-87f6-48aa-895e-1a5558e3b639 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:02.438058 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 16/34] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:02 2022] GET /identity/v3/users/55aadc9862fd4d0e93e5113dacf48de6 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:02.438808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b8b78-87f6-48aa-895e-1a5558e3b639 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:02.456623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfe657-b542-410f-b22f-bd8bbe489980 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:02.482465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:02.494327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41c3f1-6fd3-4bf9-bec6-d21efd215d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:02.495162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41c3f1-6fd3-4bf9-bec6-d21efd215d45 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:02.495537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41c3f1-6fd3-4bf9-bec6-d21efd215d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:02.495901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41c3f1-6fd3-4bf9-bec6-d21efd215d45 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:02.496901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41c3f1-6fd3-4bf9-bec6-d21efd215d45 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:02.498392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41c3f1-6fd3-4bf9-bec6-d21efd215d45 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:02.552076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b8b78-87f6-48aa-895e-1a5558e3b639 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:02.594715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a74899-2c4d-4e7c-9aec-de74195c5b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:02.595541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74899-2c4d-4e7c-9aec-de74195c5b6e None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:02.595949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74899-2c4d-4e7c-9aec-de74195c5b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:02.596332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74899-2c4d-4e7c-9aec-de74195c5b6e None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:02.597087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a74899-2c4d-4e7c-9aec-de74195c5b6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:02.598675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a74899-2c4d-4e7c-9aec-de74195c5b6e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:02.649021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 19/35] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Sep 22 21:56:02 2022] POST /identity/v3/roles => generated 225 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:02.655202 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41c3f1-6fd3-4bf9-bec6-d21efd215d45 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:02.756252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 17/36] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:56:02 2022] POST /identity/v3/projects => generated 301 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:02.757501 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a74899-2c4d-4e7c-9aec-de74195c5b6e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:02.773344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:02.834595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41c3f1-6fd3-4bf9-bec6-d21efd215d45 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:02.898410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d833d-0541-4db3-9e35-ab5d2b41d451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:02.899101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d833d-0541-4db3-9e35-ab5d2b41d451 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:02.899346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d833d-0541-4db3-9e35-ab5d2b41d451 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:02.899593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d833d-0541-4db3-9e35-ab5d2b41d451 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:02.900712 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d833d-0541-4db3-9e35-ab5d2b41d451 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:02.902157 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d833d-0541-4db3-9e35-ab5d2b41d451 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:02.908251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a74899-2c4d-4e7c-9aec-de74195c5b6e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:02.921447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 20/37] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Sep 22 21:56:02 2022] POST /identity/v3/roles => generated 219 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:02.926862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173d49d-4b36-46b2-a067-08b3732257bd None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:02.927212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173d49d-4b36-46b2-a067-08b3732257bd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:02.927418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173d49d-4b36-46b2-a067-08b3732257bd None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:02.929289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 21/38] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:02.933907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600d672-0bfd-4b79-ada4-59d5bee5b295 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:02.934352 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600d672-0bfd-4b79-ada4-59d5bee5b295 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:02.934627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600d672-0bfd-4b79-ada4-59d5bee5b295 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:02.939507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 22/39] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:02.941650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002b4d7-593a-46ff-ae3d-2cb2facdd495 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:02.941998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002b4d7-593a-46ff-ae3d-2cb2facdd495 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:02.942271 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002b4d7-593a-46ff-ae3d-2cb2facdd495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:02.968182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf8eb6-bbee-4928-9c21-27c1c752da9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:02.968977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf8eb6-bbee-4928-9c21-27c1c752da9b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:02.969296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf8eb6-bbee-4928-9c21-27c1c752da9b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:02.969558 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0002b4d7-593a-46ff-ae3d-2cb2facdd495 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:02.969666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf8eb6-bbee-4928-9c21-27c1c752da9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:02.970990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf8eb6-bbee-4928-9c21-27c1c752da9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:02.971995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0002b4d7-593a-46ff-ae3d-2cb2facdd495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:02.972748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf8eb6-bbee-4928-9c21-27c1c752da9b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:02.974601 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 18/40] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:02.975953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa737e6-ddf4-4372-b17a-bc17d8b162fb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:02.977145 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa737e6-ddf4-4372-b17a-bc17d8b162fb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:02.977145 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa737e6-ddf4-4372-b17a-bc17d8b162fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:03.000626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3aa737e6-ddf4-4372-b17a-bc17d8b162fb None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:03.003194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3aa737e6-ddf4-4372-b17a-bc17d8b162fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:03.023408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:03.063279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 23/41] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:03.064483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002b4d7-593a-46ff-ae3d-2cb2facdd495 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:03.137677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 19/42] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:03.182757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002b4d7-593a-46ff-ae3d-2cb2facdd495 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:03.332911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fc757-2bb0-4854-9c58-9a8749a52392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:03.333587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc757-2bb0-4854-9c58-9a8749a52392 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:03.333933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc757-2bb0-4854-9c58-9a8749a52392 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:03.334214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc757-2bb0-4854-9c58-9a8749a52392 None admin] PATH_INFO: `/v3/domains/default/users/55aadc9862fd4d0e93e5113dacf48de6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:03.338209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fc757-2bb0-4854-9c58-9a8749a52392 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=55aadc9862fd4d0e93e5113dacf48de6, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:03.340085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fc757-2bb0-4854-9c58-9a8749a52392 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:03.361135 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 24/43] 10.222.0.20 () {58 vars in 1361 bytes} [Thu Sep 22 21:56:03 2022] PUT /identity/v3/domains/default/users/55aadc9862fd4d0e93e5113dacf48de6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:56:03.371674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa737e6-ddf4-4372-b17a-bc17d8b162fb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:03.383732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:03.416066 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fc757-2bb0-4854-9c58-9a8749a52392 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:03.454874 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:03.494385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa737e6-ddf4-4372-b17a-bc17d8b162fb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:03.533387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f950-a782-4ca4-8adb-8ff8bcd9f272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:03.534053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fc757-2bb0-4854-9c58-9a8749a52392 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:03.534645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f950-a782-4ca4-8adb-8ff8bcd9f272 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:03.534929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f950-a782-4ca4-8adb-8ff8bcd9f272 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:03.535203 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f950-a782-4ca4-8adb-8ff8bcd9f272 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:03.535902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779f950-a782-4ca4-8adb-8ff8bcd9f272 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:03.537459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779f950-a782-4ca4-8adb-8ff8bcd9f272 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:03.559803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 20/44] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Sep 22 21:56:03 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:03.576809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5e32f-d881-442a-9e52-dd0ffd1075a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:03.577480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5e32f-d881-442a-9e52-dd0ffd1075a7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:03.577752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5e32f-d881-442a-9e52-dd0ffd1075a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:03.578086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5e32f-d881-442a-9e52-dd0ffd1075a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:03.579295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5e32f-d881-442a-9e52-dd0ffd1075a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:03.580862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5e32f-d881-442a-9e52-dd0ffd1075a7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:03.582913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 25/45] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:03.590128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f950-a782-4ca4-8adb-8ff8bcd9f272 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:03.672538 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:03.720529 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f950-a782-4ca4-8adb-8ff8bcd9f272 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:03.761610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097251b-a0e4-4788-8b52-459d461cb05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:03.762322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097251b-a0e4-4788-8b52-459d461cb05f None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:03.762610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097251b-a0e4-4788-8b52-459d461cb05f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:03.762888 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097251b-a0e4-4788-8b52-459d461cb05f None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:03.763558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097251b-a0e4-4788-8b52-459d461cb05f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:03.765094 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097251b-a0e4-4788-8b52-459d461cb05f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:03.796811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 21/46] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:56:03 2022] POST /identity/v3/projects => generated 312 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:05.521308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4dd13-47d9-4d64-b4b3-093c6bfb0625 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:05.521946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4dd13-47d9-4d64-b4b3-093c6bfb0625 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:05.521946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4dd13-47d9-4d64-b4b3-093c6bfb0625 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:05.523218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 26/47] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:05.528579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b93bb-1965-4e07-93b3-193f180a711c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:05.528994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b93bb-1965-4e07-93b3-193f180a711c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:05.529191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b93bb-1965-4e07-93b3-193f180a711c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:05.548067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a16b93bb-1965-4e07-93b3-193f180a711c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:05.549251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a16b93bb-1965-4e07-93b3-193f180a711c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:05.617854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 22/48] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:05.882179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4dd13-47d9-4d64-b4b3-093c6bfb0625 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:05.991216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5672b-b60c-4066-a968-7b13ef18aead None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:05.991554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5672b-b60c-4066-a968-7b13ef18aead None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:05.991778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5672b-b60c-4066-a968-7b13ef18aead None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:05.993156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 23/49] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:05.993370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4dd13-47d9-4d64-b4b3-093c6bfb0625 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:05.995060 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:05.998734 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fa180-c92d-4951-a78c-9bfcc39ee481 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:05.999017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fa180-c92d-4951-a78c-9bfcc39ee481 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:05.999295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fa180-c92d-4951-a78c-9bfcc39ee481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:06.017705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-da0fa180-c92d-4951-a78c-9bfcc39ee481 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:06.018955 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-da0fa180-c92d-4951-a78c-9bfcc39ee481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:06.030764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874c16e-2dda-4f8c-980b-d4e37d255d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:06.031401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c16e-2dda-4f8c-980b-d4e37d255d84 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:06.031709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c16e-2dda-4f8c-980b-d4e37d255d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:06.031977 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c16e-2dda-4f8c-980b-d4e37d255d84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:06.042344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874c16e-2dda-4f8c-980b-d4e37d255d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d874c16e-2dda-4f8c-980b-d4e37d255d84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:06.047203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:06.048221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:06.049039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 27/50] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:56:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:06.054703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874c16e-2dda-4f8c-980b-d4e37d255d84 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:06.066973 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:06.090871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 24/51] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:06.154674 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874c16e-2dda-4f8c-980b-d4e37d255d84 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:06.188279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cf56d-2f0d-47de-8ce3-8631d55d63b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:06.188881 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf56d-2f0d-47de-8ce3-8631d55d63b8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:06.189137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf56d-2f0d-47de-8ce3-8631d55d63b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:06.189431 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf56d-2f0d-47de-8ce3-8631d55d63b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:06.190120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cf56d-2f0d-47de-8ce3-8631d55d63b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:06.190407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cf56d-2f0d-47de-8ce3-8631d55d63b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:06.191802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cf56d-2f0d-47de-8ce3-8631d55d63b8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:06.200090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 28/52] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:06.206157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fa180-c92d-4951-a78c-9bfcc39ee481 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:06.311283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fa180-c92d-4951-a78c-9bfcc39ee481 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:06.345410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1c758-beca-4331-8c9c-6a6cc75fafbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:06.346084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1c758-beca-4331-8c9c-6a6cc75fafbe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:06.346369 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1c758-beca-4331-8c9c-6a6cc75fafbe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:06.346642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1c758-beca-4331-8c9c-6a6cc75fafbe None admin] PATH_INFO: `/v3/users/55aadc9862fd4d0e93e5113dacf48de6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:06.347818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1c758-beca-4331-8c9c-6a6cc75fafbe None admin] RBAC: Authorizing `identity:get_user(user_id=55aadc9862fd4d0e93e5113dacf48de6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:06.349280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1c758-beca-4331-8c9c-6a6cc75fafbe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:06.350938 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 25/53] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:06 2022] GET /identity/v3/users/55aadc9862fd4d0e93e5113dacf48de6 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:06.356670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cf56d-2f0d-47de-8ce3-8631d55d63b8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:06.366240 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1c758-beca-4331-8c9c-6a6cc75fafbe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:06.383458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:06.418872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:06.458954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cf56d-2f0d-47de-8ce3-8631d55d63b8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:06.469427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1c758-beca-4331-8c9c-6a6cc75fafbe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:06.493276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e799a65-fe32-41ed-921e-d87357f9821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:06.493974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e799a65-fe32-41ed-921e-d87357f9821a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:06.494285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e799a65-fe32-41ed-921e-d87357f9821a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:06.494593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e799a65-fe32-41ed-921e-d87357f9821a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:06.496035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e799a65-fe32-41ed-921e-d87357f9821a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:06.497554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e799a65-fe32-41ed-921e-d87357f9821a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:06.499281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 29/54] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:06.505518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e799a65-fe32-41ed-921e-d87357f9821a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:06.610797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:06.618183 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fea9f1-fd61-4037-bb6b-8bf709a02529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:06.618834 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea9f1-fd61-4037-bb6b-8bf709a02529 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:06.619109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea9f1-fd61-4037-bb6b-8bf709a02529 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:06.619519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea9f1-fd61-4037-bb6b-8bf709a02529 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:06.621019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e799a65-fe32-41ed-921e-d87357f9821a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:06.621122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fea9f1-fd61-4037-bb6b-8bf709a02529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:06.622624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fea9f1-fd61-4037-bb6b-8bf709a02529 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:06.624202 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 26/55] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:06.629667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fea9f1-fd61-4037-bb6b-8bf709a02529 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:06.654706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7519cc-bf03-4780-81c1-a550f16b8689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:06.655306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7519cc-bf03-4780-81c1-a550f16b8689 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:06.655583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7519cc-bf03-4780-81c1-a550f16b8689 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:06.655851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7519cc-bf03-4780-81c1-a550f16b8689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:06.656572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7519cc-bf03-4780-81c1-a550f16b8689 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.domain.id=default, user.id=55aadc9862fd4d0e93e5113dacf48de6) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:06.656878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7519cc-bf03-4780-81c1-a550f16b8689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:06.658414 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7519cc-bf03-4780-81c1-a550f16b8689 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:06.664603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 30/56] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Sep 22 21:56:06 2022] GET /identity/v3/role_assignments?user.id=55aadc9862fd4d0e93e5113dacf48de6&scope.domain.id=default&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:06.743304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fea9f1-fd61-4037-bb6b-8bf709a02529 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:06.763046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:06.782442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770a8b0-5fc5-4367-bb23-209706ffd258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:06.783080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770a8b0-5fc5-4367-bb23-209706ffd258 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:06.783359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770a8b0-5fc5-4367-bb23-209706ffd258 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:06.783634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770a8b0-5fc5-4367-bb23-209706ffd258 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:06.784308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770a8b0-5fc5-4367-bb23-209706ffd258 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:06.785776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770a8b0-5fc5-4367-bb23-209706ffd258 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:06.817167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 27/57] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Sep 22 21:56:06 2022] POST /identity/v3/projects => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 21:56:08.951917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bae678-b946-4ae7-abd8-4e2858eb14a0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:08.952730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bae678-b946-4ae7-abd8-4e2858eb14a0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:08.952730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bae678-b946-4ae7-abd8-4e2858eb14a0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:08.955403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 31/58] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:08.964476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a23ba-e4f8-44fd-9716-75f5cb95a02d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:08.964896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a23ba-e4f8-44fd-9716-75f5cb95a02d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:08.965039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a23ba-e4f8-44fd-9716-75f5cb95a02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:08.994101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-167a23ba-e4f8-44fd-9716-75f5cb95a02d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:08.995509 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-167a23ba-e4f8-44fd-9716-75f5cb95a02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:09.066263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 28/59] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:09.331952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bae678-b946-4ae7-abd8-4e2858eb14a0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:09.462300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bae678-b946-4ae7-abd8-4e2858eb14a0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:09.497130 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede8b1-d925-45da-a259-396900760c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:09.497743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede8b1-d925-45da-a259-396900760c32 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:09.498053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede8b1-d925-45da-a259-396900760c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:09.498319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede8b1-d925-45da-a259-396900760c32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:09.499465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fede8b1-d925-45da-a259-396900760c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:09.500907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fede8b1-d925-45da-a259-396900760c32 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:09.502493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 32/60] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:09.511380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a23ba-e4f8-44fd-9716-75f5cb95a02d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:09.618144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:09.621771 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a23ba-e4f8-44fd-9716-75f5cb95a02d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:09.656373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437da13-9bc1-4cf7-846e-ce37d386fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:09.656991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437da13-9bc1-4cf7-846e-ce37d386fd00 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:09.657269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437da13-9bc1-4cf7-846e-ce37d386fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:09.657552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437da13-9bc1-4cf7-846e-ce37d386fd00 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:09.658216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437da13-9bc1-4cf7-846e-ce37d386fd00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:09.659669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437da13-9bc1-4cf7-846e-ce37d386fd00 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:09.688829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 29/61] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:56:09 2022] POST /identity/v3/users => generated 275 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:12.965454 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715df13-7507-4b04-a14c-b0168e62c56f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:12.966470 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715df13-7507-4b04-a14c-b0168e62c56f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:12.966969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715df13-7507-4b04-a14c-b0168e62c56f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:12.968551 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 33/62] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:12.974326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280cc15-d862-4986-bf15-5e812aca7273 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:12.975143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280cc15-d862-4986-bf15-5e812aca7273 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:12.975660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280cc15-d862-4986-bf15-5e812aca7273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:12.995234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6280cc15-d862-4986-bf15-5e812aca7273 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:12.996819 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6280cc15-d862-4986-bf15-5e812aca7273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:13.010827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1c83-3d91-4d91-a89e-566bec474eaf None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:13.011441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1c83-3d91-4d91-a89e-566bec474eaf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:13.011903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1c83-3d91-4d91-a89e-566bec474eaf None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:13.013462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 34/63] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:13.019230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621bf47-0734-4561-b629-29064825cfff None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:13.019751 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621bf47-0734-4561-b629-29064825cfff None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:13.020208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621bf47-0734-4561-b629-29064825cfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:13.046042 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c621bf47-0734-4561-b629-29064825cfff None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:13.047685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c621bf47-0734-4561-b629-29064825cfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:13.073168 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:13.098010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 30/64] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:13.120628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 35/65] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:13.405674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280cc15-d862-4986-bf15-5e812aca7273 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:13.406214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f3430-db15-4088-bbf6-06d0d06e19ba None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:13.406561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f3430-db15-4088-bbf6-06d0d06e19ba None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:13.406840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f3430-db15-4088-bbf6-06d0d06e19ba None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:13.408442 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 36/66] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:13.424486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fcc0e-3716-4ce4-b8f6-7f3c6eb876d3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:13.425076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fcc0e-3716-4ce4-b8f6-7f3c6eb876d3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:13.425968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fcc0e-3716-4ce4-b8f6-7f3c6eb876d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:13.453556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-372fcc0e-3716-4ce4-b8f6-7f3c6eb876d3 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:13.455576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-372fcc0e-3716-4ce4-b8f6-7f3c6eb876d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:13.539009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 37/67] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:13.540439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fcc0e-3716-4ce4-b8f6-7f3c6eb876d3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:13.567802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:13.599557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280cc15-d862-4986-bf15-5e812aca7273 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:13.640277 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224592aa-fa45-40a4-bb85-8a03b4a8ec54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:13.641283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224592aa-fa45-40a4-bb85-8a03b4a8ec54 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:13.641806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224592aa-fa45-40a4-bb85-8a03b4a8ec54 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:13.642313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224592aa-fa45-40a4-bb85-8a03b4a8ec54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:13.654198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224592aa-fa45-40a4-bb85-8a03b4a8ec54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-224592aa-fa45-40a4-bb85-8a03b4a8ec54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:13.660851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:13.661691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:13.662481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:13.665088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 31/68] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:13.667080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59973435-274f-4336-8a6c-2939c1f40576 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:13.667870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59973435-274f-4336-8a6c-2939c1f40576 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:13.668510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59973435-274f-4336-8a6c-2939c1f40576 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:13.670014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 32/69] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:13.672128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59973435-274f-4336-8a6c-2939c1f40576 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:13.703693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:13.721975 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fcc0e-3716-4ce4-b8f6-7f3c6eb876d3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:13.759542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2592-4259-48e3-babb-7aa5df3ceb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:13.760251 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2592-4259-48e3-babb-7aa5df3ceb6f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:13.760865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2592-4259-48e3-babb-7aa5df3ceb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:13.761282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2592-4259-48e3-babb-7aa5df3ceb6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:13.773036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e2592-4259-48e3-babb-7aa5df3ceb6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-524e2592-4259-48e3-babb-7aa5df3ceb6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:13.778662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:13.779686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:13.780632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:13.782753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 38/70] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:56:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:13.784532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459768a6-c490-4a82-a143-2b6aa0fb77bd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:13.784956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459768a6-c490-4a82-a143-2b6aa0fb77bd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:13.785385 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459768a6-c490-4a82-a143-2b6aa0fb77bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:13.794634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59973435-274f-4336-8a6c-2939c1f40576 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:13.804351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-459768a6-c490-4a82-a143-2b6aa0fb77bd None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:13.805698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-459768a6-c490-4a82-a143-2b6aa0fb77bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:13.832733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069cb7c-0850-430d-a335-a5ea266990b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:13.833356 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069cb7c-0850-430d-a335-a5ea266990b8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:13.833640 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069cb7c-0850-430d-a335-a5ea266990b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:13.833945 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069cb7c-0850-430d-a335-a5ea266990b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:13.834621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069cb7c-0850-430d-a335-a5ea266990b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:13.834925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069cb7c-0850-430d-a335-a5ea266990b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:13.836686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069cb7c-0850-430d-a335-a5ea266990b8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:13.845326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 33/71] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:13.847182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac50d24-5b70-4cf5-b083-2fd9fdff6974 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:13.847466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac50d24-5b70-4cf5-b083-2fd9fdff6974 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:13.847734 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac50d24-5b70-4cf5-b083-2fd9fdff6974 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:13.849152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 34/72] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:13.849674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac50d24-5b70-4cf5-b083-2fd9fdff6974 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:13.858585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:13.879288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 39/73] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:13.880135 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459768a6-c490-4a82-a143-2b6aa0fb77bd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:13.954991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:13.957254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac50d24-5b70-4cf5-b083-2fd9fdff6974 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:13.982884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459768a6-c490-4a82-a143-2b6aa0fb77bd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:13.992450 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2166e12-e6bb-4a31-8d0c-de72e64d8066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:13.993073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2166e12-e6bb-4a31-8d0c-de72e64d8066 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:13.993354 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2166e12-e6bb-4a31-8d0c-de72e64d8066 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:13.993637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2166e12-e6bb-4a31-8d0c-de72e64d8066 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:13.994418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2166e12-e6bb-4a31-8d0c-de72e64d8066 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:13.994729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2166e12-e6bb-4a31-8d0c-de72e64d8066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:13.996125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2166e12-e6bb-4a31-8d0c-de72e64d8066 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:14.004605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 35/74] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:14.005411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2166e12-e6bb-4a31-8d0c-de72e64d8066 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:14.023760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdba25-b511-424f-b767-61020680acfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:14.024507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdba25-b511-424f-b767-61020680acfb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:14.024788 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdba25-b511-424f-b767-61020680acfb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:14.025053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdba25-b511-424f-b767-61020680acfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:14.026629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdba25-b511-424f-b767-61020680acfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:14.028093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdba25-b511-424f-b767-61020680acfb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:14.029965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 40/75] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:14.035509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98a73f-ce90-4250-a16f-6142fa035b4c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:14.035795 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98a73f-ce90-4250-a16f-6142fa035b4c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:14.036072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98a73f-ce90-4250-a16f-6142fa035b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:14.053889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7c98a73f-ce90-4250-a16f-6142fa035b4c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:14.055079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7c98a73f-ce90-4250-a16f-6142fa035b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:14.073854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:14.110784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2166e12-e6bb-4a31-8d0c-de72e64d8066 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:14.133864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 41/76] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:14.133864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98a73f-ce90-4250-a16f-6142fa035b4c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:14.156432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b367f-175a-4114-8b46-c312026eb125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:14.157083 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b367f-175a-4114-8b46-c312026eb125 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:14.157362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b367f-175a-4114-8b46-c312026eb125 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:14.157741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b367f-175a-4114-8b46-c312026eb125 None admin] PATH_INFO: `/v3/users/79d620cf4a14435fa08f46effb6890ae` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:14.175729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b367f-175a-4114-8b46-c312026eb125 None admin] RBAC: Authorizing `identity:get_user(user_id=79d620cf4a14435fa08f46effb6890ae)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:14.177208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b367f-175a-4114-8b46-c312026eb125 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:14.178895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 36/77] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:14 2022] GET /identity/v3/users/79d620cf4a14435fa08f46effb6890ae => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:14.178895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b367f-175a-4114-8b46-c312026eb125 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:14.211995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:14.243488 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98a73f-ce90-4250-a16f-6142fa035b4c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:14.278881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b367f-175a-4114-8b46-c312026eb125 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:14.279488 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c96305-bf5a-4df4-8fd3-b1b80ee8d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:14.280383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c96305-bf5a-4df4-8fd3-b1b80ee8d75a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:14.280794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c96305-bf5a-4df4-8fd3-b1b80ee8d75a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:14.281294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c96305-bf5a-4df4-8fd3-b1b80ee8d75a None admin] PATH_INFO: `/v3/users/55aadc9862fd4d0e93e5113dacf48de6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:14.282477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c96305-bf5a-4df4-8fd3-b1b80ee8d75a None admin] RBAC: Authorizing `identity:get_user(user_id=55aadc9862fd4d0e93e5113dacf48de6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:14.283917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c96305-bf5a-4df4-8fd3-b1b80ee8d75a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:14.290095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 42/78] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:14 2022] GET /identity/v3/users/55aadc9862fd4d0e93e5113dacf48de6 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:14.290831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c96305-bf5a-4df4-8fd3-b1b80ee8d75a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:14.304793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:14.314526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eede9-4d3b-4745-855f-bfd70dbc293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:14.315157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eede9-4d3b-4745-855f-bfd70dbc293c None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:14.315440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eede9-4d3b-4745-855f-bfd70dbc293c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:14.315714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eede9-4d3b-4745-855f-bfd70dbc293c None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:14.316378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12eede9-4d3b-4745-855f-bfd70dbc293c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:14.317895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12eede9-4d3b-4745-855f-bfd70dbc293c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:14.340627 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 37/79] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:56:14 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:14.341467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eede9-4d3b-4745-855f-bfd70dbc293c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:14.436317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c96305-bf5a-4df4-8fd3-b1b80ee8d75a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:14.474214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eede9-4d3b-4745-855f-bfd70dbc293c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:14.477583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3e2d5-a68c-4026-9a05-2ec3e95bf342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:14.478299 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e2d5-a68c-4026-9a05-2ec3e95bf342 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:14.478765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e2d5-a68c-4026-9a05-2ec3e95bf342 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:14.479167 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e2d5-a68c-4026-9a05-2ec3e95bf342 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:14.490262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:14.494361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3e2d5-a68c-4026-9a05-2ec3e95bf342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-dcc3e2d5-a68c-4026-9a05-2ec3e95bf342 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:14.499648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:14.500641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:14.501380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 43/80] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:56:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:14.502058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3e2d5-a68c-4026-9a05-2ec3e95bf342 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:14.517535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd33a0d-358d-438b-b055-e73a35ab10f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:14.518200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd33a0d-358d-438b-b055-e73a35ab10f1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:14.518477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd33a0d-358d-438b-b055-e73a35ab10f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:14.518742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd33a0d-358d-438b-b055-e73a35ab10f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:14.579491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:14.605955 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd33a0d-358d-438b-b055-e73a35ab10f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:14.607590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd33a0d-358d-438b-b055-e73a35ab10f1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:14.624546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3e2d5-a68c-4026-9a05-2ec3e95bf342 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:14.671886 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd6104-e620-462f-8aff-7a2234299a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:14.672518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd6104-e620-462f-8aff-7a2234299a73 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:14.672803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd6104-e620-462f-8aff-7a2234299a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:14.673074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd6104-e620-462f-8aff-7a2234299a73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:14.734450 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 38/81] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:14.735308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd33a0d-358d-438b-b055-e73a35ab10f1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:14.751231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd6104-e620-462f-8aff-7a2234299a73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:14.751913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:14.754835 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd6104-e620-462f-8aff-7a2234299a73 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:14.832800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:14.852975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd33a0d-358d-438b-b055-e73a35ab10f1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:14.877761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 44/82] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:14.882130 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd6104-e620-462f-8aff-7a2234299a73 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:14.895112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb571ed-dcd3-40f9-be7c-64e982452457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:14.895766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb571ed-dcd3-40f9-be7c-64e982452457 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:14.896045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb571ed-dcd3-40f9-be7c-64e982452457 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:14.896322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb571ed-dcd3-40f9-be7c-64e982452457 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:14.907637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb571ed-dcd3-40f9-be7c-64e982452457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-beb571ed-dcd3-40f9-be7c-64e982452457 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:14.912597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:14.913508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:14.914280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 39/83] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:14.914898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb571ed-dcd3-40f9-be7c-64e982452457 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:15.011189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:15.015532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd6104-e620-462f-8aff-7a2234299a73 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:15.022289 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb571ed-dcd3-40f9-be7c-64e982452457 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:15.059476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75844b2-76d8-4266-934a-80e6e83b5973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:15.060233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75844b2-76d8-4266-934a-80e6e83b5973 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:15.060603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75844b2-76d8-4266-934a-80e6e83b5973 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:15.060944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75844b2-76d8-4266-934a-80e6e83b5973 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:15.061358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9b51-1236-48e3-b827-d7495e98b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:15.062164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9b51-1236-48e3-b827-d7495e98b5dd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:15.062398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75844b2-76d8-4266-934a-80e6e83b5973 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:15.062618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9b51-1236-48e3-b827-d7495e98b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:15.063063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9b51-1236-48e3-b827-d7495e98b5dd None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:15.064108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75844b2-76d8-4266-934a-80e6e83b5973 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:15.064219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e9b51-1236-48e3-b827-d7495e98b5dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:15.064687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e9b51-1236-48e3-b827-d7495e98b5dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:15.066567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e9b51-1236-48e3-b827-d7495e98b5dd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:15.070953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 40/84] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:14 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:15.071923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75844b2-76d8-4266-934a-80e6e83b5973 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:15.075614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 45/85] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:56:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:15.078768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9b51-1236-48e3-b827-d7495e98b5dd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:15.090817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:15.194280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9b51-1236-48e3-b827-d7495e98b5dd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:15.194767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75844b2-76d8-4266-934a-80e6e83b5973 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:15.230239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffe553-3626-4be1-bf04-dc8a7557bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:15.231376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe553-3626-4be1-bf04-dc8a7557bd93 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:15.231664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe553-3626-4be1-bf04-dc8a7557bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:15.231938 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe553-3626-4be1-bf04-dc8a7557bd93 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:15.232611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffe553-3626-4be1-bf04-dc8a7557bd93 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:15.232911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffe553-3626-4be1-bf04-dc8a7557bd93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:15.234535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffe553-3626-4be1-bf04-dc8a7557bd93 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:15.234748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6404d5-f24d-4fad-8d24-81463b930216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:15.235467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6404d5-f24d-4fad-8d24-81463b930216 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:15.235910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6404d5-f24d-4fad-8d24-81463b930216 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:15.236273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6404d5-f24d-4fad-8d24-81463b930216 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:15.237596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6404d5-f24d-4fad-8d24-81463b930216 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:15.239161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6404d5-f24d-4fad-8d24-81463b930216 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:15.241226 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 41/86] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:15 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:15.242153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6404d5-f24d-4fad-8d24-81463b930216 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:15.248402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 46/87] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:15.249464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffe553-3626-4be1-bf04-dc8a7557bd93 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:15.281954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:15.346781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:15.366816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffe553-3626-4be1-bf04-dc8a7557bd93 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:15.374743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6404d5-f24d-4fad-8d24-81463b930216 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:15.405991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de167d-b25a-4f00-b42f-b25b5a99dc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:15.406877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de167d-b25a-4f00-b42f-b25b5a99dc58 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:15.407345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de167d-b25a-4f00-b42f-b25b5a99dc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:15.407852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de167d-b25a-4f00-b42f-b25b5a99dc58 None admin] PATH_INFO: `/v3/users/79d620cf4a14435fa08f46effb6890ae` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:15.409167 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de167d-b25a-4f00-b42f-b25b5a99dc58 None admin] RBAC: Authorizing `identity:get_user(user_id=79d620cf4a14435fa08f46effb6890ae)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:15.411075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de167d-b25a-4f00-b42f-b25b5a99dc58 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:15.413189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 47/88] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:15 2022] GET /identity/v3/users/79d620cf4a14435fa08f46effb6890ae => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:15.414302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de167d-b25a-4f00-b42f-b25b5a99dc58 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:15.421259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c8dba-476e-4f4f-85d3-729f662f0477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:15.421917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c8dba-476e-4f4f-85d3-729f662f0477 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:15.422203 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c8dba-476e-4f4f-85d3-729f662f0477 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:15.422478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c8dba-476e-4f4f-85d3-729f662f0477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:15.423223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c8dba-476e-4f4f-85d3-729f662f0477 None admin] RBAC: Adding query filter params (role.id=92f2004a6ac04948af8cd639d0d09f09, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80, user.id=79d620cf4a14435fa08f46effb6890ae) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:15.423534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c8dba-476e-4f4f-85d3-729f662f0477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:15.425595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c8dba-476e-4f4f-85d3-729f662f0477 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:15.436530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 42/89] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:15 2022] GET /identity/v3/role_assignments?user.id=79d620cf4a14435fa08f46effb6890ae&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:15.437373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c8dba-476e-4f4f-85d3-729f662f0477 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:15.526964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:15.537939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de167d-b25a-4f00-b42f-b25b5a99dc58 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:15.573139 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c8dba-476e-4f4f-85d3-729f662f0477 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:15.603394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca17a34-f113-404a-a014-205f9c5088f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:15.604601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca17a34-f113-404a-a014-205f9c5088f0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:15.605090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca17a34-f113-404a-a014-205f9c5088f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:15.605560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca17a34-f113-404a-a014-205f9c5088f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:15.606581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca17a34-f113-404a-a014-205f9c5088f0 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80, user.id=55aadc9862fd4d0e93e5113dacf48de6) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:15.607114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca17a34-f113-404a-a014-205f9c5088f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:15.608955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca17a34-f113-404a-a014-205f9c5088f0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:15.622030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 48/90] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:15 2022] GET /identity/v3/role_assignments?user.id=55aadc9862fd4d0e93e5113dacf48de6&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:15.623428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca17a34-f113-404a-a014-205f9c5088f0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:15.626313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf0289-ff33-4608-8024-961f0f1a8ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:15.627374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf0289-ff33-4608-8024-961f0f1a8ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:15.627659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf0289-ff33-4608-8024-961f0f1a8ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:15.627939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf0289-ff33-4608-8024-961f0f1a8ff7 None admin] PATH_INFO: `/v3/users/79d620cf4a14435fa08f46effb6890ae` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:15.630580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf0289-ff33-4608-8024-961f0f1a8ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=79d620cf4a14435fa08f46effb6890ae)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:15.632243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf0289-ff33-4608-8024-961f0f1a8ff7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:15.635393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 43/91] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:15 2022] GET /identity/v3/users/79d620cf4a14435fa08f46effb6890ae => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:15.640163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf0289-ff33-4608-8024-961f0f1a8ff7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:15.671290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:15.779927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca17a34-f113-404a-a014-205f9c5088f0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:15.825899 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf0289-ff33-4608-8024-961f0f1a8ff7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:15.828010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66e82c-7916-4238-9f88-d764b946e979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:15.828643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66e82c-7916-4238-9f88-d764b946e979 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:15.828917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66e82c-7916-4238-9f88-d764b946e979 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:15.829184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66e82c-7916-4238-9f88-d764b946e979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:15.905013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:15.923892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb4507-b492-4d36-955d-fd0826c2b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:15.924531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb4507-b492-4d36-955d-fd0826c2b1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:15.924802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb4507-b492-4d36-955d-fd0826c2b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:15.925075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb4507-b492-4d36-955d-fd0826c2b1b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:15.987915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66e82c-7916-4238-9f88-d764b946e979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:15.989415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66e82c-7916-4238-9f88-d764b946e979 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:16.061355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb4507-b492-4d36-955d-fd0826c2b1b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:16.062883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb4507-b492-4d36-955d-fd0826c2b1b9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:16.082965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:16.175063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 49/92] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:16.182244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66e82c-7916-4238-9f88-d764b946e979 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:16.240858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 44/93] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:16.246930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb4507-b492-4d36-955d-fd0826c2b1b9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:16.282077 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:16.351424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66e82c-7916-4238-9f88-d764b946e979 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:16.419499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22921af1-2c21-43c3-aa47-dbec7def3db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:16.420161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22921af1-2c21-43c3-aa47-dbec7def3db6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:16.420437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22921af1-2c21-43c3-aa47-dbec7def3db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:16.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22921af1-2c21-43c3-aa47-dbec7def3db6 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:16.422228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22921af1-2c21-43c3-aa47-dbec7def3db6 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:16.423706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22921af1-2c21-43c3-aa47-dbec7def3db6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:16.425381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 50/94] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:16 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:16.431480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22921af1-2c21-43c3-aa47-dbec7def3db6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:16.437413 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb4507-b492-4d36-955d-fd0826c2b1b9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:16.474295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:16.516606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4934e3f-cae3-4bb9-bf04-42bcfe52dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:16.517387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4934e3f-cae3-4bb9-bf04-42bcfe52dc86 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:16.517666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4934e3f-cae3-4bb9-bf04-42bcfe52dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:16.521863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4934e3f-cae3-4bb9-bf04-42bcfe52dc86 None admin] PATH_INFO: `/v3/projects/694f50f94c824aba85ea055a5999b255` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:16.522549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4934e3f-cae3-4bb9-bf04-42bcfe52dc86 None admin] RBAC: Authorizing `identity:get_project(project_id=694f50f94c824aba85ea055a5999b255)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:16.524438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4934e3f-cae3-4bb9-bf04-42bcfe52dc86 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:16.526040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 45/95] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:16 2022] GET /identity/v3/projects/694f50f94c824aba85ea055a5999b255 => generated 312 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:16.532052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4934e3f-cae3-4bb9-bf04-42bcfe52dc86 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:16.606383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22921af1-2c21-43c3-aa47-dbec7def3db6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:16.649860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:16.670247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68f47e-a5b3-4ce5-bf91-3625a6ced49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:16.671244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68f47e-a5b3-4ce5-bf91-3625a6ced49d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:16.671716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68f47e-a5b3-4ce5-bf91-3625a6ced49d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:16.672178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68f47e-a5b3-4ce5-bf91-3625a6ced49d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:16.673105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68f47e-a5b3-4ce5-bf91-3625a6ced49d None admin] RBAC: Adding query filter params (role.id=dcc8ff85c52344698c38ecafb6b0978c, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80, user.id=79d620cf4a14435fa08f46effb6890ae) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:16.673621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68f47e-a5b3-4ce5-bf91-3625a6ced49d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:16.675311 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68f47e-a5b3-4ce5-bf91-3625a6ced49d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:16.686649 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 51/96] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:16 2022] GET /identity/v3/role_assignments?user.id=79d620cf4a14435fa08f46effb6890ae&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=dcc8ff85c52344698c38ecafb6b0978c => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:16.751168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4934e3f-cae3-4bb9-bf04-42bcfe52dc86 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:16.808880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f55e25-c495-4a0e-9900-fea6305b5e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:16.809536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f55e25-c495-4a0e-9900-fea6305b5e57 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:16.809815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f55e25-c495-4a0e-9900-fea6305b5e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:16.810109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f55e25-c495-4a0e-9900-fea6305b5e57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:16.810876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f55e25-c495-4a0e-9900-fea6305b5e57 None admin] RBAC: Adding query filter params (role.id=92f2004a6ac04948af8cd639d0d09f09, scope.project.id=694f50f94c824aba85ea055a5999b255, user.id=79d620cf4a14435fa08f46effb6890ae) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:16.811177 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f55e25-c495-4a0e-9900-fea6305b5e57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:16.812678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f55e25-c495-4a0e-9900-fea6305b5e57 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:16.819524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 46/97] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:16 2022] GET /identity/v3/role_assignments?user.id=79d620cf4a14435fa08f46effb6890ae&scope.project.id=694f50f94c824aba85ea055a5999b255&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:16.915099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45510e-79ab-4093-b1e9-4f1708e0d793 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:16.915705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45510e-79ab-4093-b1e9-4f1708e0d793 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:16.916309 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45510e-79ab-4093-b1e9-4f1708e0d793 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:16.918173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 52/98] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:16.924216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a9584-b709-4540-89ae-3b37c87f286e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:16.924522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a9584-b709-4540-89ae-3b37c87f286e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:16.924769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a9584-b709-4540-89ae-3b37c87f286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:16.950761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-502a9584-b709-4540-89ae-3b37c87f286e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:16.952010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-502a9584-b709-4540-89ae-3b37c87f286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:16.993023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:17.035278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 47/99] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:17.158762 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98314d0c-d978-4ec2-9819-b17ad1e7e59b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:17.159440 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98314d0c-d978-4ec2-9819-b17ad1e7e59b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:17.159919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98314d0c-d978-4ec2-9819-b17ad1e7e59b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:17.161681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 53/100] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:17.168304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d687-faa0-4b72-9390-f601fd5bfa94 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:17.168816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d687-faa0-4b72-9390-f601fd5bfa94 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:17.168816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d687-faa0-4b72-9390-f601fd5bfa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:17.198934 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9d36d687-faa0-4b72-9390-f601fd5bfa94 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:17.200140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9d36d687-faa0-4b72-9390-f601fd5bfa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:17.283247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 48/101] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:17.398980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98314d0c-d978-4ec2-9819-b17ad1e7e59b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:17.539523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98314d0c-d978-4ec2-9819-b17ad1e7e59b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:17.581432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09d0b3-c2be-416e-be9b-e80eb1f6a450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:17.582540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09d0b3-c2be-416e-be9b-e80eb1f6a450 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:17.583036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09d0b3-c2be-416e-be9b-e80eb1f6a450 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:17.583552 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09d0b3-c2be-416e-be9b-e80eb1f6a450 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:17.596791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09d0b3-c2be-416e-be9b-e80eb1f6a450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-fd09d0b3-c2be-416e-be9b-e80eb1f6a450 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:17.602559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:17.603439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:17.604277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:17.606578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 54/102] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:17.614978 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36d687-faa0-4b72-9390-f601fd5bfa94 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:17.721032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09d0b3-c2be-416e-be9b-e80eb1f6a450 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:17.740748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36d687-faa0-4b72-9390-f601fd5bfa94 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:17.742119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:17.797145 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefddfc-aaef-469a-a641-2677eb97af6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:17.797803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefddfc-aaef-469a-a641-2677eb97af6b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:17.798144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefddfc-aaef-469a-a641-2677eb97af6b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:17.798420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefddfc-aaef-469a-a641-2677eb97af6b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:17.799127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefddfc-aaef-469a-a641-2677eb97af6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:17.799434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefddfc-aaef-469a-a641-2677eb97af6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:17.800853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefddfc-aaef-469a-a641-2677eb97af6b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:17.819767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 49/103] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:17.820760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefddfc-aaef-469a-a641-2677eb97af6b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:17.824289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:17.902896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09d0b3-c2be-416e-be9b-e80eb1f6a450 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:17.966279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2367f-197f-4ae1-8518-71525654394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:17.966929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2367f-197f-4ae1-8518-71525654394b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:17.967205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2367f-197f-4ae1-8518-71525654394b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:17.967478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2367f-197f-4ae1-8518-71525654394b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:17.969254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2367f-197f-4ae1-8518-71525654394b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:17.970871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2367f-197f-4ae1-8518-71525654394b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:17.972633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 55/104] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:17.978170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2367f-197f-4ae1-8518-71525654394b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:18.026587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefddfc-aaef-469a-a641-2677eb97af6b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:18.076971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc4dab-e62b-4137-922f-f5017921617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:18.077542 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc4dab-e62b-4137-922f-f5017921617f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:18.077822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc4dab-e62b-4137-922f-f5017921617f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:18.078132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc4dab-e62b-4137-922f-f5017921617f None admin] PATH_INFO: `/v3/users/d807f29957f0443594e0040b06bcb55f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:18.102537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc4dab-e62b-4137-922f-f5017921617f None admin] RBAC: Authorizing `identity:get_user(user_id=d807f29957f0443594e0040b06bcb55f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:18.104090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc4dab-e62b-4137-922f-f5017921617f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:18.106184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 50/105] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:17 2022] GET /identity/v3/users/d807f29957f0443594e0040b06bcb55f => generated 289 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:18.113455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc4dab-e62b-4137-922f-f5017921617f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:18.158221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:18.227821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2367f-197f-4ae1-8518-71525654394b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:18.263436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:18.267025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc4dab-e62b-4137-922f-f5017921617f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:18.322649 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e1a9f-45dd-44a3-b866-842f61ed519b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:18.323286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e1a9f-45dd-44a3-b866-842f61ed519b None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:18.323729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e1a9f-45dd-44a3-b866-842f61ed519b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:18.324012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e1a9f-45dd-44a3-b866-842f61ed519b None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:18.324781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e1a9f-45dd-44a3-b866-842f61ed519b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:18.326432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e1a9f-45dd-44a3-b866-842f61ed519b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:18.330693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c243e-f198-401d-88f5-4d92a5ba358b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:18.331273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c243e-f198-401d-88f5-4d92a5ba358b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:18.331549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c243e-f198-401d-88f5-4d92a5ba358b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:18.331819 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c243e-f198-401d-88f5-4d92a5ba358b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:18.389215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 56/106] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:56:17 2022] POST /identity/v3/projects => generated 302 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 21:56:18.446851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c243e-f198-401d-88f5-4d92a5ba358b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:18.448487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c243e-f198-401d-88f5-4d92a5ba358b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:18.486923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:18.594190 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 51/107] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 21:56:18.603096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e1a9f-45dd-44a3-b866-842f61ed519b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:18.757124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e1a9f-45dd-44a3-b866-842f61ed519b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:18.802868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf84606-8ad1-4764-8f35-40aca1937bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:18.803516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf84606-8ad1-4764-8f35-40aca1937bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:18.803798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf84606-8ad1-4764-8f35-40aca1937bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:18.804074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf84606-8ad1-4764-8f35-40aca1937bf4 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:18.808005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf84606-8ad1-4764-8f35-40aca1937bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:18.809142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5bf3e-ddf0-4f3b-adf5-ce7b835a800d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:18.809428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5bf3e-ddf0-4f3b-adf5-ce7b835a800d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:18.809523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf84606-8ad1-4764-8f35-40aca1937bf4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:18.809705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5bf3e-ddf0-4f3b-adf5-ce7b835a800d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:18.811303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 52/108] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:18.811723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 57/109] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:18 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:18.817435 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf84606-8ad1-4764-8f35-40aca1937bf4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:18.817748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202856e-b2b7-4260-b33c-8fada02c90d6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:18.818059 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202856e-b2b7-4260-b33c-8fada02c90d6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:18.818332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202856e-b2b7-4260-b33c-8fada02c90d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:18.849971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8202856e-b2b7-4260-b33c-8fada02c90d6 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:18.851270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8202856e-b2b7-4260-b33c-8fada02c90d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:18.867143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:18.983127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 53/110] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:18.988511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf84606-8ad1-4764-8f35-40aca1937bf4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:19.045667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f43f7b-3a26-472f-adea-bdee1bdccf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:19.046313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f43f7b-3a26-472f-adea-bdee1bdccf4d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:19.046594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f43f7b-3a26-472f-adea-bdee1bdccf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:19.046867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f43f7b-3a26-472f-adea-bdee1bdccf4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:19.047610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f43f7b-3a26-472f-adea-bdee1bdccf4d None admin] RBAC: Adding query filter params (role.id=36b37fbf95184e75911ca9f9e5d963d9, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80, user.id=d807f29957f0443594e0040b06bcb55f) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:19.047918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f43f7b-3a26-472f-adea-bdee1bdccf4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:19.049374 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f43f7b-3a26-472f-adea-bdee1bdccf4d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:19.058624 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 58/111] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:18 2022] GET /identity/v3/role_assignments?user.id=d807f29957f0443594e0040b06bcb55f&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=36b37fbf95184e75911ca9f9e5d963d9 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:19.166305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e6fc4-f3ec-4575-b243-b40543c541c4 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:19.166605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e6fc4-f3ec-4575-b243-b40543c541c4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:19.166810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e6fc4-f3ec-4575-b243-b40543c541c4 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:19.168481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 54/112] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:19.174076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b01d9f-e003-4c45-91ee-5e3a722edac4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:19.174366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b01d9f-e003-4c45-91ee-5e3a722edac4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:19.174648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b01d9f-e003-4c45-91ee-5e3a722edac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:19.199038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a5b01d9f-e003-4c45-91ee-5e3a722edac4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:19.200295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a5b01d9f-e003-4c45-91ee-5e3a722edac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:19.299504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 59/113] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:19.301249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e6fc4-f3ec-4575-b243-b40543c541c4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:19.377327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:19.442629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e6fc4-f3ec-4575-b243-b40543c541c4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:19.491128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbba96-0f10-402e-b9fa-5bcf4967ce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:19.491790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbba96-0f10-402e-b9fa-5bcf4967ce0f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:19.492074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbba96-0f10-402e-b9fa-5bcf4967ce0f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:19.492352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbba96-0f10-402e-b9fa-5bcf4967ce0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:19.509545 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbba96-0f10-402e-b9fa-5bcf4967ce0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-52cbba96-0f10-402e-b9fa-5bcf4967ce0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:19.514829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:19.516222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:19.518244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 55/114] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:56:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:19.522503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b01d9f-e003-4c45-91ee-5e3a722edac4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:19.564709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:19.663971 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b01d9f-e003-4c45-91ee-5e3a722edac4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:19.722811 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c131cf-def8-4969-8709-815705d68a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:19.723435 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c131cf-def8-4969-8709-815705d68a56 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:19.723716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c131cf-def8-4969-8709-815705d68a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:19.723989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c131cf-def8-4969-8709-815705d68a56 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:19.724669 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c131cf-def8-4969-8709-815705d68a56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:19.724972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c131cf-def8-4969-8709-815705d68a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:19.726399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c131cf-def8-4969-8709-815705d68a56 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:19.735177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 60/115] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:19.740751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbba96-0f10-402e-b9fa-5bcf4967ce0f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:19.845875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c131cf-def8-4969-8709-815705d68a56 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:19.892956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbba96-0f10-402e-b9fa-5bcf4967ce0f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:19.918713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:19.957050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab8d9d-a1b0-43cf-abb3-ec1c0c21d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:19.957777 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8d9d-a1b0-43cf-abb3-ec1c0c21d8eb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:19.958122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8d9d-a1b0-43cf-abb3-ec1c0c21d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:19.958399 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8d9d-a1b0-43cf-abb3-ec1c0c21d8eb None admin] PATH_INFO: `/v3/users/55aadc9862fd4d0e93e5113dacf48de6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:19.960273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab8d9d-a1b0-43cf-abb3-ec1c0c21d8eb None admin] RBAC: Authorizing `identity:get_user(user_id=55aadc9862fd4d0e93e5113dacf48de6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:19.963585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab8d9d-a1b0-43cf-abb3-ec1c0c21d8eb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:19.966910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 56/116] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:19 2022] GET /identity/v3/users/55aadc9862fd4d0e93e5113dacf48de6 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:19.973131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab8d9d-a1b0-43cf-abb3-ec1c0c21d8eb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:20.012755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:20.022277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c131cf-def8-4969-8709-815705d68a56 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:20.066646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb14af-6dc1-413c-a400-94a7a3c9ed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:20.067318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb14af-6dc1-413c-a400-94a7a3c9ed22 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:20.067597 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb14af-6dc1-413c-a400-94a7a3c9ed22 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:20.067864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb14af-6dc1-413c-a400-94a7a3c9ed22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:20.091990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb14af-6dc1-413c-a400-94a7a3c9ed22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8bdb14af-6dc1-413c-a400-94a7a3c9ed22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:20.097473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:20.098339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:20.099084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:20.111207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 61/117] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:56:20.112682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4b68e-cc80-4bb8-89de-b8a508a97df0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:20.112965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4b68e-cc80-4bb8-89de-b8a508a97df0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:20.113234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4b68e-cc80-4bb8-89de-b8a508a97df0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:20.114680 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 62/118] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:20.118995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4b68e-cc80-4bb8-89de-b8a508a97df0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:20.127192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab8d9d-a1b0-43cf-abb3-ec1c0c21d8eb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:20.163619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9b777-d4ca-4a60-86ed-97d202543ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:20.164279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b777-d4ca-4a60-86ed-97d202543ddb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:20.164611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b777-d4ca-4a60-86ed-97d202543ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:20.164897 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9b777-d4ca-4a60-86ed-97d202543ddb None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:20.166151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9b777-d4ca-4a60-86ed-97d202543ddb None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:20.168273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9b777-d4ca-4a60-86ed-97d202543ddb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:20.170719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 57/119] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:19 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:20.171798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5789c-bfa8-457a-baf7-c7359ca98bea None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:20.172081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5789c-bfa8-457a-baf7-c7359ca98bea None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:20.172358 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5789c-bfa8-457a-baf7-c7359ca98bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:20.198144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b9d5789c-bfa8-457a-baf7-c7359ca98bea None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:20.199612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b9d5789c-bfa8-457a-baf7-c7359ca98bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:20.251618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:20.277716 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 58/120] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:20.278736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5789c-bfa8-457a-baf7-c7359ca98bea None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:20.315127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4b68e-cc80-4bb8-89de-b8a508a97df0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:20.392751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5789c-bfa8-457a-baf7-c7359ca98bea None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:20.395327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f5205-3191-40d1-92d9-134bf140949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:20.395959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f5205-3191-40d1-92d9-134bf140949c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:20.396233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f5205-3191-40d1-92d9-134bf140949c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:20.396498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f5205-3191-40d1-92d9-134bf140949c None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:20.397169 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f5205-3191-40d1-92d9-134bf140949c None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:20.397466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f5205-3191-40d1-92d9-134bf140949c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:20.398884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f5205-3191-40d1-92d9-134bf140949c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:20.416816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 63/121] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:20.418326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c97f3-cf65-4895-b0ac-1f03cdffb938 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:20.418609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c97f3-cf65-4895-b0ac-1f03cdffb938 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:20.418875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c97f3-cf65-4895-b0ac-1f03cdffb938 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:20.420364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 64/122] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:20.424189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c97f3-cf65-4895-b0ac-1f03cdffb938 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:20.428467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a00c2d-fa84-4840-ac09-8ade2838ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:20.429156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a00c2d-fa84-4840-ac09-8ade2838ce4b None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:20.429436 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a00c2d-fa84-4840-ac09-8ade2838ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:20.429711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a00c2d-fa84-4840-ac09-8ade2838ce4b None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/users/55aadc9862fd4d0e93e5113dacf48de6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:20.431760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a00c2d-fa84-4840-ac09-8ade2838ce4b None admin] RBAC: Authorizing `identity:create_grant(project_id=4426e8bcefe54612af19bbbfa1a25f80, user_id=55aadc9862fd4d0e93e5113dacf48de6, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:20.433327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a00c2d-fa84-4840-ac09-8ade2838ce4b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:20.442048 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:20.451300 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 59/123] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:56:20 2022] PUT /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/users/55aadc9862fd4d0e93e5113dacf48de6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:56:20.453076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84abc66-43a2-41bd-be32-90fd81ff5582 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:20.453611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84abc66-43a2-41bd-be32-90fd81ff5582 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:20.454188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84abc66-43a2-41bd-be32-90fd81ff5582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:20.477112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c84abc66-43a2-41bd-be32-90fd81ff5582 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:20.478898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c84abc66-43a2-41bd-be32-90fd81ff5582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:20.513701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:20.610549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c97f3-cf65-4895-b0ac-1f03cdffb938 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:20.632124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 60/124] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:20.641062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84abc66-43a2-41bd-be32-90fd81ff5582 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:20.676376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15d7c5-3ae9-4959-9612-9c30b2450cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:20.677904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15d7c5-3ae9-4959-9612-9c30b2450cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:20.678400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15d7c5-3ae9-4959-9612-9c30b2450cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:20.679225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15d7c5-3ae9-4959-9612-9c30b2450cc6 None admin] PATH_INFO: `/v3/users/79d620cf4a14435fa08f46effb6890ae` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:20.683125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15d7c5-3ae9-4959-9612-9c30b2450cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=79d620cf4a14435fa08f46effb6890ae)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:20.684866 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15d7c5-3ae9-4959-9612-9c30b2450cc6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:20.686831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 65/125] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:20 2022] GET /identity/v3/users/79d620cf4a14435fa08f46effb6890ae => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:20.692565 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15d7c5-3ae9-4959-9612-9c30b2450cc6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:20.839583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84abc66-43a2-41bd-be32-90fd81ff5582 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:20.878625 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486f49-4c86-4bde-aaf7-1d3a44a2f03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:20.879686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486f49-4c86-4bde-aaf7-1d3a44a2f03e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:20.880164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486f49-4c86-4bde-aaf7-1d3a44a2f03e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:20.880628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486f49-4c86-4bde-aaf7-1d3a44a2f03e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:20.892512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76486f49-4c86-4bde-aaf7-1d3a44a2f03e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:20.895931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-76486f49-4c86-4bde-aaf7-1d3a44a2f03e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:20.899163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:20.899985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:20.900880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:20.903192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 61/126] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:56:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:56:20.925216 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15d7c5-3ae9-4959-9612-9c30b2450cc6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:20.939260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486f49-4c86-4bde-aaf7-1d3a44a2f03e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:20.967586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d30b6-ba30-4655-a0a4-1e4775e79293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:20.968232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d30b6-ba30-4655-a0a4-1e4775e79293 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:20.968514 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d30b6-ba30-4655-a0a4-1e4775e79293 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:20.968787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d30b6-ba30-4655-a0a4-1e4775e79293 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:20.970578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d30b6-ba30-4655-a0a4-1e4775e79293 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:20.972068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d30b6-ba30-4655-a0a4-1e4775e79293 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:20.974057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 66/127] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:20 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:20.984974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d30b6-ba30-4655-a0a4-1e4775e79293 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:21.001709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:21.122671 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486f49-4c86-4bde-aaf7-1d3a44a2f03e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:21.149241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d30b6-ba30-4655-a0a4-1e4775e79293 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:21.187726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e78b8b-a7ef-4cf5-9381-3e98239f6b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:21.188724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e78b8b-a7ef-4cf5-9381-3e98239f6b3b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:21.189199 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e78b8b-a7ef-4cf5-9381-3e98239f6b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:21.189663 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e78b8b-a7ef-4cf5-9381-3e98239f6b3b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:21.190619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e78b8b-a7ef-4cf5-9381-3e98239f6b3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:21.191142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e78b8b-a7ef-4cf5-9381-3e98239f6b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:21.192743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e78b8b-a7ef-4cf5-9381-3e98239f6b3b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:21.203837 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 62/128] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:56:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:21.205739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e78b8b-a7ef-4cf5-9381-3e98239f6b3b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:21.230586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07caa7a-113b-480b-9235-a658c6849100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:21.231282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caa7a-113b-480b-9235-a658c6849100 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:21.231560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caa7a-113b-480b-9235-a658c6849100 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:21.231829 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caa7a-113b-480b-9235-a658c6849100 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/users/79d620cf4a14435fa08f46effb6890ae/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:21.233863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07caa7a-113b-480b-9235-a658c6849100 None admin] RBAC: Authorizing `identity:create_grant(project_id=4426e8bcefe54612af19bbbfa1a25f80, user_id=79d620cf4a14435fa08f46effb6890ae, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:21.235337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07caa7a-113b-480b-9235-a658c6849100 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:21.284090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 67/129] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:56:20 2022] PUT /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/users/79d620cf4a14435fa08f46effb6890ae/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 21:56:21.284961 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07caa7a-113b-480b-9235-a658c6849100 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:21.311977 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:21.323062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:21.331960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e78b8b-a7ef-4cf5-9381-3e98239f6b3b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:21.374047 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c47f4-032e-4e8f-a29b-72a4abef379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:21.374770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c47f4-032e-4e8f-a29b-72a4abef379a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:21.375053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c47f4-032e-4e8f-a29b-72a4abef379a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:21.375329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c47f4-032e-4e8f-a29b-72a4abef379a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:21.387439 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c47f4-032e-4e8f-a29b-72a4abef379a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a16c47f4-032e-4e8f-a29b-72a4abef379a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:21.394223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:21.395532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:21.396323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 63/130] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:21.403962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c47f4-032e-4e8f-a29b-72a4abef379a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:21.561734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07caa7a-113b-480b-9235-a658c6849100 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:21.574981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c47f4-032e-4e8f-a29b-72a4abef379a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:21.619672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6a2fc-de85-455b-bad8-23a67bd02072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:21.620338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6a2fc-de85-455b-bad8-23a67bd02072 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:21.620618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6a2fc-de85-455b-bad8-23a67bd02072 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:21.620889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6a2fc-de85-455b-bad8-23a67bd02072 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:21.621575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6a2fc-de85-455b-bad8-23a67bd02072 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:21.621905 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6a2fc-de85-455b-bad8-23a67bd02072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:21.622573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9a4cb-4b80-4e31-a43e-74703985de7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:21.623335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6a2fc-de85-455b-bad8-23a67bd02072 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:21.623523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a4cb-4b80-4e31-a43e-74703985de7a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:21.623933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a4cb-4b80-4e31-a43e-74703985de7a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:21.624392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a4cb-4b80-4e31-a43e-74703985de7a None admin] PATH_INFO: `/v3/users/79d620cf4a14435fa08f46effb6890ae` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:21.625703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9a4cb-4b80-4e31-a43e-74703985de7a None admin] RBAC: Authorizing `identity:get_user(user_id=79d620cf4a14435fa08f46effb6890ae)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:21.627316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9a4cb-4b80-4e31-a43e-74703985de7a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:21.629056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 68/131] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:21 2022] GET /identity/v3/users/79d620cf4a14435fa08f46effb6890ae => generated 275 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:21.632829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 64/132] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:21.640622 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9a4cb-4b80-4e31-a43e-74703985de7a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:21.640853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6a2fc-de85-455b-bad8-23a67bd02072 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:21.686442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:21.781547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:21.825908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9a4cb-4b80-4e31-a43e-74703985de7a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:21.830974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6a2fc-de85-455b-bad8-23a67bd02072 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:21.894312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48650678-1190-45fd-9c40-816b1dde0bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:21.895542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48650678-1190-45fd-9c40-816b1dde0bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:21.896487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48650678-1190-45fd-9c40-816b1dde0bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:21.897275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc77ad-077b-4db3-86b3-b9a6a2185e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:21.897731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48650678-1190-45fd-9c40-816b1dde0bc2 None admin] PATH_INFO: `/v3/users/79d620cf4a14435fa08f46effb6890ae` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:21.898579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc77ad-077b-4db3-86b3-b9a6a2185e53 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:21.899652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc77ad-077b-4db3-86b3-b9a6a2185e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:21.900652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48650678-1190-45fd-9c40-816b1dde0bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=79d620cf4a14435fa08f46effb6890ae)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:21.901089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc77ad-077b-4db3-86b3-b9a6a2185e53 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:21.903387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48650678-1190-45fd-9c40-816b1dde0bc2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:21.904227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc77ad-077b-4db3-86b3-b9a6a2185e53 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:21.907179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 69/133] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:21 2022] GET /identity/v3/users/79d620cf4a14435fa08f46effb6890ae => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:21.912359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc77ad-077b-4db3-86b3-b9a6a2185e53 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:21.914352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 65/134] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:21 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:21.916117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdab7f-79b6-4729-b5b6-35356da9d899 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:21.916764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdab7f-79b6-4729-b5b6-35356da9d899 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:21.917178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdab7f-79b6-4729-b5b6-35356da9d899 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:21.919163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 70/135] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:21.920197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc77ad-077b-4db3-86b3-b9a6a2185e53 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:21.921413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdab7f-79b6-4729-b5b6-35356da9d899 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:22.061652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:22.092674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc77ad-077b-4db3-86b3-b9a6a2185e53 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:22.115664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdab7f-79b6-4729-b5b6-35356da9d899 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:22.128006 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518a72c-9cf7-45df-aa6d-3c7c162b659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:22.128933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a72c-9cf7-45df-aa6d-3c7c162b659d None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:22.129213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a72c-9cf7-45df-aa6d-3c7c162b659d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:22.129488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a72c-9cf7-45df-aa6d-3c7c162b659d None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/users/79d620cf4a14435fa08f46effb6890ae/roles/dcc8ff85c52344698c38ecafb6b0978c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:22.131728 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518a72c-9cf7-45df-aa6d-3c7c162b659d None admin] RBAC: Authorizing `identity:create_grant(project_id=4426e8bcefe54612af19bbbfa1a25f80, user_id=79d620cf4a14435fa08f46effb6890ae, role_id=dcc8ff85c52344698c38ecafb6b0978c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:22.133194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518a72c-9cf7-45df-aa6d-3c7c162b659d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:22.150518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 66/136] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:56:21 2022] PUT /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/users/79d620cf4a14435fa08f46effb6890ae/roles/dcc8ff85c52344698c38ecafb6b0978c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:56:22.151974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6f58-2cf0-438a-9559-0b48609af092 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:22.152370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6f58-2cf0-438a-9559-0b48609af092 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:22.152643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6f58-2cf0-438a-9559-0b48609af092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:22.164732 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026c89a-41ce-429a-a599-bb3b5aa4d636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:22.165767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c89a-41ce-429a-a599-bb3b5aa4d636 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:22.166428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c89a-41ce-429a-a599-bb3b5aa4d636 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:22.167015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c89a-41ce-429a-a599-bb3b5aa4d636 None admin] PATH_INFO: `/v3/projects/694f50f94c824aba85ea055a5999b255` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:22.168989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026c89a-41ce-429a-a599-bb3b5aa4d636 None admin] RBAC: Authorizing `identity:get_project(project_id=694f50f94c824aba85ea055a5999b255)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:22.171047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026c89a-41ce-429a-a599-bb3b5aa4d636 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:22.173288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 71/137] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:21 2022] GET /identity/v3/projects/694f50f94c824aba85ea055a5999b255 => generated 312 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:22.174530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-70ae6f58-2cf0-438a-9559-0b48609af092 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:22.175040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da8b3d-651b-41d2-953c-adde4b57b257 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:22.175523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da8b3d-651b-41d2-953c-adde4b57b257 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:22.175889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-70ae6f58-2cf0-438a-9559-0b48609af092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:22.176250 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da8b3d-651b-41d2-953c-adde4b57b257 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:22.177895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 72/138] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:22.184495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da8b3d-651b-41d2-953c-adde4b57b257 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:22.208086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:22.283037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 67/139] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:22.284508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be2632-b1ee-4915-bccc-6212f5753af2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:22.289577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be2632-b1ee-4915-bccc-6212f5753af2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:22.289956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be2632-b1ee-4915-bccc-6212f5753af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:22.322110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-73be2632-b1ee-4915-bccc-6212f5753af2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:22.323517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-73be2632-b1ee-4915-bccc-6212f5753af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:22.426956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da8b3d-651b-41d2-953c-adde4b57b257 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:22.441813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:22.448726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 68/140] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:22.466154 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64741f-cf14-4fb1-8776-69a59305c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:22.466827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64741f-cf14-4fb1-8776-69a59305c4e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:22.467101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64741f-cf14-4fb1-8776-69a59305c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:22.467369 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64741f-cf14-4fb1-8776-69a59305c4e4 None admin] PATH_INFO: `/v3/projects/694f50f94c824aba85ea055a5999b255/users/79d620cf4a14435fa08f46effb6890ae/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:22.469320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64741f-cf14-4fb1-8776-69a59305c4e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=694f50f94c824aba85ea055a5999b255, user_id=79d620cf4a14435fa08f46effb6890ae, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:22.470924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64741f-cf14-4fb1-8776-69a59305c4e4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:22.495036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 73/141] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:56:22 2022] PUT /identity/v3/projects/694f50f94c824aba85ea055a5999b255/users/79d620cf4a14435fa08f46effb6890ae/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:56:22.794554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be2632-b1ee-4915-bccc-6212f5753af2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:22.851023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64741f-cf14-4fb1-8776-69a59305c4e4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:22.963105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be2632-b1ee-4915-bccc-6212f5753af2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:22.971500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:23.023533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64741f-cf14-4fb1-8776-69a59305c4e4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:23.036088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a5bed-7b4e-4478-b0c7-0cc71014c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:23.036778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5bed-7b4e-4478-b0c7-0cc71014c92e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:23.037360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5bed-7b4e-4478-b0c7-0cc71014c92e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:23.037640 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5bed-7b4e-4478-b0c7-0cc71014c92e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:23.062303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a5bed-7b4e-4478-b0c7-0cc71014c92e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f02a5bed-7b4e-4478-b0c7-0cc71014c92e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:23.069135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:23.070046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:23.070840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:23.075498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 69/142] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:23.081660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a5bed-7b4e-4478-b0c7-0cc71014c92e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:23.090972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a3bd-07e8-4987-b9f7-c2783ed4774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:23.091857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a3bd-07e8-4987-b9f7-c2783ed4774a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:23.092331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a3bd-07e8-4987-b9f7-c2783ed4774a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:23.092736 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a3bd-07e8-4987-b9f7-c2783ed4774a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:23.097511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47a3bd-07e8-4987-b9f7-c2783ed4774a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:23.099204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47a3bd-07e8-4987-b9f7-c2783ed4774a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:23.101281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 74/143] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:23.107419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a3bd-07e8-4987-b9f7-c2783ed4774a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:23.178455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:23.220690 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a5bed-7b4e-4478-b0c7-0cc71014c92e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:23.248482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a3bd-07e8-4987-b9f7-c2783ed4774a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:23.256184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3007ff-1439-4905-bbb4-c67babb6928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:23.256993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3007ff-1439-4905-bbb4-c67babb6928f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:23.257408 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3007ff-1439-4905-bbb4-c67babb6928f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:23.257818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3007ff-1439-4905-bbb4-c67babb6928f None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:23.258651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3007ff-1439-4905-bbb4-c67babb6928f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:23.259093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3007ff-1439-4905-bbb4-c67babb6928f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:23.260722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3007ff-1439-4905-bbb4-c67babb6928f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:23.269542 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 70/144] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:23.278829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3007ff-1439-4905-bbb4-c67babb6928f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:23.285348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3029c02-1bfc-49aa-9c99-9689ed3267b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:23.285579 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3029c02-1bfc-49aa-9c99-9689ed3267b9 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:23.285898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3029c02-1bfc-49aa-9c99-9689ed3267b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:23.286179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3029c02-1bfc-49aa-9c99-9689ed3267b9 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:23.286842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3029c02-1bfc-49aa-9c99-9689ed3267b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:23.288315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3029c02-1bfc-49aa-9c99-9689ed3267b9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:23.316980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:23.322597 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 75/145] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:56:23 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:23.468116 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3007ff-1439-4905-bbb4-c67babb6928f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:23.497617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:23.515785 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7d04b-0835-4176-af59-8cf5350dbffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:23.516354 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d04b-0835-4176-af59-8cf5350dbffc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:23.516631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d04b-0835-4176-af59-8cf5350dbffc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:23.516904 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d04b-0835-4176-af59-8cf5350dbffc None admin] PATH_INFO: `/v3/users/d807f29957f0443594e0040b06bcb55f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:23.518345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7d04b-0835-4176-af59-8cf5350dbffc None admin] RBAC: Authorizing `identity:get_user(user_id=d807f29957f0443594e0040b06bcb55f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:23.519816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7d04b-0835-4176-af59-8cf5350dbffc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:23.524061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 71/146] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:23 2022] GET /identity/v3/users/d807f29957f0443594e0040b06bcb55f => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:23.530112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3029c02-1bfc-49aa-9c99-9689ed3267b9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:23.654153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3029c02-1bfc-49aa-9c99-9689ed3267b9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:23.683769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c431e2-c431-492d-8820-5b6980366b83 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:23.684092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c431e2-c431-492d-8820-5b6980366b83 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:23.684310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c431e2-c431-492d-8820-5b6980366b83 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:23.685864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 72/147] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:23.691517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb9c2-3d18-41a1-af95-ba051e3a6144 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:23.691811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb9c2-3d18-41a1-af95-ba051e3a6144 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:23.692063 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb9c2-3d18-41a1-af95-ba051e3a6144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:23.702962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabd4f7-5209-445f-9291-fbaf860e8b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:23.704021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabd4f7-5209-445f-9291-fbaf860e8b93 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:23.704502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabd4f7-5209-445f-9291-fbaf860e8b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:23.704956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabd4f7-5209-445f-9291-fbaf860e8b93 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:23.706343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabd4f7-5209-445f-9291-fbaf860e8b93 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:23.708128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabd4f7-5209-445f-9291-fbaf860e8b93 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:23.711468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 76/148] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:23 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:23.713654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a23cb9c2-3d18-41a1-af95-ba051e3a6144 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:23.715071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a23cb9c2-3d18-41a1-af95-ba051e3a6144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:23.724918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabd4f7-5209-445f-9291-fbaf860e8b93 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:23.797557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 73/149] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:23.827020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:23.851013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabd4f7-5209-445f-9291-fbaf860e8b93 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:23.886822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bb2d7-b5a6-4790-bdb7-571fbf5fc6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:23.888298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bb2d7-b5a6-4790-bdb7-571fbf5fc6bc None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:23.888798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bb2d7-b5a6-4790-bdb7-571fbf5fc6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:23.889248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bb2d7-b5a6-4790-bdb7-571fbf5fc6bc None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/users/d807f29957f0443594e0040b06bcb55f/roles/36b37fbf95184e75911ca9f9e5d963d9` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:23.891420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bb2d7-b5a6-4790-bdb7-571fbf5fc6bc None admin] RBAC: Authorizing `identity:create_grant(project_id=4426e8bcefe54612af19bbbfa1a25f80, user_id=d807f29957f0443594e0040b06bcb55f, role_id=36b37fbf95184e75911ca9f9e5d963d9)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:23.893116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bb2d7-b5a6-4790-bdb7-571fbf5fc6bc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:23.910497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 77/150] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:56:23 2022] PUT /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/users/d807f29957f0443594e0040b06bcb55f/roles/36b37fbf95184e75911ca9f9e5d963d9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 21:56:24.092360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cb9c2-3d18-41a1-af95-ba051e3a6144 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:24.202860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cb9c2-3d18-41a1-af95-ba051e3a6144 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:24.228853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:24.240015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f84ff6-083f-4fb7-b3a8-90e3f70ff491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:24.241171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f84ff6-083f-4fb7-b3a8-90e3f70ff491 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:24.241700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f84ff6-083f-4fb7-b3a8-90e3f70ff491 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:24.242420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f84ff6-083f-4fb7-b3a8-90e3f70ff491 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:24.253809 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f84ff6-083f-4fb7-b3a8-90e3f70ff491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c7f84ff6-083f-4fb7-b3a8-90e3f70ff491 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:24.258917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:24.259826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:24.260723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 74/151] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:56:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:24.267797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bb2d7-b5a6-4790-bdb7-571fbf5fc6bc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:24.407701 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bb2d7-b5a6-4790-bdb7-571fbf5fc6bc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:24.435395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:24.445329 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d80fe-d08d-404a-9f1c-fa3dc02c5bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:24.445966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d80fe-d08d-404a-9f1c-fa3dc02c5bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:24.446243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d80fe-d08d-404a-9f1c-fa3dc02c5bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:24.446513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d80fe-d08d-404a-9f1c-fa3dc02c5bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:24.447461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d80fe-d08d-404a-9f1c-fa3dc02c5bf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:24.447920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d80fe-d08d-404a-9f1c-fa3dc02c5bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:24.449427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d80fe-d08d-404a-9f1c-fa3dc02c5bf1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:24.461956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 78/152] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:24.467729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f84ff6-083f-4fb7-b3a8-90e3f70ff491 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:24.494329 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5b404-4da6-4b62-a7ca-8b829d699791 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:24.494649 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5b404-4da6-4b62-a7ca-8b829d699791 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:24.494968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5b404-4da6-4b62-a7ca-8b829d699791 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:24.496327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 79/153] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:24.501908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef82ec-95de-4aa5-a0b5-0928ce7a3dca None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:24.502189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef82ec-95de-4aa5-a0b5-0928ce7a3dca None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:24.502457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef82ec-95de-4aa5-a0b5-0928ce7a3dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:24.538855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a6ef82ec-95de-4aa5-a0b5-0928ce7a3dca None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:24.540084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a6ef82ec-95de-4aa5-a0b5-0928ce7a3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:24.625268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f84ff6-083f-4fb7-b3a8-90e3f70ff491 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:24.657448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 80/154] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:24.683248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03580786-644c-4e39-b543-b16ae1ade9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:24.683833 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03580786-644c-4e39-b543-b16ae1ade9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:24.684168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03580786-644c-4e39-b543-b16ae1ade9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:24.684447 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03580786-644c-4e39-b543-b16ae1ade9c7 None admin] PATH_INFO: `/v3/users/55aadc9862fd4d0e93e5113dacf48de6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:24.690565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03580786-644c-4e39-b543-b16ae1ade9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=55aadc9862fd4d0e93e5113dacf48de6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:24.692034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03580786-644c-4e39-b543-b16ae1ade9c7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:24.693860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 75/155] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:24 2022] GET /identity/v3/users/55aadc9862fd4d0e93e5113dacf48de6 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:24.699499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef82ec-95de-4aa5-a0b5-0928ce7a3dca None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:24.833380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef82ec-95de-4aa5-a0b5-0928ce7a3dca None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:24.852993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:24.873625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21185f2-32cb-43aa-be67-b83210738218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:24.874604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21185f2-32cb-43aa-be67-b83210738218 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:24.875140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21185f2-32cb-43aa-be67-b83210738218 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:24.875594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21185f2-32cb-43aa-be67-b83210738218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:24.956793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21185f2-32cb-43aa-be67-b83210738218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:24.959039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21185f2-32cb-43aa-be67-b83210738218 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:25.077507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 81/156] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 21:56:25.084325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03580786-644c-4e39-b543-b16ae1ade9c7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:25.142255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:25.191499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03580786-644c-4e39-b543-b16ae1ade9c7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:25.221463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21185f2-32cb-43aa-be67-b83210738218 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:25.244752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d518f-6c72-4360-973f-edb8c90656cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:25.245630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d518f-6c72-4360-973f-edb8c90656cb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:25.245925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d518f-6c72-4360-973f-edb8c90656cb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:25.246196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d518f-6c72-4360-973f-edb8c90656cb None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:25.248247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d518f-6c72-4360-973f-edb8c90656cb None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:25.249705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d518f-6c72-4360-973f-edb8c90656cb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:25.251588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 76/157] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:25 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:25.255071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:25.261582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d518f-6c72-4360-973f-edb8c90656cb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:25.433716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21185f2-32cb-43aa-be67-b83210738218 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:25.469377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d518f-6c72-4360-973f-edb8c90656cb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:25.496420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:25.521080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5af64-98c1-48b3-b8a8-80313492c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:25.522104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5af64-98c1-48b3-b8a8-80313492c785 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:25.522397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5af64-98c1-48b3-b8a8-80313492c785 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:25.522935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5af64-98c1-48b3-b8a8-80313492c785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:25.523690 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5af64-98c1-48b3-b8a8-80313492c785 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80, user.id=55aadc9862fd4d0e93e5113dacf48de6) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:25.524007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5af64-98c1-48b3-b8a8-80313492c785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:25.528357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5af64-98c1-48b3-b8a8-80313492c785 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:25.530164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c9f8f-8e7e-4d71-bf98-0ba450157fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:25.530799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c9f8f-8e7e-4d71-bf98-0ba450157fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:25.531071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c9f8f-8e7e-4d71-bf98-0ba450157fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:25.531339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c9f8f-8e7e-4d71-bf98-0ba450157fe2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:25.535585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 77/158] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:25 2022] GET /identity/v3/role_assignments?user.id=55aadc9862fd4d0e93e5113dacf48de6&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:25.538359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad943a-cf0f-4b16-b779-4c1498c3f195 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:25.538983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad943a-cf0f-4b16-b779-4c1498c3f195 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:25.539484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad943a-cf0f-4b16-b779-4c1498c3f195 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:25.544336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c9f8f-8e7e-4d71-bf98-0ba450157fe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:25.547155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 78/159] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:25.551601 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332ae19-ce6d-4c6d-90fe-869641fc8429 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:25.551884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332ae19-ce6d-4c6d-90fe-869641fc8429 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:25.552168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332ae19-ce6d-4c6d-90fe-869641fc8429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-459c9f8f-8e7e-4d71-bf98-0ba450157fe2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:25.557439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:25.558344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:25.559084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:25.561515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 82/160] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:25.572140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c9f8f-8e7e-4d71-bf98-0ba450157fe2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:25.596888 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d332ae19-ce6d-4c6d-90fe-869641fc8429 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:25.598147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d332ae19-ce6d-4c6d-90fe-869641fc8429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:25.782100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:25.782828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 79/161] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:25.828458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c9f8f-8e7e-4d71-bf98-0ba450157fe2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:25.873184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e47ca-af54-4b50-83ca-ff34a0477b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:25.873803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e47ca-af54-4b50-83ca-ff34a0477b56 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:25.874097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e47ca-af54-4b50-83ca-ff34a0477b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:25.874365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e47ca-af54-4b50-83ca-ff34a0477b56 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:25.875044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e47ca-af54-4b50-83ca-ff34a0477b56 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:25.875340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e47ca-af54-4b50-83ca-ff34a0477b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:25.876793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e47ca-af54-4b50-83ca-ff34a0477b56 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:25.887614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 83/162] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:25.893616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332ae19-ce6d-4c6d-90fe-869641fc8429 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:26.040019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332ae19-ce6d-4c6d-90fe-869641fc8429 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:26.055833 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:26.080595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd3276-3026-46ed-b5df-ec547a136203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:26.081249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd3276-3026-46ed-b5df-ec547a136203 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:26.081523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd3276-3026-46ed-b5df-ec547a136203 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:26.081794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd3276-3026-46ed-b5df-ec547a136203 None admin] PATH_INFO: `/v3/users/79d620cf4a14435fa08f46effb6890ae` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:26.082979 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd3276-3026-46ed-b5df-ec547a136203 None admin] RBAC: Authorizing `identity:get_user(user_id=79d620cf4a14435fa08f46effb6890ae)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:26.084449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd3276-3026-46ed-b5df-ec547a136203 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:26.087481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 80/163] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:25 2022] GET /identity/v3/users/79d620cf4a14435fa08f46effb6890ae => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:26.092236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e47ca-af54-4b50-83ca-ff34a0477b56 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:26.242006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e47ca-af54-4b50-83ca-ff34a0477b56 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:26.282263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e8f65-0e89-455b-99f5-ce3554127829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:26.282886 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e8f65-0e89-455b-99f5-ce3554127829 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:26.283163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e8f65-0e89-455b-99f5-ce3554127829 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:26.283436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e8f65-0e89-455b-99f5-ce3554127829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:26.295755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:26.357121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bafa77-1047-4d87-aa2e-869962c38cc8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:26.357459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bafa77-1047-4d87-aa2e-869962c38cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:26.357669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bafa77-1047-4d87-aa2e-869962c38cc8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:26.359115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 81/164] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:26.359993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e8f65-0e89-455b-99f5-ce3554127829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:26.361499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e8f65-0e89-455b-99f5-ce3554127829 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:26.364364 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeee4e2-844c-4dc4-aa33-4cb68aa7bc16 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:26.364640 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeee4e2-844c-4dc4-aa33-4cb68aa7bc16 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:26.364914 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeee4e2-844c-4dc4-aa33-4cb68aa7bc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:26.398215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-adeee4e2-844c-4dc4-aa33-4cb68aa7bc16 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:26.399461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-adeee4e2-844c-4dc4-aa33-4cb68aa7bc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:26.556905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 84/165] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:26.565935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e8f65-0e89-455b-99f5-ce3554127829 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:26.572085 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 82/166] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:26.602843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeee4e2-844c-4dc4-aa33-4cb68aa7bc16 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:26.648495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:26.792429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e8f65-0e89-455b-99f5-ce3554127829 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:26.823991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeee4e2-844c-4dc4-aa33-4cb68aa7bc16 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:26.836570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:26.859472 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46119-e042-424c-ae02-56b38bd2b3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:26.860108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46119-e042-424c-ae02-56b38bd2b3db None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:26.860388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46119-e042-424c-ae02-56b38bd2b3db None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:26.860660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46119-e042-424c-ae02-56b38bd2b3db None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:26.861798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa46119-e042-424c-ae02-56b38bd2b3db None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:26.863305 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa46119-e042-424c-ae02-56b38bd2b3db None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:26.864958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 85/167] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:26 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:26.873897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46119-e042-424c-ae02-56b38bd2b3db None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:26.903128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499731d-9ca4-4071-bf60-fad7e226bd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:26.903789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499731d-9ca4-4071-bf60-fad7e226bd67 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:26.904070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499731d-9ca4-4071-bf60-fad7e226bd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:26.904345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499731d-9ca4-4071-bf60-fad7e226bd67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:26.938711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499731d-9ca4-4071-bf60-fad7e226bd67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c499731d-9ca4-4071-bf60-fad7e226bd67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:26.943692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:26.944706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:26.945477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 83/168] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:56:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:56:26.951217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499731d-9ca4-4071-bf60-fad7e226bd67 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:27.060749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46119-e042-424c-ae02-56b38bd2b3db None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:27.078868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:27.125091 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105ee19-8e6d-4c3b-a6a3-7083787bb161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:27.125726 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105ee19-8e6d-4c3b-a6a3-7083787bb161 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:27.126018 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105ee19-8e6d-4c3b-a6a3-7083787bb161 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:27.126290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105ee19-8e6d-4c3b-a6a3-7083787bb161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:27.127038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105ee19-8e6d-4c3b-a6a3-7083787bb161 None admin] RBAC: Adding query filter params (role.id=92f2004a6ac04948af8cd639d0d09f09, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80, user.id=79d620cf4a14435fa08f46effb6890ae) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:27.127347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105ee19-8e6d-4c3b-a6a3-7083787bb161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:27.128805 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105ee19-8e6d-4c3b-a6a3-7083787bb161 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:27.140110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 86/169] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:26 2022] GET /identity/v3/role_assignments?user.id=79d620cf4a14435fa08f46effb6890ae&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:27.194616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499731d-9ca4-4071-bf60-fad7e226bd67 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:27.244831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105ee19-8e6d-4c3b-a6a3-7083787bb161 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:27.272132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41410-85a1-408d-b599-07b2f32a8ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:27.272783 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41410-85a1-408d-b599-07b2f32a8ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:27.273066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41410-85a1-408d-b599-07b2f32a8ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:27.273397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41410-85a1-408d-b599-07b2f32a8ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:27.274121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41410-85a1-408d-b599-07b2f32a8ea6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:27.274423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41410-85a1-408d-b599-07b2f32a8ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:27.275871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41410-85a1-408d-b599-07b2f32a8ea6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:27.292111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 84/170] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:56:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:27.298397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41410-85a1-408d-b599-07b2f32a8ea6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:27.378281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:27.424787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105ee19-8e6d-4c3b-a6a3-7083787bb161 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:27.483062 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df66e5-5fcf-49ac-a48f-23b86f37a635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:27.483725 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df66e5-5fcf-49ac-a48f-23b86f37a635 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:27.484003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df66e5-5fcf-49ac-a48f-23b86f37a635 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:27.484268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df66e5-5fcf-49ac-a48f-23b86f37a635 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:27.504707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df66e5-5fcf-49ac-a48f-23b86f37a635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-34df66e5-5fcf-49ac-a48f-23b86f37a635 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:27.509761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:27.510757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:27.511507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:27.519564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 87/171] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:56:27.522335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41410-85a1-408d-b599-07b2f32a8ea6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:27.525423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df66e5-5fcf-49ac-a48f-23b86f37a635 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:27.600383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:27.606822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4693e-235d-456e-adbb-13e3500bb03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:27.607522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4693e-235d-456e-adbb-13e3500bb03b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:27.607812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4693e-235d-456e-adbb-13e3500bb03b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:27.608072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4693e-235d-456e-adbb-13e3500bb03b None admin] PATH_INFO: `/v3/users/79d620cf4a14435fa08f46effb6890ae` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:27.614563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4693e-235d-456e-adbb-13e3500bb03b None admin] RBAC: Authorizing `identity:get_user(user_id=79d620cf4a14435fa08f46effb6890ae)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:27.616042 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4693e-235d-456e-adbb-13e3500bb03b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:27.618088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 85/172] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:27 2022] GET /identity/v3/users/79d620cf4a14435fa08f46effb6890ae => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:27.626055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4693e-235d-456e-adbb-13e3500bb03b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:27.740315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df66e5-5fcf-49ac-a48f-23b86f37a635 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:27.790320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4693e-235d-456e-adbb-13e3500bb03b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:27.795023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273f409-e4d9-4e64-a031-91a4e5e5124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:27.795220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:27.795301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273f409-e4d9-4e64-a031-91a4e5e5124d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:27.795497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273f409-e4d9-4e64-a031-91a4e5e5124d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:27.795770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273f409-e4d9-4e64-a031-91a4e5e5124d None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:27.796448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273f409-e4d9-4e64-a031-91a4e5e5124d None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:27.796744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273f409-e4d9-4e64-a031-91a4e5e5124d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:27.799912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273f409-e4d9-4e64-a031-91a4e5e5124d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:27.813049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 88/173] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:27.818885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273f409-e4d9-4e64-a031-91a4e5e5124d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:27.851941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035db285-fd57-4e0c-9c68-da8d4334eb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:27.853406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035db285-fd57-4e0c-9c68-da8d4334eb51 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:27.853749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035db285-fd57-4e0c-9c68-da8d4334eb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:27.854264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035db285-fd57-4e0c-9c68-da8d4334eb51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:27.962704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:27.977612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273f409-e4d9-4e64-a031-91a4e5e5124d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:27.991864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035db285-fd57-4e0c-9c68-da8d4334eb51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:27.993639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035db285-fd57-4e0c-9c68-da8d4334eb51 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:28.046307 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c3318-ed8d-48b8-92f1-377815467a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:28.048274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3318-ed8d-48b8-92f1-377815467a04 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:28.049574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3318-ed8d-48b8-92f1-377815467a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:28.050047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3318-ed8d-48b8-92f1-377815467a04 None admin] PATH_INFO: `/v3/users/79d620cf4a14435fa08f46effb6890ae` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:28.052766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c3318-ed8d-48b8-92f1-377815467a04 None admin] RBAC: Authorizing `identity:get_user(user_id=79d620cf4a14435fa08f46effb6890ae)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:28.055620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c3318-ed8d-48b8-92f1-377815467a04 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:28.059539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 89/174] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:27 2022] GET /identity/v3/users/79d620cf4a14435fa08f46effb6890ae => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:28.067269 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b16f7-a52f-4dff-8da1-d7f6593960eb None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:28.068858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b16f7-a52f-4dff-8da1-d7f6593960eb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:28.070790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b16f7-a52f-4dff-8da1-d7f6593960eb None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:28.072458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 90/175] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:28.086836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b16f7-a52f-4dff-8da1-d7f6593960eb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:28.190374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:28.196185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 86/176] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 21:56:28.198054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260faf5-af8b-46b6-a357-234e60ede18a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:28.203923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260faf5-af8b-46b6-a357-234e60ede18a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:28.204428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260faf5-af8b-46b6-a357-234e60ede18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:28.236686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4260faf5-af8b-46b6-a357-234e60ede18a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:28.238259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4260faf5-af8b-46b6-a357-234e60ede18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:28.338366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 87/177] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:28.344231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260faf5-af8b-46b6-a357-234e60ede18a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:28.371160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b16f7-a52f-4dff-8da1-d7f6593960eb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:28.485928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c4b07-2fb2-4f91-b94a-814c89e57a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:28.487391 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c4b07-2fb2-4f91-b94a-814c89e57a39 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:28.488191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c4b07-2fb2-4f91-b94a-814c89e57a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:28.488649 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c4b07-2fb2-4f91-b94a-814c89e57a39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:28.537364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:28.541275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260faf5-af8b-46b6-a357-234e60ede18a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:28.590063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c4b07-2fb2-4f91-b94a-814c89e57a39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:28.592237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c4b07-2fb2-4f91-b94a-814c89e57a39 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:28.597974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:28.619940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5125aaf-7c0b-4ebc-8fd9-4c16a4426e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:28.621123 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5125aaf-7c0b-4ebc-8fd9-4c16a4426e02 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:28.622812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5125aaf-7c0b-4ebc-8fd9-4c16a4426e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:28.624306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5125aaf-7c0b-4ebc-8fd9-4c16a4426e02 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:28.628712 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5125aaf-7c0b-4ebc-8fd9-4c16a4426e02 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:28.630462 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5125aaf-7c0b-4ebc-8fd9-4c16a4426e02 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:28.632325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 88/178] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:28 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:28.640775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e29aa-8a96-4bbc-9e4f-c9a00608131a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:28.641764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e29aa-8a96-4bbc-9e4f-c9a00608131a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:28.642927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e29aa-8a96-4bbc-9e4f-c9a00608131a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:28.645042 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 89/179] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:28.646428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd5e4-c450-4f66-aaff-9daaf1885c30 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:28.646935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd5e4-c450-4f66-aaff-9daaf1885c30 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:28.647403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd5e4-c450-4f66-aaff-9daaf1885c30 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:28.648758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 90/180] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:28.654584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afd5e4-c450-4f66-aaff-9daaf1885c30 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:28.772414 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 91/181] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:28.774474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ca267-5bde-49f7-861e-778507a7aa90 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:28.774921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ca267-5bde-49f7-861e-778507a7aa90 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:28.775354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ca267-5bde-49f7-861e-778507a7aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:28.793993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ae8ca267-5bde-49f7-861e-778507a7aa90 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:28.795239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ae8ca267-5bde-49f7-861e-778507a7aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:28.809863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afd5e4-c450-4f66-aaff-9daaf1885c30 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:28.846839 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7dde9-ab41-433b-803a-c0cd02022848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:28.847275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7dde9-ab41-433b-803a-c0cd02022848 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:28.847553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7dde9-ab41-433b-803a-c0cd02022848 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:28.847823 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7dde9-ab41-433b-803a-c0cd02022848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:28.848555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7dde9-ab41-433b-803a-c0cd02022848 None admin] RBAC: Adding query filter params (role.id=dcc8ff85c52344698c38ecafb6b0978c, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80, user.id=79d620cf4a14435fa08f46effb6890ae) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:28.848863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7dde9-ab41-433b-803a-c0cd02022848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:28.850351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7dde9-ab41-433b-803a-c0cd02022848 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:28.853342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:28.857425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 91/182] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:28 2022] GET /identity/v3/role_assignments?user.id=79d620cf4a14435fa08f46effb6890ae&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=dcc8ff85c52344698c38ecafb6b0978c => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:28.858756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd1f4-d713-4546-9c1c-6eee50ff7cfc None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:28.859043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd1f4-d713-4546-9c1c-6eee50ff7cfc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:28.859315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd1f4-d713-4546-9c1c-6eee50ff7cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:28.869294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 92/183] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:28.869647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ca267-5bde-49f7-861e-778507a7aa90 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:28.884790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7fdbd1f4-d713-4546-9c1c-6eee50ff7cfc None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:28.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7fdbd1f4-d713-4546-9c1c-6eee50ff7cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:28.966365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:28.985378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 92/184] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:28.987416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd1f4-d713-4546-9c1c-6eee50ff7cfc None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:28.992782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ca267-5bde-49f7-861e-778507a7aa90 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:29.031767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943bf4b-f524-4e32-844a-de665dd3551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:29.032336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943bf4b-f524-4e32-844a-de665dd3551c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.032609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943bf4b-f524-4e32-844a-de665dd3551c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.032933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943bf4b-f524-4e32-844a-de665dd3551c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.044638 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943bf4b-f524-4e32-844a-de665dd3551c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9943bf4b-f524-4e32-844a-de665dd3551c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:29.049899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:29.050778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:29.051540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 93/185] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:29.052662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dadcf-ae27-4085-9aae-1f8f71e31dec None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.052662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dadcf-ae27-4085-9aae-1f8f71e31dec None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.052910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dadcf-ae27-4085-9aae-1f8f71e31dec None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.055027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 94/186] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:29.059999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dadcf-ae27-4085-9aae-1f8f71e31dec None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:29.136128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:29.138586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd1f4-d713-4546-9c1c-6eee50ff7cfc None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:29.187708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d1022-4598-4af3-9b6c-6c819770e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:29.188083 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1022-4598-4af3-9b6c-6c819770e122 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.188295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1022-4598-4af3-9b6c-6c819770e122 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.188660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1022-4598-4af3-9b6c-6c819770e122 None admin] PATH_INFO: `/v3/projects/694f50f94c824aba85ea055a5999b255` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.189800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d1022-4598-4af3-9b6c-6c819770e122 None admin] RBAC: Authorizing `identity:get_project(project_id=694f50f94c824aba85ea055a5999b255)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:29.191284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d1022-4598-4af3-9b6c-6c819770e122 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:29.193122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 93/187] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:28 2022] GET /identity/v3/projects/694f50f94c824aba85ea055a5999b255 => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:29.194387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2b56-88cb-4bc3-8ef9-d9aad982015c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.194387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2b56-88cb-4bc3-8ef9-d9aad982015c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.195244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2b56-88cb-4bc3-8ef9-d9aad982015c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.197763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dadcf-ae27-4085-9aae-1f8f71e31dec None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:29.213746 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c40e2b56-88cb-4bc3-8ef9-d9aad982015c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:29.215096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c40e2b56-88cb-4bc3-8ef9-d9aad982015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:29.241598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de864e-2204-403f-8049-43cecef227a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:29.242291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de864e-2204-403f-8049-43cecef227a1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.242650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de864e-2204-403f-8049-43cecef227a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.242884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de864e-2204-403f-8049-43cecef227a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.243559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de864e-2204-403f-8049-43cecef227a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:29.243970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de864e-2204-403f-8049-43cecef227a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:29.245727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de864e-2204-403f-8049-43cecef227a1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:29.254653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 95/188] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:29.255390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de864e-2204-403f-8049-43cecef227a1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:29.277522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:29.292359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 94/189] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:29.293451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2b56-88cb-4bc3-8ef9-d9aad982015c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:29.362103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de864e-2204-403f-8049-43cecef227a1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:29.377115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:29.398347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460417dc-0be4-4ce9-923c-fa1a0fe9d4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:29.398986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460417dc-0be4-4ce9-923c-fa1a0fe9d4cb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.399257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460417dc-0be4-4ce9-923c-fa1a0fe9d4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.399532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460417dc-0be4-4ce9-923c-fa1a0fe9d4cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.409991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460417dc-0be4-4ce9-923c-fa1a0fe9d4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:29.411604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2b56-88cb-4bc3-8ef9-d9aad982015c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-460417dc-0be4-4ce9-923c-fa1a0fe9d4cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:29.416164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:29.417005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:29.417904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 96/190] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:56:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:29.422654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460417dc-0be4-4ce9-923c-fa1a0fe9d4cb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:29.452704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a4a7-bfe3-4795-b33e-e0eab7910a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:29.453457 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a4a7-bfe3-4795-b33e-e0eab7910a67 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.454062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a4a7-bfe3-4795-b33e-e0eab7910a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.454335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a4a7-bfe3-4795-b33e-e0eab7910a67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.455078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a4a7-bfe3-4795-b33e-e0eab7910a67 None admin] RBAC: Adding query filter params (role.id=92f2004a6ac04948af8cd639d0d09f09, scope.project.id=694f50f94c824aba85ea055a5999b255, user.id=79d620cf4a14435fa08f46effb6890ae) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:29.455381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a4a7-bfe3-4795-b33e-e0eab7910a67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:29.456826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a4a7-bfe3-4795-b33e-e0eab7910a67 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:29.473874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 95/191] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:29 2022] GET /identity/v3/role_assignments?user.id=79d620cf4a14435fa08f46effb6890ae&scope.project.id=694f50f94c824aba85ea055a5999b255&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:29.473874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a4a7-bfe3-4795-b33e-e0eab7910a67 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:29.523811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:29.548236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460417dc-0be4-4ce9-923c-fa1a0fe9d4cb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:29.583157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a4a7-bfe3-4795-b33e-e0eab7910a67 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:29.589591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c000fb-2504-4098-abe7-1e5513dd1ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:29.590270 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c000fb-2504-4098-abe7-1e5513dd1ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.590681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c000fb-2504-4098-abe7-1e5513dd1ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.590949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c000fb-2504-4098-abe7-1e5513dd1ab1 None admin] PATH_INFO: `/v3/users/d807f29957f0443594e0040b06bcb55f` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.592142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c000fb-2504-4098-abe7-1e5513dd1ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=d807f29957f0443594e0040b06bcb55f)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:29.593633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c000fb-2504-4098-abe7-1e5513dd1ab1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:29.596099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 97/192] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:29 2022] GET /identity/v3/users/d807f29957f0443594e0040b06bcb55f => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:29.596687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c000fb-2504-4098-abe7-1e5513dd1ab1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:29.623814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850178f-4dc5-47a1-93fb-ceed686128fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:29.624851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850178f-4dc5-47a1-93fb-ceed686128fd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.625286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850178f-4dc5-47a1-93fb-ceed686128fd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.625571 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850178f-4dc5-47a1-93fb-ceed686128fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.638645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850178f-4dc5-47a1-93fb-ceed686128fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:29.643412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b850178f-4dc5-47a1-93fb-ceed686128fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:29.645953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:29.646998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 96/193] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:56:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:29.648380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850178f-4dc5-47a1-93fb-ceed686128fd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:29.739875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c000fb-2504-4098-abe7-1e5513dd1ab1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:29.778655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850178f-4dc5-47a1-93fb-ceed686128fd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:29.791385 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a8100-b3ff-4b71-a21a-38e051200d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:29.792030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a8100-b3ff-4b71-a21a-38e051200d67 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.792308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a8100-b3ff-4b71-a21a-38e051200d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.792673 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a8100-b3ff-4b71-a21a-38e051200d67 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.793363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a8100-b3ff-4b71-a21a-38e051200d67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:29.793714 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a8100-b3ff-4b71-a21a-38e051200d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:29.794997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:29.795119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a8100-b3ff-4b71-a21a-38e051200d67 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:29.803480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 98/194] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:29.806844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a8100-b3ff-4b71-a21a-38e051200d67 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:29.818089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729576b-db36-4abf-bdee-6907963df925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:29.818743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729576b-db36-4abf-bdee-6907963df925 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.819025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729576b-db36-4abf-bdee-6907963df925 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.819297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729576b-db36-4abf-bdee-6907963df925 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.820492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729576b-db36-4abf-bdee-6907963df925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:29.822069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729576b-db36-4abf-bdee-6907963df925 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:29.824230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 97/195] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:29.824996 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729576b-db36-4abf-bdee-6907963df925 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:29.905498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a8100-b3ff-4b71-a21a-38e051200d67 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:29.907737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:29.925007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729576b-db36-4abf-bdee-6907963df925 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:29.938747 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c0fda-e254-4093-9d27-7886abafc527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:29.939388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c0fda-e254-4093-9d27-7886abafc527 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.939660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c0fda-e254-4093-9d27-7886abafc527 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.939927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c0fda-e254-4093-9d27-7886abafc527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.957384 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dca97f-c40f-4e28-be58-bfcfd229648e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:29.958027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dca97f-c40f-4e28-be58-bfcfd229648e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:29.958312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dca97f-c40f-4e28-be58-bfcfd229648e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:29.958583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dca97f-c40f-4e28-be58-bfcfd229648e None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:29.959245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dca97f-c40f-4e28-be58-bfcfd229648e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:29.959544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dca97f-c40f-4e28-be58-bfcfd229648e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:29.961283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dca97f-c40f-4e28-be58-bfcfd229648e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:29.969390 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 98/196] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:56:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:29.970414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dca97f-c40f-4e28-be58-bfcfd229648e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:30.012451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:30.012788 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c0fda-e254-4093-9d27-7886abafc527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:30.014291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c0fda-e254-4093-9d27-7886abafc527 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:30.070587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dca97f-c40f-4e28-be58-bfcfd229648e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:30.104042 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b16580-c3dd-42bb-b690-74c77c931589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:30.104660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16580-c3dd-42bb-b690-74c77c931589 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:30.104942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16580-c3dd-42bb-b690-74c77c931589 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:30.105214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16580-c3dd-42bb-b690-74c77c931589 None admin] PATH_INFO: `/v3/users/99b392c3f1ff441eaa475ea337f53ceb` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:30.111317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 99/197] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:30.111984 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c0fda-e254-4093-9d27-7886abafc527 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:30.115794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:30.118635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b16580-c3dd-42bb-b690-74c77c931589 None admin] RBAC: Authorizing `identity:get_user(user_id=99b392c3f1ff441eaa475ea337f53ceb)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:30.120240 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b16580-c3dd-42bb-b690-74c77c931589 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:30.122062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 99/198] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:29 2022] GET /identity/v3/users/99b392c3f1ff441eaa475ea337f53ceb => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:30.122798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b16580-c3dd-42bb-b690-74c77c931589 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:30.211102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c0fda-e254-4093-9d27-7886abafc527 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:30.221115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:30.224601 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b16580-c3dd-42bb-b690-74c77c931589 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:30.244912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb748c64-f061-4474-b6da-535e8f9371f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:30.245525 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb748c64-f061-4474-b6da-535e8f9371f6 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:30.245800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb748c64-f061-4474-b6da-535e8f9371f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:30.246097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb748c64-f061-4474-b6da-535e8f9371f6 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:30.246747 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb748c64-f061-4474-b6da-535e8f9371f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:30.248193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb748c64-f061-4474-b6da-535e8f9371f6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:30.258093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587031a-30ab-4c13-b034-468a9c19b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:30.258740 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587031a-30ab-4c13-b034-468a9c19b6fa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:30.259018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587031a-30ab-4c13-b034-468a9c19b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:30.259305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587031a-30ab-4c13-b034-468a9c19b6fa None admin] PATH_INFO: `/v3/users/99b392c3f1ff441eaa475ea337f53ceb` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:30.260492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587031a-30ab-4c13-b034-468a9c19b6fa None admin] RBAC: Authorizing `identity:get_user(user_id=99b392c3f1ff441eaa475ea337f53ceb)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:30.262104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587031a-30ab-4c13-b034-468a9c19b6fa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:30.263730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 100/199] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:30 2022] GET /identity/v3/users/99b392c3f1ff441eaa475ea337f53ceb => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:30.266782 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587031a-30ab-4c13-b034-468a9c19b6fa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:30.275779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 100/200] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:56:30 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:30.275779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb748c64-f061-4474-b6da-535e8f9371f6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:30.366784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:30.393443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587031a-30ab-4c13-b034-468a9c19b6fa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:30.415526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb748c64-f061-4474-b6da-535e8f9371f6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:30.429507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2c4b-7d7d-4c21-8d02-2dbc67663838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:30.430188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2c4b-7d7d-4c21-8d02-2dbc67663838 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:30.430461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2c4b-7d7d-4c21-8d02-2dbc67663838 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:30.430723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2c4b-7d7d-4c21-8d02-2dbc67663838 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:30.432001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2c4b-7d7d-4c21-8d02-2dbc67663838 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:30.433458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2c4b-7d7d-4c21-8d02-2dbc67663838 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:30.435381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 101/201] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:30 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:30.438804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2c4b-7d7d-4c21-8d02-2dbc67663838 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:30.456428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d4863-d572-4248-b047-c4d9145ae4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:30.457046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d4863-d572-4248-b047-c4d9145ae4cd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:30.457321 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d4863-d572-4248-b047-c4d9145ae4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:30.457590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d4863-d572-4248-b047-c4d9145ae4cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:30.486979 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:30.540576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d4863-d572-4248-b047-c4d9145ae4cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:30.542994 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d4863-d572-4248-b047-c4d9145ae4cd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:30.575262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2c4b-7d7d-4c21-8d02-2dbc67663838 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:30.619437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:30.620971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce091808-24ba-4a14-b02a-4d436131d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:30.621642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce091808-24ba-4a14-b02a-4d436131d36d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:30.622655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce091808-24ba-4a14-b02a-4d436131d36d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:30.622655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce091808-24ba-4a14-b02a-4d436131d36d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:30.666873 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 101/202] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:30.667799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d4863-d572-4248-b047-c4d9145ae4cd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:30.704754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce091808-24ba-4a14-b02a-4d436131d36d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:30.706498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce091808-24ba-4a14-b02a-4d436131d36d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:30.749795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:30.783445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d4863-d572-4248-b047-c4d9145ae4cd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:30.819228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1baecd-501d-47be-9073-26c67c73688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:30.820317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1baecd-501d-47be-9073-26c67c73688d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:30.820901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1baecd-501d-47be-9073-26c67c73688d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:30.821407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1baecd-501d-47be-9073-26c67c73688d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:30.822488 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1baecd-501d-47be-9073-26c67c73688d None admin] RBAC: Adding query filter params (role.id=36b37fbf95184e75911ca9f9e5d963d9, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80, user.id=d807f29957f0443594e0040b06bcb55f) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:30.823000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1baecd-501d-47be-9073-26c67c73688d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:30.824709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1baecd-501d-47be-9073-26c67c73688d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:30.831576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 102/203] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:30 2022] GET /identity/v3/role_assignments?user.id=d807f29957f0443594e0040b06bcb55f&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=36b37fbf95184e75911ca9f9e5d963d9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:30.832798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1baecd-501d-47be-9073-26c67c73688d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:30.833963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 102/204] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:30.842641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce091808-24ba-4a14-b02a-4d436131d36d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:30.885953 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:31.041943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce091808-24ba-4a14-b02a-4d436131d36d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:31.049529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1baecd-501d-47be-9073-26c67c73688d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:31.089481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278378b-d53d-4e61-841d-fbb3aae2af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:31.090160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278378b-d53d-4e61-841d-fbb3aae2af0c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:31.090438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278378b-d53d-4e61-841d-fbb3aae2af0c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:31.090708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278378b-d53d-4e61-841d-fbb3aae2af0c None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:31.091835 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278378b-d53d-4e61-841d-fbb3aae2af0c None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:31.093306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278378b-d53d-4e61-841d-fbb3aae2af0c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:31.094187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28719631-02a5-4c25-b333-2a1eda3fd142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:31.099746 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 103/205] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:30 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:31.100145 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28719631-02a5-4c25-b333-2a1eda3fd142 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:31.100541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28719631-02a5-4c25-b333-2a1eda3fd142 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:31.100892 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28719631-02a5-4c25-b333-2a1eda3fd142 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:31.102344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28719631-02a5-4c25-b333-2a1eda3fd142 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:31.102913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278378b-d53d-4e61-841d-fbb3aae2af0c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:31.104137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28719631-02a5-4c25-b333-2a1eda3fd142 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:31.107848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 103/206] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:30 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:31.116903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:31.119574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28719631-02a5-4c25-b333-2a1eda3fd142 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:31.236690 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278378b-d53d-4e61-841d-fbb3aae2af0c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:31.262165 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:31.275567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28719631-02a5-4c25-b333-2a1eda3fd142 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:31.295321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d652ba-7559-4c85-b830-115097a13160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:31.295940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d652ba-7559-4c85-b830-115097a13160 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:31.296208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d652ba-7559-4c85-b830-115097a13160 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:31.296517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d652ba-7559-4c85-b830-115097a13160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:31.297258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d652ba-7559-4c85-b830-115097a13160 None admin] RBAC: Adding query filter params (role.id=dcc8ff85c52344698c38ecafb6b0978c, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4, user.id=99b392c3f1ff441eaa475ea337f53ceb) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:31.297719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d652ba-7559-4c85-b830-115097a13160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:31.299524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d652ba-7559-4c85-b830-115097a13160 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:31.306504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 104/207] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:31 2022] GET /identity/v3/role_assignments?user.id=99b392c3f1ff441eaa475ea337f53ceb&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=dcc8ff85c52344698c38ecafb6b0978c => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:31.317883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074e87-c372-4682-ba76-02432c04a324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:31.318537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074e87-c372-4682-ba76-02432c04a324 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:31.318803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074e87-c372-4682-ba76-02432c04a324 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:31.319114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074e87-c372-4682-ba76-02432c04a324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:31.319871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074e87-c372-4682-ba76-02432c04a324 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4, user.id=99b392c3f1ff441eaa475ea337f53ceb) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:31.320174 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074e87-c372-4682-ba76-02432c04a324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:31.321753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074e87-c372-4682-ba76-02432c04a324 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:31.331017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 104/208] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:31 2022] GET /identity/v3/role_assignments?user.id=99b392c3f1ff441eaa475ea337f53ceb&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:32.616851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289baf4-1494-4d67-ad16-d3f7c78101e9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:32.617423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289baf4-1494-4d67-ad16-d3f7c78101e9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:32.617423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289baf4-1494-4d67-ad16-d3f7c78101e9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:32.618855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 105/209] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:32.624441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729544e4-c6c4-47b7-a325-ed3351894123 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:32.624958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729544e4-c6c4-47b7-a325-ed3351894123 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:32.625109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729544e4-c6c4-47b7-a325-ed3351894123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:32.645573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-729544e4-c6c4-47b7-a325-ed3351894123 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:32.646874 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-729544e4-c6c4-47b7-a325-ed3351894123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:32.726196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 105/210] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:32.768345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a479-5e93-42d7-ac6b-66419af14d4a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:32.768672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a479-5e93-42d7-ac6b-66419af14d4a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:32.768896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a479-5e93-42d7-ac6b-66419af14d4a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:32.770485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 106/211] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:32.775809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd35264-ca78-43c3-81f9-06d4a8512850 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:32.776098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd35264-ca78-43c3-81f9-06d4a8512850 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:32.776371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd35264-ca78-43c3-81f9-06d4a8512850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:32.794837 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0bd35264-ca78-43c3-81f9-06d4a8512850 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:32.796078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0bd35264-ca78-43c3-81f9-06d4a8512850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:32.864036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 106/212] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:33.021892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a479-5e93-42d7-ac6b-66419af14d4a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:33.092637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:33.129102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a479-5e93-42d7-ac6b-66419af14d4a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:33.163380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05bc27-09dc-4992-ad91-9ce11b742fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:33.164015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05bc27-09dc-4992-ad91-9ce11b742fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:33.164286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05bc27-09dc-4992-ad91-9ce11b742fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:33.164548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05bc27-09dc-4992-ad91-9ce11b742fc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:33.170938 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd35264-ca78-43c3-81f9-06d4a8512850 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:33.181783 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05bc27-09dc-4992-ad91-9ce11b742fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3f05bc27-09dc-4992-ad91-9ce11b742fc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:33.187401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:33.188279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:33.189051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:33.189635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:33.189712 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 107/213] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:33.194872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05bc27-09dc-4992-ad91-9ce11b742fc8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:33.287800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd35264-ca78-43c3-81f9-06d4a8512850 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:33.319658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05bc27-09dc-4992-ad91-9ce11b742fc8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:33.329853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f37af-8cbd-4443-a026-6f93b554a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:33.330497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f37af-8cbd-4443-a026-6f93b554a75a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:33.330778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f37af-8cbd-4443-a026-6f93b554a75a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:33.331071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f37af-8cbd-4443-a026-6f93b554a75a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:33.332179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f37af-8cbd-4443-a026-6f93b554a75a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:33.333630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f37af-8cbd-4443-a026-6f93b554a75a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:33.335414 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 107/214] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:33.341175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f37af-8cbd-4443-a026-6f93b554a75a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:33.351226 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:33.362327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79ee16-077b-4898-9a1a-c553f9ea40d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:33.363068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79ee16-077b-4898-9a1a-c553f9ea40d1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:33.363444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79ee16-077b-4898-9a1a-c553f9ea40d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:33.363719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79ee16-077b-4898-9a1a-c553f9ea40d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:33.364637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79ee16-077b-4898-9a1a-c553f9ea40d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:33.364988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79ee16-077b-4898-9a1a-c553f9ea40d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:33.366494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79ee16-077b-4898-9a1a-c553f9ea40d1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:33.378456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 108/215] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:33.384684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79ee16-077b-4898-9a1a-c553f9ea40d1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:33.442210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:33.462778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f37af-8cbd-4443-a026-6f93b554a75a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:33.490841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79ee16-077b-4898-9a1a-c553f9ea40d1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:33.504284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ea65c-5dc5-4f3b-bc43-6856964c7bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:33.505336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ea65c-5dc5-4f3b-bc43-6856964c7bc1 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:33.505632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ea65c-5dc5-4f3b-bc43-6856964c7bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:33.506015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ea65c-5dc5-4f3b-bc43-6856964c7bc1 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:33.506793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ea65c-5dc5-4f3b-bc43-6856964c7bc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:33.509248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ea65c-5dc5-4f3b-bc43-6856964c7bc1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:33.526445 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f431e-11d2-4204-b9d5-74ae3be199c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:33.527423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f431e-11d2-4204-b9d5-74ae3be199c1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:33.527958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f431e-11d2-4204-b9d5-74ae3be199c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:33.528343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f431e-11d2-4204-b9d5-74ae3be199c1 None admin] PATH_INFO: `/v3/users/36733b24c45d406d9b121820f08c7d23` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:33.541979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 108/216] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:56:33 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 21:56:33.541979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4e82-ae26-4021-b37f-9e758bfe0d23 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:33.541979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4e82-ae26-4021-b37f-9e758bfe0d23 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:33.541979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4e82-ae26-4021-b37f-9e758bfe0d23 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:33.541979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 109/217] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:33.544468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce975b-5774-45ba-a92c-7ece64f80903 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:33.544752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce975b-5774-45ba-a92c-7ece64f80903 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:33.545019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce975b-5774-45ba-a92c-7ece64f80903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:33.554000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f431e-11d2-4204-b9d5-74ae3be199c1 None admin] RBAC: Authorizing `identity:get_user(user_id=36733b24c45d406d9b121820f08c7d23)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:33.555890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f431e-11d2-4204-b9d5-74ae3be199c1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:33.563370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 109/218] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:33 2022] GET /identity/v3/users/36733b24c45d406d9b121820f08c7d23 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:33.565618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f431e-11d2-4204-b9d5-74ae3be199c1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:33.569858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-46ce975b-5774-45ba-a92c-7ece64f80903 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:33.571099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-46ce975b-5774-45ba-a92c-7ece64f80903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:33.628776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:33.656365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 110/219] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:33.658313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d55ec-4fce-46c6-8768-ae33abd2a2b6 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:33.658812 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d55ec-4fce-46c6-8768-ae33abd2a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:33.659255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d55ec-4fce-46c6-8768-ae33abd2a2b6 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:33.660782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 111/220] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:33.667446 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907795eb-bbf0-4c4b-b779-7a5220ec38f2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:33.667944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907795eb-bbf0-4c4b-b779-7a5220ec38f2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:33.668417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907795eb-bbf0-4c4b-b779-7a5220ec38f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:33.688785 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-907795eb-bbf0-4c4b-b779-7a5220ec38f2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:33.690402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-907795eb-bbf0-4c4b-b779-7a5220ec38f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:33.693331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f431e-11d2-4204-b9d5-74ae3be199c1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:33.741876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba10f4c-67fa-46f5-a6c7-3b8df3ecfdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:33.742424 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba10f4c-67fa-46f5-a6c7-3b8df3ecfdfd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:33.742698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba10f4c-67fa-46f5-a6c7-3b8df3ecfdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:33.743161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba10f4c-67fa-46f5-a6c7-3b8df3ecfdfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:33.775873 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:33.786025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 112/221] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:33.827008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba10f4c-67fa-46f5-a6c7-3b8df3ecfdfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:33.828408 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba10f4c-67fa-46f5-a6c7-3b8df3ecfdfd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:33.879735 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:33.926503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907795eb-bbf0-4c4b-b779-7a5220ec38f2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:33.938148 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 110/222] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 21:56:33.944936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba10f4c-67fa-46f5-a6c7-3b8df3ecfdfd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:34.067283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba10f4c-67fa-46f5-a6c7-3b8df3ecfdfd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:34.080073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907795eb-bbf0-4c4b-b779-7a5220ec38f2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:34.109257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559899c3-a3d6-4345-8a52-199a9de60862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:34.110558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559899c3-a3d6-4345-8a52-199a9de60862 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:34.111467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559899c3-a3d6-4345-8a52-199a9de60862 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:34.111941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559899c3-a3d6-4345-8a52-199a9de60862 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:34.113766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559899c3-a3d6-4345-8a52-199a9de60862 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:34.116331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559899c3-a3d6-4345-8a52-199a9de60862 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:34.119143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 111/223] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:33 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:34.120539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559899c3-a3d6-4345-8a52-199a9de60862 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:34.127177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167b32f-8d52-48be-b87d-58b34eb07e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:34.127830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167b32f-8d52-48be-b87d-58b34eb07e35 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:34.128110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167b32f-8d52-48be-b87d-58b34eb07e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:34.128376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167b32f-8d52-48be-b87d-58b34eb07e35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:34.141192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167b32f-8d52-48be-b87d-58b34eb07e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c167b32f-8d52-48be-b87d-58b34eb07e35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:34.146427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:34.147315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:34.148095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:34.150838 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 113/224] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:56:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:34.151922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167b32f-8d52-48be-b87d-58b34eb07e35 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:34.158216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:34.221368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:34.253662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559899c3-a3d6-4345-8a52-199a9de60862 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:34.270704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167b32f-8d52-48be-b87d-58b34eb07e35 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:34.294686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cd401-df81-4b4a-ab75-472dbf20d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:34.295770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cd401-df81-4b4a-ab75-472dbf20d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:34.296590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cd401-df81-4b4a-ab75-472dbf20d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:34.297045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cd401-df81-4b4a-ab75-472dbf20d0b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:34.307089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88fbcc-0ef0-428b-9ac0-971ceb182af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:34.307992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88fbcc-0ef0-428b-9ac0-971ceb182af1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:34.308416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88fbcc-0ef0-428b-9ac0-971ceb182af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:34.308638 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cd401-df81-4b4a-ab75-472dbf20d0b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:34.308975 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88fbcc-0ef0-428b-9ac0-971ceb182af1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:34.309939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88fbcc-0ef0-428b-9ac0-971ceb182af1 None admin] RBAC: Adding query filter params (role.id=92f2004a6ac04948af8cd639d0d09f09, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4, user.id=36733b24c45d406d9b121820f08c7d23) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:34.310392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88fbcc-0ef0-428b-9ac0-971ceb182af1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:34.311996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88fbcc-0ef0-428b-9ac0-971ceb182af1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5b5cd401-df81-4b4a-ab75-472dbf20d0b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:34.314355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:34.315372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:34.316172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 112/225] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:34.317410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cd401-df81-4b4a-ab75-472dbf20d0b6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:34.324482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 114/226] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:34 2022] GET /identity/v3/role_assignments?user.id=36733b24c45d406d9b121820f08c7d23&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:34.325402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88fbcc-0ef0-428b-9ac0-971ceb182af1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:34.454091 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:34.502376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88fbcc-0ef0-428b-9ac0-971ceb182af1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:34.504619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cd401-df81-4b4a-ab75-472dbf20d0b6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:34.545053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:34.546783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd7d65-1a78-4ee0-9847-faf287256efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:34.548181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7d65-1a78-4ee0-9847-faf287256efb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:34.548181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7d65-1a78-4ee0-9847-faf287256efb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:34.548636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7d65-1a78-4ee0-9847-faf287256efb None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:34.549369 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd7d65-1a78-4ee0-9847-faf287256efb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:34.549673 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd7d65-1a78-4ee0-9847-faf287256efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:34.551106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd7d65-1a78-4ee0-9847-faf287256efb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:34.567849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 115/227] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:34.574086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd7d65-1a78-4ee0-9847-faf287256efb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:34.585085 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9463309-4c04-4919-9a36-40fcb1e7bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:34.586219 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9463309-4c04-4919-9a36-40fcb1e7bbdf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:34.586500 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9463309-4c04-4919-9a36-40fcb1e7bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:34.586768 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9463309-4c04-4919-9a36-40fcb1e7bbdf None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:34.587787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9463309-4c04-4919-9a36-40fcb1e7bbdf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:34.588225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9463309-4c04-4919-9a36-40fcb1e7bbdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:34.590902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9463309-4c04-4919-9a36-40fcb1e7bbdf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:34.600815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 113/228] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:56:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:34.610810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9463309-4c04-4919-9a36-40fcb1e7bbdf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:34.686046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd7d65-1a78-4ee0-9847-faf287256efb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:34.750004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b2780-f61e-40d6-aeb7-551ee8d3b5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:34.750650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b2780-f61e-40d6-aeb7-551ee8d3b5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:34.750923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b2780-f61e-40d6-aeb7-551ee8d3b5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:34.751185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b2780-f61e-40d6-aeb7-551ee8d3b5a1 None admin] PATH_INFO: `/v3/users/99b392c3f1ff441eaa475ea337f53ceb` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:34.754027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b2780-f61e-40d6-aeb7-551ee8d3b5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=99b392c3f1ff441eaa475ea337f53ceb)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:34.755502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b2780-f61e-40d6-aeb7-551ee8d3b5a1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:34.758430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 116/229] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:34 2022] GET /identity/v3/users/99b392c3f1ff441eaa475ea337f53ceb => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:34.764150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b2780-f61e-40d6-aeb7-551ee8d3b5a1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:34.800323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9463309-4c04-4919-9a36-40fcb1e7bbdf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:34.873992 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af629fba-7f58-46f9-b965-7884e496aba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:34.874237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:34.874631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af629fba-7f58-46f9-b965-7884e496aba7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:34.875021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af629fba-7f58-46f9-b965-7884e496aba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:34.875297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af629fba-7f58-46f9-b965-7884e496aba7 None admin] PATH_INFO: `/v3/users/99b392c3f1ff441eaa475ea337f53ceb` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:34.877737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af629fba-7f58-46f9-b965-7884e496aba7 None admin] RBAC: Authorizing `identity:get_user(user_id=99b392c3f1ff441eaa475ea337f53ceb)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:34.880034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af629fba-7f58-46f9-b965-7884e496aba7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:34.882581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 114/230] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:34 2022] GET /identity/v3/users/99b392c3f1ff441eaa475ea337f53ceb => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:34.889533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af629fba-7f58-46f9-b965-7884e496aba7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:34.901467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:34.946603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b2780-f61e-40d6-aeb7-551ee8d3b5a1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:35.012278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c944a0-b922-466e-bb05-e3efcb44c1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:35.012917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c944a0-b922-466e-bb05-e3efcb44c1be None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:35.013187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c944a0-b922-466e-bb05-e3efcb44c1be None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:35.013450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c944a0-b922-466e-bb05-e3efcb44c1be None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:35.018611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c944a0-b922-466e-bb05-e3efcb44c1be None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:35.020170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c944a0-b922-466e-bb05-e3efcb44c1be None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:35.022242 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 117/231] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:34 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:35.028142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c944a0-b922-466e-bb05-e3efcb44c1be None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:35.029928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af629fba-7f58-46f9-b965-7884e496aba7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:35.066137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febec9a-22a1-4786-bea9-d1564eedb542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:35.066836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febec9a-22a1-4786-bea9-d1564eedb542 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:35.067114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febec9a-22a1-4786-bea9-d1564eedb542 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:35.067385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febec9a-22a1-4786-bea9-d1564eedb542 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:35.068585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febec9a-22a1-4786-bea9-d1564eedb542 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:35.070142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febec9a-22a1-4786-bea9-d1564eedb542 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:35.071883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 115/232] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:34 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:35.077485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febec9a-22a1-4786-bea9-d1564eedb542 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:35.164124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:35.191975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febec9a-22a1-4786-bea9-d1564eedb542 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:35.230222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d160e-4376-4fcf-978b-2f140271e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:35.231182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d160e-4376-4fcf-978b-2f140271e15b None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:35.231561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d160e-4376-4fcf-978b-2f140271e15b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:35.231933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d160e-4376-4fcf-978b-2f140271e15b None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/users/99b392c3f1ff441eaa475ea337f53ceb/roles/dcc8ff85c52344698c38ecafb6b0978c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:35.234303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d160e-4376-4fcf-978b-2f140271e15b None admin] RBAC: Authorizing `identity:create_grant(project_id=2b8d315d35194c14b0a0b17d94801ce4, user_id=99b392c3f1ff441eaa475ea337f53ceb, role_id=dcc8ff85c52344698c38ecafb6b0978c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:35.235871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d160e-4376-4fcf-978b-2f140271e15b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:35.257327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c944a0-b922-466e-bb05-e3efcb44c1be None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:35.274811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 116/233] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:56:35 2022] PUT /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/users/99b392c3f1ff441eaa475ea337f53ceb/roles/dcc8ff85c52344698c38ecafb6b0978c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 21:56:35.293557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:35.307320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8310df-2228-4bda-9cab-bfcdb14d44bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:35.308151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8310df-2228-4bda-9cab-bfcdb14d44bc None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:35.308430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8310df-2228-4bda-9cab-bfcdb14d44bc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:35.308706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8310df-2228-4bda-9cab-bfcdb14d44bc None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/users/99b392c3f1ff441eaa475ea337f53ceb/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:35.310757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8310df-2228-4bda-9cab-bfcdb14d44bc None admin] RBAC: Authorizing `identity:create_grant(project_id=2b8d315d35194c14b0a0b17d94801ce4, user_id=99b392c3f1ff441eaa475ea337f53ceb, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:35.312411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8310df-2228-4bda-9cab-bfcdb14d44bc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:35.346670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 118/234] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:56:35 2022] PUT /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/users/99b392c3f1ff441eaa475ea337f53ceb/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 21:56:36.206679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4897a0-e3bf-4be8-8e4e-88053f05227f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:36.207714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4897a0-e3bf-4be8-8e4e-88053f05227f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:36.208184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4897a0-e3bf-4be8-8e4e-88053f05227f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:36.210006 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 117/235] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:36.216178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac2c0-d845-4d03-91f9-3f999a5e8229 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:36.217043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac2c0-d845-4d03-91f9-3f999a5e8229 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:36.217516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac2c0-d845-4d03-91f9-3f999a5e8229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:36.246852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-988ac2c0-d845-4d03-91f9-3f999a5e8229 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:36.248395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-988ac2c0-d845-4d03-91f9-3f999a5e8229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:36.354199 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 119/236] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:36.391641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a3e7a-1a28-443d-81df-04474f9dade2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:36.391974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a3e7a-1a28-443d-81df-04474f9dade2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:36.392179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a3e7a-1a28-443d-81df-04474f9dade2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:36.393693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 118/237] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:36.413719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412c69-a135-408b-beae-7340107cde21 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:36.413719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412c69-a135-408b-beae-7340107cde21 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:36.413719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412c69-a135-408b-beae-7340107cde21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:36.446902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c3412c69-a135-408b-beae-7340107cde21 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:36.448447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c3412c69-a135-408b-beae-7340107cde21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:36.532249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 120/238] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:36.735580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a3e7a-1a28-443d-81df-04474f9dade2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:36.858895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a3e7a-1a28-443d-81df-04474f9dade2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:36.890529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3412c69-a135-408b-beae-7340107cde21 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:36.902351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de3710-82db-4c5d-99f9-7dabfcadbf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:36.902999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de3710-82db-4c5d-99f9-7dabfcadbf6d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:36.903266 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de3710-82db-4c5d-99f9-7dabfcadbf6d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:36.903529 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de3710-82db-4c5d-99f9-7dabfcadbf6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:36.906610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:36.916518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de3710-82db-4c5d-99f9-7dabfcadbf6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-83de3710-82db-4c5d-99f9-7dabfcadbf6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:36.922347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:36.923237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:36.924072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 119/239] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:36.932825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de3710-82db-4c5d-99f9-7dabfcadbf6d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:36.968132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:37.064498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de3710-82db-4c5d-99f9-7dabfcadbf6d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:37.082113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3412c69-a135-408b-beae-7340107cde21 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:37.104940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae45ac-212a-4b49-9436-db74d7cd1efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:37.105921 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae45ac-212a-4b49-9436-db74d7cd1efe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.106387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae45ac-212a-4b49-9436-db74d7cd1efe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.106843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae45ac-212a-4b49-9436-db74d7cd1efe None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:37.107692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae45ac-212a-4b49-9436-db74d7cd1efe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:37.108255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae45ac-212a-4b49-9436-db74d7cd1efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:37.109889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae45ac-212a-4b49-9436-db74d7cd1efe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:37.119557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 120/240] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:37.126148 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae45ac-212a-4b49-9436-db74d7cd1efe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:37.155538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a3b1d-0aed-49cd-99d0-be8351c5f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:37.156190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3b1d-0aed-49cd-99d0-be8351c5f36e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.156505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3b1d-0aed-49cd-99d0-be8351c5f36e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.156730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3b1d-0aed-49cd-99d0-be8351c5f36e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:37.157869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a3b1d-0aed-49cd-99d0-be8351c5f36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:37.159328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a3b1d-0aed-49cd-99d0-be8351c5f36e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:37.168237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 121/241] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:37.169109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a3b1d-0aed-49cd-99d0-be8351c5f36e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:37.188791 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:37.239163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae45ac-212a-4b49-9436-db74d7cd1efe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:37.274344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a3b1d-0aed-49cd-99d0-be8351c5f36e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:37.274910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694ea66-81b9-48f1-a67c-5f5113500c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:37.275503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694ea66-81b9-48f1-a67c-5f5113500c7c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.275784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694ea66-81b9-48f1-a67c-5f5113500c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.276050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694ea66-81b9-48f1-a67c-5f5113500c7c None admin] PATH_INFO: `/v3/users/c9e95237bc2c4c4bb998217158939d90` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:37.290333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:37.291511 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694ea66-81b9-48f1-a67c-5f5113500c7c None admin] RBAC: Authorizing `identity:get_user(user_id=c9e95237bc2c4c4bb998217158939d90)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:37.293090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694ea66-81b9-48f1-a67c-5f5113500c7c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:37.300759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 121/242] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:37 2022] GET /identity/v3/users/c9e95237bc2c4c4bb998217158939d90 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:37.302930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44d9c-4083-408d-97ff-590a36f874b8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.303210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44d9c-4083-408d-97ff-590a36f874b8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.303479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44d9c-4083-408d-97ff-590a36f874b8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:37.304994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 122/243] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:37.309482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c44d9c-4083-408d-97ff-590a36f874b8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:37.328083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e12f9d-f70a-4d9c-b00c-5d73cd579bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:37.328695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e12f9d-f70a-4d9c-b00c-5d73cd579bef None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.329079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e12f9d-f70a-4d9c-b00c-5d73cd579bef None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.329398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e12f9d-f70a-4d9c-b00c-5d73cd579bef None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:37.330180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e12f9d-f70a-4d9c-b00c-5d73cd579bef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:37.331767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e12f9d-f70a-4d9c-b00c-5d73cd579bef None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:37.357485 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 122/244] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:56:37 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:37.359050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e1a66-198b-4415-b6aa-4828726406be None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.359425 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e1a66-198b-4415-b6aa-4828726406be None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.359743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e1a66-198b-4415-b6aa-4828726406be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:37.381402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-291e1a66-198b-4415-b6aa-4828726406be None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:37.382591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-291e1a66-198b-4415-b6aa-4828726406be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:37.420890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c44d9c-4083-408d-97ff-590a36f874b8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:37.437561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:37.459076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6cd6b-9fe1-484c-ab67-98e32fd1c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:37.459879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6cd6b-9fe1-484c-ab67-98e32fd1c20f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.460254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6cd6b-9fe1-484c-ab67-98e32fd1c20f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.460961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6cd6b-9fe1-484c-ab67-98e32fd1c20f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:37.465003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 123/245] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:37.537279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6cd6b-9fe1-484c-ab67-98e32fd1c20f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:37.538817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6cd6b-9fe1-484c-ab67-98e32fd1c20f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:37.645130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 123/246] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:37.651062 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e1a66-198b-4415-b6aa-4828726406be None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:37.768244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:37.774646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e1a66-198b-4415-b6aa-4828726406be None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:37.803653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6cd6b-9fe1-484c-ab67-98e32fd1c20f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:37.813558 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c547d5-31be-46b7-a77c-b3823adce025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:37.814320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c547d5-31be-46b7-a77c-b3823adce025 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.814592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c547d5-31be-46b7-a77c-b3823adce025 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.814859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c547d5-31be-46b7-a77c-b3823adce025 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:37.816058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c547d5-31be-46b7-a77c-b3823adce025 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:37.817732 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c547d5-31be-46b7-a77c-b3823adce025 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:37.819689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 124/247] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:37 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:37.825549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c547d5-31be-46b7-a77c-b3823adce025 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:37.826125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:37.920385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6cd6b-9fe1-484c-ab67-98e32fd1c20f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:37.939890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c547d5-31be-46b7-a77c-b3823adce025 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:37.956516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08acdb2-578d-4fcf-ac4a-32b083efe3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:37.957278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08acdb2-578d-4fcf-ac4a-32b083efe3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.957623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08acdb2-578d-4fcf-ac4a-32b083efe3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.957998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08acdb2-578d-4fcf-ac4a-32b083efe3f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:37.969553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08acdb2-578d-4fcf-ac4a-32b083efe3f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c08acdb2-578d-4fcf-ac4a-32b083efe3f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:37.974626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:37.975678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:37.976444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 124/248] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:37.977541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077529d-f279-4aa2-a473-95463c625b8a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.977541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077529d-f279-4aa2-a473-95463c625b8a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.977754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077529d-f279-4aa2-a473-95463c625b8a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:37.981084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 125/249] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:37.982442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077529d-f279-4aa2-a473-95463c625b8a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:37.982851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97169814-ed38-4d15-9363-f286bfd7ea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:37.983480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97169814-ed38-4d15-9363-f286bfd7ea42 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.983751 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97169814-ed38-4d15-9363-f286bfd7ea42 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.984012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97169814-ed38-4d15-9363-f286bfd7ea42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:37.984750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97169814-ed38-4d15-9363-f286bfd7ea42 None admin] RBAC: Adding query filter params (role.id=36b37fbf95184e75911ca9f9e5d963d9, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4, user.id=c9e95237bc2c4c4bb998217158939d90) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:37.985338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97169814-ed38-4d15-9363-f286bfd7ea42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:37.986862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97169814-ed38-4d15-9363-f286bfd7ea42 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:37.993159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 125/250] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:37 2022] GET /identity/v3/role_assignments?user.id=c9e95237bc2c4c4bb998217158939d90&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=36b37fbf95184e75911ca9f9e5d963d9 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:37.995683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9f97-1da0-468e-9532-259cdc01354a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:37.995683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9f97-1da0-468e-9532-259cdc01354a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:37.995683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9f97-1da0-468e-9532-259cdc01354a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:38.015283 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-230b9f97-1da0-468e-9532-259cdc01354a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:38.016632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-230b9f97-1da0-468e-9532-259cdc01354a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:38.044050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:38.096994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:38.102094 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 126/251] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:38.140889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077529d-f279-4aa2-a473-95463c625b8a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:38.182533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb7da3-3a21-4ca0-8123-e39e858b259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:38.183478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb7da3-3a21-4ca0-8123-e39e858b259a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:38.183911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb7da3-3a21-4ca0-8123-e39e858b259a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:38.184349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb7da3-3a21-4ca0-8123-e39e858b259a None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:38.185258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb7da3-3a21-4ca0-8123-e39e858b259a None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:38.187033 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cd67c-c611-4faa-bf6b-763349b4cc19 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:38.187497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cd67c-c611-4faa-bf6b-763349b4cc19 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:38.187928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cd67c-c611-4faa-bf6b-763349b4cc19 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:38.189518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 127/252] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:38.190194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb7da3-3a21-4ca0-8123-e39e858b259a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:38.191859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb7da3-3a21-4ca0-8123-e39e858b259a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:38.196267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639226a-2f15-445a-8fb4-0c498161cc6c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:38.196786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639226a-2f15-445a-8fb4-0c498161cc6c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:38.197194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639226a-2f15-445a-8fb4-0c498161cc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:38.205259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 126/253] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:38.210901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb7da3-3a21-4ca0-8123-e39e858b259a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:38.219891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2639226a-2f15-445a-8fb4-0c498161cc6c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:38.221467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2639226a-2f15-445a-8fb4-0c498161cc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:38.307020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 128/254] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:38.327240 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb7da3-3a21-4ca0-8123-e39e858b259a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:38.374167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a8163-ed66-4a54-a9c2-a9c89f93f55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:38.375217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a8163-ed66-4a54-a9c2-a9c89f93f55f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:38.375710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a8163-ed66-4a54-a9c2-a9c89f93f55f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:38.376170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a8163-ed66-4a54-a9c2-a9c89f93f55f None admin] PATH_INFO: `/v3/users/36733b24c45d406d9b121820f08c7d23` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:38.382569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a8163-ed66-4a54-a9c2-a9c89f93f55f None admin] RBAC: Authorizing `identity:get_user(user_id=36733b24c45d406d9b121820f08c7d23)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:38.384312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a8163-ed66-4a54-a9c2-a9c89f93f55f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:38.386214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 127/255] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:38 2022] GET /identity/v3/users/36733b24c45d406d9b121820f08c7d23 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:38.391965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639226a-2f15-445a-8fb4-0c498161cc6c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:38.447250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a8163-ed66-4a54-a9c2-a9c89f93f55f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:38.455172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:38.525282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:38.546897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639226a-2f15-445a-8fb4-0c498161cc6c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:38.581462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858cd32-8a01-4cdd-839e-836417e32207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:38.582138 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858cd32-8a01-4cdd-839e-836417e32207 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:38.582415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858cd32-8a01-4cdd-839e-836417e32207 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:38.582677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858cd32-8a01-4cdd-839e-836417e32207 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:38.583792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858cd32-8a01-4cdd-839e-836417e32207 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:38.585234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858cd32-8a01-4cdd-839e-836417e32207 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:38.587523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 129/256] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:38 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:38.593084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858cd32-8a01-4cdd-839e-836417e32207 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:38.675879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a8163-ed66-4a54-a9c2-a9c89f93f55f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:38.746624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d81d51-3efc-4063-9efd-c1200d47c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:38.747326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d81d51-3efc-4063-9efd-c1200d47c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:38.747602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d81d51-3efc-4063-9efd-c1200d47c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:38.747868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d81d51-3efc-4063-9efd-c1200d47c0d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:38.764024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858cd32-8a01-4cdd-839e-836417e32207 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:38.766890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d81d51-3efc-4063-9efd-c1200d47c0d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-82d81d51-3efc-4063-9efd-c1200d47c0d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:38.772313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:38.773353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:38.774283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 128/257] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:56:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:38.783037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d81d51-3efc-4063-9efd-c1200d47c0d5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:38.815043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030e8fc-4dec-4d71-a8ab-ade75e61dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:38.816668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e8fc-4dec-4d71-a8ab-ade75e61dbef None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:38.819184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e8fc-4dec-4d71-a8ab-ade75e61dbef None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:38.819605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e8fc-4dec-4d71-a8ab-ade75e61dbef None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/users/36733b24c45d406d9b121820f08c7d23/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:38.824090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030e8fc-4dec-4d71-a8ab-ade75e61dbef None admin] RBAC: Authorizing `identity:create_grant(project_id=2b8d315d35194c14b0a0b17d94801ce4, user_id=36733b24c45d406d9b121820f08c7d23, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:38.825723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030e8fc-4dec-4d71-a8ab-ade75e61dbef None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:38.854513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 130/258] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:56:38 2022] PUT /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/users/36733b24c45d406d9b121820f08c7d23/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:56:38.855686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030e8fc-4dec-4d71-a8ab-ade75e61dbef None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:38.900558 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:38.911373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:39.005120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d81d51-3efc-4063-9efd-c1200d47c0d5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:39.048185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030e8fc-4dec-4d71-a8ab-ade75e61dbef None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:39.078355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a1ae1-a605-4ea1-8e40-7ae6050a7189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:39.079499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a1ae1-a605-4ea1-8e40-7ae6050a7189 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:39.079978 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a1ae1-a605-4ea1-8e40-7ae6050a7189 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:39.080443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a1ae1-a605-4ea1-8e40-7ae6050a7189 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:39.091504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9869dd-e805-4790-b103-363dcb3acfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:39.092158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9869dd-e805-4790-b103-363dcb3acfbb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:39.092434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9869dd-e805-4790-b103-363dcb3acfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:39.092697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9869dd-e805-4790-b103-363dcb3acfbb None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:39.093387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9869dd-e805-4790-b103-363dcb3acfbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:39.093683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9869dd-e805-4790-b103-363dcb3acfbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:39.096705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9869dd-e805-4790-b103-363dcb3acfbb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:39.105542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 131/259] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:39.110732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a1ae1-a605-4ea1-8e40-7ae6050a7189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:39.111135 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9869dd-e805-4790-b103-363dcb3acfbb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-705a1ae1-a605-4ea1-8e40-7ae6050a7189 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:39.116958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:39.117875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:39.118940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:39.130242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 129/260] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:56:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:39.136334 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a1ae1-a605-4ea1-8e40-7ae6050a7189 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:39.266342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:39.307084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a1ae1-a605-4ea1-8e40-7ae6050a7189 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:39.316118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9869dd-e805-4790-b103-363dcb3acfbb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:39.334063 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:39.350379 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8609-dce0-41aa-bbe2-86a63d19439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:39.351561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8609-dce0-41aa-bbe2-86a63d19439c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:39.354215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8609-dce0-41aa-bbe2-86a63d19439c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:39.354467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8609-dce0-41aa-bbe2-86a63d19439c None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:39.355812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8609-dce0-41aa-bbe2-86a63d19439c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:39.356265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8609-dce0-41aa-bbe2-86a63d19439c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:39.357917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8609-dce0-41aa-bbe2-86a63d19439c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:39.368394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 130/261] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:56:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:39.370580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e82fc9-24f1-4a11-9e89-3f174ca9cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:39.371220 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e82fc9-24f1-4a11-9e89-3f174ca9cd19 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:39.371491 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e82fc9-24f1-4a11-9e89-3f174ca9cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:39.371756 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e82fc9-24f1-4a11-9e89-3f174ca9cd19 None admin] PATH_INFO: `/v3/users/99b392c3f1ff441eaa475ea337f53ceb` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:39.373185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e82fc9-24f1-4a11-9e89-3f174ca9cd19 None admin] RBAC: Authorizing `identity:get_user(user_id=99b392c3f1ff441eaa475ea337f53ceb)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:39.373785 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8609-dce0-41aa-bbe2-86a63d19439c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:39.374778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e82fc9-24f1-4a11-9e89-3f174ca9cd19 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:39.376621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 132/262] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:39 2022] GET /identity/v3/users/99b392c3f1ff441eaa475ea337f53ceb => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:39.381623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e82fc9-24f1-4a11-9e89-3f174ca9cd19 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:39.495083 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8609-dce0-41aa-bbe2-86a63d19439c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:39.567681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e82fc9-24f1-4a11-9e89-3f174ca9cd19 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:39.575678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fa052-cc09-4d68-a633-a58c88492e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:39.576329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa052-cc09-4d68-a633-a58c88492e61 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:39.576601 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa052-cc09-4d68-a633-a58c88492e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:39.576868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa052-cc09-4d68-a633-a58c88492e61 None admin] PATH_INFO: `/v3/users/99b392c3f1ff441eaa475ea337f53ceb` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:39.584118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fa052-cc09-4d68-a633-a58c88492e61 None admin] RBAC: Authorizing `identity:get_user(user_id=99b392c3f1ff441eaa475ea337f53ceb)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:39.586008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fa052-cc09-4d68-a633-a58c88492e61 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:39.592656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 131/263] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:39 2022] GET /identity/v3/users/99b392c3f1ff441eaa475ea337f53ceb => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:39.593528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fa052-cc09-4d68-a633-a58c88492e61 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:39.655551 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4809d-8959-4d9f-82fb-073599d4c7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:39.656163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4809d-8959-4d9f-82fb-073599d4c7db None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:39.656431 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4809d-8959-4d9f-82fb-073599d4c7db None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:39.656689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4809d-8959-4d9f-82fb-073599d4c7db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:39.689291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:39.734328 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:39.809534 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4809d-8959-4d9f-82fb-073599d4c7db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:39.811034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4809d-8959-4d9f-82fb-073599d4c7db None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:39.820608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fa052-cc09-4d68-a633-a58c88492e61 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:39.876261 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd5821-37b5-4edc-8bd4-ed80560313b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:39.877402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5821-37b5-4edc-8bd4-ed80560313b2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:39.880219 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5821-37b5-4edc-8bd4-ed80560313b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:39.880700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5821-37b5-4edc-8bd4-ed80560313b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:39.985506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd5821-37b5-4edc-8bd4-ed80560313b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:39.987017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd5821-37b5-4edc-8bd4-ed80560313b2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:40.044518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:40.061430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 133/264] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 21:56:40.066583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4809d-8959-4d9f-82fb-073599d4c7db None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:40.093797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 132/265] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:40.099961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd5821-37b5-4edc-8bd4-ed80560313b2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:40.158804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:40.260038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4809d-8959-4d9f-82fb-073599d4c7db None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:40.282547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd5821-37b5-4edc-8bd4-ed80560313b2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:40.322541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be353428-bd2f-4c38-9ca1-b6367be9c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:40.323522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be353428-bd2f-4c38-9ca1-b6367be9c131 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:40.323987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be353428-bd2f-4c38-9ca1-b6367be9c131 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:40.324477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be353428-bd2f-4c38-9ca1-b6367be9c131 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:40.325872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be353428-bd2f-4c38-9ca1-b6367be9c131 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:40.327465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be353428-bd2f-4c38-9ca1-b6367be9c131 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:40.329591 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 133/266] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:40 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:40.338078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de02aff-6ced-42e1-a6c5-087413e1b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:40.338747 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de02aff-6ced-42e1-a6c5-087413e1b16c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:40.339026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de02aff-6ced-42e1-a6c5-087413e1b16c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:40.339237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be353428-bd2f-4c38-9ca1-b6367be9c131 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:40.339615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de02aff-6ced-42e1-a6c5-087413e1b16c None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:40.340463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de02aff-6ced-42e1-a6c5-087413e1b16c None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:40.342055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de02aff-6ced-42e1-a6c5-087413e1b16c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:40.344046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 134/267] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:40 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:40.349655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de02aff-6ced-42e1-a6c5-087413e1b16c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:40.366970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:40.442297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be353428-bd2f-4c38-9ca1-b6367be9c131 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:40.477264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cd253-5240-4018-9d17-6d9c227e9602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:40.478303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cd253-5240-4018-9d17-6d9c227e9602 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:40.478935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cd253-5240-4018-9d17-6d9c227e9602 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:40.479347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cd253-5240-4018-9d17-6d9c227e9602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:40.480219 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cd253-5240-4018-9d17-6d9c227e9602 None admin] RBAC: Adding query filter params (role.id=dcc8ff85c52344698c38ecafb6b0978c, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4, user.id=99b392c3f1ff441eaa475ea337f53ceb) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:40.480663 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cd253-5240-4018-9d17-6d9c227e9602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:40.482370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cd253-5240-4018-9d17-6d9c227e9602 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:40.488975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 134/268] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:40 2022] GET /identity/v3/role_assignments?user.id=99b392c3f1ff441eaa475ea337f53ceb&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=dcc8ff85c52344698c38ecafb6b0978c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:40.566520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de02aff-6ced-42e1-a6c5-087413e1b16c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:40.593878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:40.630902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537198c7-c6de-4c7b-bf19-70b17959dc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:40.631456 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537198c7-c6de-4c7b-bf19-70b17959dc0e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:40.631728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537198c7-c6de-4c7b-bf19-70b17959dc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:40.631998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537198c7-c6de-4c7b-bf19-70b17959dc0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:40.632771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537198c7-c6de-4c7b-bf19-70b17959dc0e None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4, user.id=99b392c3f1ff441eaa475ea337f53ceb) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:40.633081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537198c7-c6de-4c7b-bf19-70b17959dc0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:40.634705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537198c7-c6de-4c7b-bf19-70b17959dc0e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:40.641958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 135/269] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:40 2022] GET /identity/v3/role_assignments?user.id=99b392c3f1ff441eaa475ea337f53ceb&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:40.816894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0979-eebf-4463-88f5-0e6915d96299 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:40.817552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0979-eebf-4463-88f5-0e6915d96299 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:40.818069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0979-eebf-4463-88f5-0e6915d96299 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:40.819911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 135/270] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:40.826115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e2c1-388d-4462-8332-3fd81188e7e1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:40.826420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e2c1-388d-4462-8332-3fd81188e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:40.826664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e2c1-388d-4462-8332-3fd81188e7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:40.850869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a7e6e2c1-388d-4462-8332-3fd81188e7e1 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:40.852071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a7e6e2c1-388d-4462-8332-3fd81188e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:40.944478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 136/271] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:41.201635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32121-57ec-4440-9896-fa30aea002d2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:41.202367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32121-57ec-4440-9896-fa30aea002d2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:41.202837 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32121-57ec-4440-9896-fa30aea002d2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:41.204662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 136/272] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:41.213074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30074c-cb59-4af1-9ec3-fa77f4dc5585 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:41.213518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30074c-cb59-4af1-9ec3-fa77f4dc5585 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:41.213792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30074c-cb59-4af1-9ec3-fa77f4dc5585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:41.219477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d468a-8375-49bb-974f-154d75d94b4d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:41.220089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d468a-8375-49bb-974f-154d75d94b4d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:41.220577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d468a-8375-49bb-974f-154d75d94b4d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:41.222137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 137/273] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:41.228103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed0a5d-89c5-4100-8785-74e2cc9901ea None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:41.228382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed0a5d-89c5-4100-8785-74e2cc9901ea None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:41.228649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed0a5d-89c5-4100-8785-74e2cc9901ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:41.238087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ca30074c-cb59-4af1-9ec3-fa77f4dc5585 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:41.239283 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ca30074c-cb59-4af1-9ec3-fa77f4dc5585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:41.250901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-16ed0a5d-89c5-4100-8785-74e2cc9901ea None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:41.252107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-16ed0a5d-89c5-4100-8785-74e2cc9901ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:41.323830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 138/274] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:41.324689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed0a5d-89c5-4100-8785-74e2cc9901ea None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:41.332598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 137/275] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:41.348810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:41.433204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed0a5d-89c5-4100-8785-74e2cc9901ea None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:41.468112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feaeb7-05fe-4e23-8030-60d435bacfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:41.468677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feaeb7-05fe-4e23-8030-60d435bacfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:41.468951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feaeb7-05fe-4e23-8030-60d435bacfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:41.469215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feaeb7-05fe-4e23-8030-60d435bacfc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:41.479965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06feaeb7-05fe-4e23-8030-60d435bacfc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-06feaeb7-05fe-4e23-8030-60d435bacfc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:41.485062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:41.485928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:41.486708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 139/276] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:41.492286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30074c-cb59-4af1-9ec3-fa77f4dc5585 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:41.534050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:41.595880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feaeb7-05fe-4e23-8030-60d435bacfc6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:41.600920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30074c-cb59-4af1-9ec3-fa77f4dc5585 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:41.636046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171a275-36fe-4cfe-9121-2f73d7dda16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:41.636964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a275-36fe-4cfe-9121-2f73d7dda16e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:41.637411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a275-36fe-4cfe-9121-2f73d7dda16e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:41.637677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a275-36fe-4cfe-9121-2f73d7dda16e None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:41.638370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171a275-36fe-4cfe-9121-2f73d7dda16e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:41.638672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171a275-36fe-4cfe-9121-2f73d7dda16e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:41.640093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171a275-36fe-4cfe-9121-2f73d7dda16e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:41.648557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 138/277] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:41.649208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171a275-36fe-4cfe-9121-2f73d7dda16e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:41.690635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:41.725090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feaeb7-05fe-4e23-8030-60d435bacfc6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:41.760506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:41.764444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171a275-36fe-4cfe-9121-2f73d7dda16e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:41.769325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1afec-c5fe-46a4-a0e4-e5c408a27fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:41.770289 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1afec-c5fe-46a4-a0e4-e5c408a27fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:41.770728 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1afec-c5fe-46a4-a0e4-e5c408a27fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:41.771159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1afec-c5fe-46a4-a0e4-e5c408a27fe4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:41.782837 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1afec-c5fe-46a4-a0e4-e5c408a27fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-0ff1afec-c5fe-46a4-a0e4-e5c408a27fe4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:41.787831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:41.788866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:41.789795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:41.792256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 140/278] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:56:41.793280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1afec-c5fe-46a4-a0e4-e5c408a27fe4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:41.802399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c5cb0-70b0-41b0-bd89-b37ae095939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:41.803084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5cb0-70b0-41b0-bd89-b37ae095939a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:41.803312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5cb0-70b0-41b0-bd89-b37ae095939a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:41.803582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5cb0-70b0-41b0-bd89-b37ae095939a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:41.804697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c5cb0-70b0-41b0-bd89-b37ae095939a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:41.806363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c5cb0-70b0-41b0-bd89-b37ae095939a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:41.808272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 139/279] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:41.809113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c5cb0-70b0-41b0-bd89-b37ae095939a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:41.900865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1afec-c5fe-46a4-a0e4-e5c408a27fe4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:41.917956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c5cb0-70b0-41b0-bd89-b37ae095939a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:41.935431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e2845-ebb1-4949-be1f-b7e1c509e2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:41.936069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e2845-ebb1-4949-be1f-b7e1c509e2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:41.936350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e2845-ebb1-4949-be1f-b7e1c509e2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:41.936622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e2845-ebb1-4949-be1f-b7e1c509e2a8 None admin] PATH_INFO: `/v3/users/c9e95237bc2c4c4bb998217158939d90` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:41.937748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e2845-ebb1-4949-be1f-b7e1c509e2a8 None admin] RBAC: Authorizing `identity:get_user(user_id=c9e95237bc2c4c4bb998217158939d90)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:41.939339 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e2845-ebb1-4949-be1f-b7e1c509e2a8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:41.945932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 141/280] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:41 2022] GET /identity/v3/users/c9e95237bc2c4c4bb998217158939d90 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:41.945932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e2845-ebb1-4949-be1f-b7e1c509e2a8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:41.950319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:41.955349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc721c61-1ca5-4fd0-b241-9bdfbdd1a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:41.955963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721c61-1ca5-4fd0-b241-9bdfbdd1a155 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:41.956230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721c61-1ca5-4fd0-b241-9bdfbdd1a155 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:41.956493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721c61-1ca5-4fd0-b241-9bdfbdd1a155 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:41.957150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc721c61-1ca5-4fd0-b241-9bdfbdd1a155 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:41.957449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc721c61-1ca5-4fd0-b241-9bdfbdd1a155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:41.958867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc721c61-1ca5-4fd0-b241-9bdfbdd1a155 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:41.967583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 140/281] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:41.968375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc721c61-1ca5-4fd0-b241-9bdfbdd1a155 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:42.000424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:42.066578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e2845-ebb1-4949-be1f-b7e1c509e2a8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:42.075310 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc721c61-1ca5-4fd0-b241-9bdfbdd1a155 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:42.104341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111a74a-f59b-4c28-8002-9acd713c18e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:42.104954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111a74a-f59b-4c28-8002-9acd713c18e1 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:42.105233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111a74a-f59b-4c28-8002-9acd713c18e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:42.105505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111a74a-f59b-4c28-8002-9acd713c18e1 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:42.106190 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111a74a-f59b-4c28-8002-9acd713c18e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:42.107623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111a74a-f59b-4c28-8002-9acd713c18e1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:42.114308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270d09a-84b6-4dcc-b109-e8af0a5634a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:42.115164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270d09a-84b6-4dcc-b109-e8af0a5634a0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:42.115850 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270d09a-84b6-4dcc-b109-e8af0a5634a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:42.116327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270d09a-84b6-4dcc-b109-e8af0a5634a0 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:42.119104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270d09a-84b6-4dcc-b109-e8af0a5634a0 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:42.121662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270d09a-84b6-4dcc-b109-e8af0a5634a0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:42.123730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 141/282] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:41 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:42.124640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270d09a-84b6-4dcc-b109-e8af0a5634a0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:42.135612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 142/283] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:56:41 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:42.136427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111a74a-f59b-4c28-8002-9acd713c18e1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:42.209797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:42.256357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:42.256548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111a74a-f59b-4c28-8002-9acd713c18e1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:42.261142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270d09a-84b6-4dcc-b109-e8af0a5634a0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:42.295854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2723f-b789-43ca-8633-ad813311e5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:42.296497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2723f-b789-43ca-8633-ad813311e5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:42.296771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2723f-b789-43ca-8633-ad813311e5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:42.297042 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2723f-b789-43ca-8633-ad813311e5d9 None admin] PATH_INFO: `/v3/users/a8d3c15fd64642b3824a5ac799f3c503` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:42.303457 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541433e-45bd-4f95-a0c5-0ac7ff693616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:42.304437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541433e-45bd-4f95-a0c5-0ac7ff693616 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:42.305191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541433e-45bd-4f95-a0c5-0ac7ff693616 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:42.306549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541433e-45bd-4f95-a0c5-0ac7ff693616 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/users/c9e95237bc2c4c4bb998217158939d90/roles/36b37fbf95184e75911ca9f9e5d963d9` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:42.309170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541433e-45bd-4f95-a0c5-0ac7ff693616 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b8d315d35194c14b0a0b17d94801ce4, user_id=c9e95237bc2c4c4bb998217158939d90, role_id=36b37fbf95184e75911ca9f9e5d963d9)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:42.311829 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2723f-b789-43ca-8633-ad813311e5d9 None admin] RBAC: Authorizing `identity:get_user(user_id=a8d3c15fd64642b3824a5ac799f3c503)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:42.311981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541433e-45bd-4f95-a0c5-0ac7ff693616 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:42.313590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2723f-b789-43ca-8633-ad813311e5d9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:42.315314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 142/284] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:42 2022] GET /identity/v3/users/a8d3c15fd64642b3824a5ac799f3c503 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:42.319213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e983c8-dc83-4b9a-b45d-5b6d5886e3f0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:42.319535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e983c8-dc83-4b9a-b45d-5b6d5886e3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:42.319825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e983c8-dc83-4b9a-b45d-5b6d5886e3f0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:42.321202 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 143/285] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:42.322072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e983c8-dc83-4b9a-b45d-5b6d5886e3f0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:42.332596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 143/286] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:56:42 2022] PUT /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/users/c9e95237bc2c4c4bb998217158939d90/roles/36b37fbf95184e75911ca9f9e5d963d9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:56:42.333763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595525d1-0ee7-4aa8-a839-22294767a87e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:42.334127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595525d1-0ee7-4aa8-a839-22294767a87e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:42.334404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595525d1-0ee7-4aa8-a839-22294767a87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:42.359999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-595525d1-0ee7-4aa8-a839-22294767a87e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:42.362039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-595525d1-0ee7-4aa8-a839-22294767a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:42.458340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 144/287] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:42.477360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e983c8-dc83-4b9a-b45d-5b6d5886e3f0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:42.519007 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf044709-2210-4e68-ab9f-179857fa49e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:42.519644 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044709-2210-4e68-ab9f-179857fa49e4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:42.519867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044709-2210-4e68-ab9f-179857fa49e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:42.520105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044709-2210-4e68-ab9f-179857fa49e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:42.520836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf044709-2210-4e68-ab9f-179857fa49e4 None admin] RBAC: Adding query filter params (role.id=92f2004a6ac04948af8cd639d0d09f09, user.id=a8d3c15fd64642b3824a5ac799f3c503, scope.system=all) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:42.521137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf044709-2210-4e68-ab9f-179857fa49e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:42.522606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf044709-2210-4e68-ab9f-179857fa49e4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:42.529227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 144/288] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Sep 22 21:56:42 2022] GET /identity/v3/role_assignments?user.id=a8d3c15fd64642b3824a5ac799f3c503&scope.system=all&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:42.756441 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595525d1-0ee7-4aa8-a839-22294767a87e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:42.814877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:42.876796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595525d1-0ee7-4aa8-a839-22294767a87e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:42.923952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563911-2c0f-4e1c-aff3-cc7b7ee2632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:42.924607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563911-2c0f-4e1c-aff3-cc7b7ee2632f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:42.924882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563911-2c0f-4e1c-aff3-cc7b7ee2632f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:42.925149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563911-2c0f-4e1c-aff3-cc7b7ee2632f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:42.942013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563911-2c0f-4e1c-aff3-cc7b7ee2632f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-84563911-2c0f-4e1c-aff3-cc7b7ee2632f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:42.947001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:42.947884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:42.948656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 145/289] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:42.954418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf044709-2210-4e68-ab9f-179857fa49e4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:43.005070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:43.130267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf044709-2210-4e68-ab9f-179857fa49e4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:43.179796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ab8d1-28d3-4667-82f6-a58ca11aa2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:43.180412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab8d1-28d3-4667-82f6-a58ca11aa2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:43.180691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab8d1-28d3-4667-82f6-a58ca11aa2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:43.181290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab8d1-28d3-4667-82f6-a58ca11aa2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:43.182014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ab8d1-28d3-4667-82f6-a58ca11aa2f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:43.182317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ab8d1-28d3-4667-82f6-a58ca11aa2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:43.183699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ab8d1-28d3-4667-82f6-a58ca11aa2f2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:43.197224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 145/290] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:43.205389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563911-2c0f-4e1c-aff3-cc7b7ee2632f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:43.367396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563911-2c0f-4e1c-aff3-cc7b7ee2632f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:43.387505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:43.423278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05d66e-29ef-4134-aae2-b0113a71eedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:43.423939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05d66e-29ef-4134-aae2-b0113a71eedb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:43.424214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05d66e-29ef-4134-aae2-b0113a71eedb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:43.424483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05d66e-29ef-4134-aae2-b0113a71eedb None admin] PATH_INFO: `/v3/users/36733b24c45d406d9b121820f08c7d23` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:43.425642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05d66e-29ef-4134-aae2-b0113a71eedb None admin] RBAC: Authorizing `identity:get_user(user_id=36733b24c45d406d9b121820f08c7d23)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:43.427138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05d66e-29ef-4134-aae2-b0113a71eedb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:43.429101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 146/291] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:43 2022] GET /identity/v3/users/36733b24c45d406d9b121820f08c7d23 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:43.434602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ab8d1-28d3-4667-82f6-a58ca11aa2f2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:43.548642 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:43.576259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ab8d1-28d3-4667-82f6-a58ca11aa2f2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:43.620467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba881d88-5548-4e88-9af7-bb82e16241ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:43.621088 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881d88-5548-4e88-9af7-bb82e16241ae None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:43.621360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881d88-5548-4e88-9af7-bb82e16241ae None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:43.621627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881d88-5548-4e88-9af7-bb82e16241ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:43.725681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba881d88-5548-4e88-9af7-bb82e16241ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:43.727197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba881d88-5548-4e88-9af7-bb82e16241ae None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:43.852537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:43.878175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 146/292] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:43.880151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05d66e-29ef-4134-aae2-b0113a71eedb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:44.029479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05d66e-29ef-4134-aae2-b0113a71eedb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:44.062661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfc5bb-c539-42f1-82dc-62f88e8a9559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:44.063301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc5bb-c539-42f1-82dc-62f88e8a9559 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:44.063576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc5bb-c539-42f1-82dc-62f88e8a9559 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:44.063843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc5bb-c539-42f1-82dc-62f88e8a9559 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:44.064960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfc5bb-c539-42f1-82dc-62f88e8a9559 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:44.066443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfc5bb-c539-42f1-82dc-62f88e8a9559 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:44.068466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 147/293] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:43 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:44.075142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba881d88-5548-4e88-9af7-bb82e16241ae None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:44.235014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba881d88-5548-4e88-9af7-bb82e16241ae None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:44.277937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdae4b7-b6a4-4de8-bb11-5a8884bb9ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:44.278541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdae4b7-b6a4-4de8-bb11-5a8884bb9ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:44.278808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdae4b7-b6a4-4de8-bb11-5a8884bb9ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:44.279070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdae4b7-b6a4-4de8-bb11-5a8884bb9ce9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:44.279847 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdae4b7-b6a4-4de8-bb11-5a8884bb9ce9 None admin] RBAC: Adding query filter params (role.id=92f2004a6ac04948af8cd639d0d09f09, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4, user.id=36733b24c45d406d9b121820f08c7d23) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:44.280093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdae4b7-b6a4-4de8-bb11-5a8884bb9ce9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:44.281530 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdae4b7-b6a4-4de8-bb11-5a8884bb9ce9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:44.290485 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 147/294] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:44 2022] GET /identity/v3/role_assignments?user.id=36733b24c45d406d9b121820f08c7d23&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:44.844005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7c975-64dd-47fd-a3a2-2f5bdc2aa27d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:44.845046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7c975-64dd-47fd-a3a2-2f5bdc2aa27d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:44.845531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7c975-64dd-47fd-a3a2-2f5bdc2aa27d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:44.847656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 148/295] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:44.853466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887467b4-51e6-4296-ae19-6dd38b40c4f1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:44.854620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887467b4-51e6-4296-ae19-6dd38b40c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:44.855105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887467b4-51e6-4296-ae19-6dd38b40c4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:44.883187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-887467b4-51e6-4296-ae19-6dd38b40c4f1 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:44.884479 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-887467b4-51e6-4296-ae19-6dd38b40c4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:44.945384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:44.962133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ebae-c7b7-431f-a86e-c6ad142b45c4 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:44.962853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ebae-c7b7-431f-a86e-c6ad142b45c4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:44.963317 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ebae-c7b7-431f-a86e-c6ad142b45c4 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:44.965237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 149/296] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:44.971452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e329e-eb9f-472d-96b7-40d3d74f416d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:44.971619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e329e-eb9f-472d-96b7-40d3d74f416d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:44.971891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e329e-eb9f-472d-96b7-40d3d74f416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:44.987325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 148/297] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:44.994280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e71e329e-eb9f-472d-96b7-40d3d74f416d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:44.995485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e71e329e-eb9f-472d-96b7-40d3d74f416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:45.047318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:45.068825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014face8-a4ed-410c-96b7-db530400ed9b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:45.069146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014face8-a4ed-410c-96b7-db530400ed9b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:45.069375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014face8-a4ed-410c-96b7-db530400ed9b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:45.070994 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 149/298] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:45.072066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 150/299] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:45.076196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ff88-ac34-42eb-bedc-aaa75376366b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:45.076478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ff88-ac34-42eb-bedc-aaa75376366b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:45.076746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ff88-ac34-42eb-bedc-aaa75376366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:45.095723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-20b9ff88-ac34-42eb-bedc-aaa75376366b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:45.096901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-20b9ff88-ac34-42eb-bedc-aaa75376366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:45.170026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 150/300] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:45.275896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e329e-eb9f-472d-96b7-40d3d74f416d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:45.335009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa722-7bbe-4e72-89e1-3c3c062c543c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:45.335323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa722-7bbe-4e72-89e1-3c3c062c543c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:45.335883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa722-7bbe-4e72-89e1-3c3c062c543c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:45.337391 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 151/301] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:45.342365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f71a6-1c05-4781-9cd9-874ff167f1c5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:45.342641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f71a6-1c05-4781-9cd9-874ff167f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:45.342908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f71a6-1c05-4781-9cd9-874ff167f1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:45.361474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-309f71a6-1c05-4781-9cd9-874ff167f1c5 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:45.362682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-309f71a6-1c05-4781-9cd9-874ff167f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:45.381344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e329e-eb9f-472d-96b7-40d3d74f416d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:45.417522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8c9f7-d2bc-4e9c-a224-2984a557fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:45.418503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8c9f7-d2bc-4e9c-a224-2984a557fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:45.419036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8c9f7-d2bc-4e9c-a224-2984a557fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:45.419557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8c9f7-d2bc-4e9c-a224-2984a557fdf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:45.421002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8c9f7-d2bc-4e9c-a224-2984a557fdf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:45.422736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8c9f7-d2bc-4e9c-a224-2984a557fdf7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:45.424574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 151/302] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:45.427232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 152/303] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:45.429791 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8c9f7-d2bc-4e9c-a224-2984a557fdf7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:45.434896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f71a6-1c05-4781-9cd9-874ff167f1c5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:45.469916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:45.477612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:45.536864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8c9f7-d2bc-4e9c-a224-2984a557fdf7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:45.539858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f71a6-1c05-4781-9cd9-874ff167f1c5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:45.570693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d152-4c8b-4213-ac6e-0f2fb8f47719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:45.571335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d152-4c8b-4213-ac6e-0f2fb8f47719 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:45.571649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d152-4c8b-4213-ac6e-0f2fb8f47719 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:45.571921 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d152-4c8b-4213-ac6e-0f2fb8f47719 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:45.574754 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565f1f5-15ed-486f-9e6a-e7f12e201c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:45.575516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565f1f5-15ed-486f-9e6a-e7f12e201c5b None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:45.575944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565f1f5-15ed-486f-9e6a-e7f12e201c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:45.576351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565f1f5-15ed-486f-9e6a-e7f12e201c5b None admin] PATH_INFO: `/v3/groups` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:45.577114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565f1f5-15ed-486f-9e6a-e7f12e201c5b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:45.578846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565f1f5-15ed-486f-9e6a-e7f12e201c5b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:45.581793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1d152-4c8b-4213-ac6e-0f2fb8f47719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-2ce1d152-4c8b-4213-ac6e-0f2fb8f47719 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:45.587018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:45.588212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:45.589011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 152/304] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:45.590077 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d152-4c8b-4213-ac6e-0f2fb8f47719 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:45.602463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 153/305] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Sep 22 21:56:45 2022] POST /identity/v3/groups => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:45.603774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565f1f5-15ed-486f-9e6a-e7f12e201c5b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:45.734909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:45.742617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565f1f5-15ed-486f-9e6a-e7f12e201c5b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:45.746855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d152-4c8b-4213-ac6e-0f2fb8f47719 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:45.751947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:45.782989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e26a12-73b9-4ae6-ab01-6ca4ae66872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:45.783607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e26a12-73b9-4ae6-ab01-6ca4ae66872f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:45.783880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e26a12-73b9-4ae6-ab01-6ca4ae66872f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:45.784148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e26a12-73b9-4ae6-ab01-6ca4ae66872f None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:45.784825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e26a12-73b9-4ae6-ab01-6ca4ae66872f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:45.785128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e26a12-73b9-4ae6-ab01-6ca4ae66872f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:45.786559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e26a12-73b9-4ae6-ab01-6ca4ae66872f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:45.795325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fafc1-5a3e-4f95-8ebd-796f2e5f0bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:45.795981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fafc1-5a3e-4f95-8ebd-796f2e5f0bdf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:45.796251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fafc1-5a3e-4f95-8ebd-796f2e5f0bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:45.796518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fafc1-5a3e-4f95-8ebd-796f2e5f0bdf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:45.798010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 154/306] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:45.799050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e26a12-73b9-4ae6-ab01-6ca4ae66872f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:45.811236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fafc1-5a3e-4f95-8ebd-796f2e5f0bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-200fafc1-5a3e-4f95-8ebd-796f2e5f0bdf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:45.815469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:45.816336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:45.817110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 153/307] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:45.817750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fafc1-5a3e-4f95-8ebd-796f2e5f0bdf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:45.910941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e26a12-73b9-4ae6-ab01-6ca4ae66872f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:45.925172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fafc1-5a3e-4f95-8ebd-796f2e5f0bdf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:45.954880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25fe83-7218-4a5f-8993-d5b832f00021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:45.956101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25fe83-7218-4a5f-8993-d5b832f00021 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:45.956607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25fe83-7218-4a5f-8993-d5b832f00021 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:45.957095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25fe83-7218-4a5f-8993-d5b832f00021 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:45.959338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39783e-c2fe-4251-a914-6441d3b50c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:45.959970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39783e-c2fe-4251-a914-6441d3b50c8b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:45.960270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39783e-c2fe-4251-a914-6441d3b50c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:45.960930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39783e-c2fe-4251-a914-6441d3b50c8b None admin] PATH_INFO: `/v3/users/c9e95237bc2c4c4bb998217158939d90` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:45.962101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39783e-c2fe-4251-a914-6441d3b50c8b None admin] RBAC: Authorizing `identity:get_user(user_id=c9e95237bc2c4c4bb998217158939d90)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:45.963580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39783e-c2fe-4251-a914-6441d3b50c8b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:45.965158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 154/308] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:45 2022] GET /identity/v3/users/c9e95237bc2c4c4bb998217158939d90 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:45.965941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39783e-c2fe-4251-a914-6441d3b50c8b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:45.975667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25fe83-7218-4a5f-8993-d5b832f00021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-aa25fe83-7218-4a5f-8993-d5b832f00021 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:45.980607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:45.981546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 155/309] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:45.987008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25fe83-7218-4a5f-8993-d5b832f00021 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:46.005629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:46.012785 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:46.085229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39783e-c2fe-4251-a914-6441d3b50c8b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:46.103618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25fe83-7218-4a5f-8993-d5b832f00021 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:46.122411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c8339-c46b-4d5d-aae2-e394203366b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:46.123035 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8339-c46b-4d5d-aae2-e394203366b0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:46.123311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8339-c46b-4d5d-aae2-e394203366b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:46.123579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8339-c46b-4d5d-aae2-e394203366b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:46.124698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8339-c46b-4d5d-aae2-e394203366b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:46.125103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8339-c46b-4d5d-aae2-e394203366b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:46.126453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8339-c46b-4d5d-aae2-e394203366b0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:46.135245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 155/310] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:46.138771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d3831-09cc-4b73-8704-4cc7f0ec0026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:46.138999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c8339-c46b-4d5d-aae2-e394203366b0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:46.139975 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3831-09cc-4b73-8704-4cc7f0ec0026 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:46.140454 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3831-09cc-4b73-8704-4cc7f0ec0026 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:46.140729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3831-09cc-4b73-8704-4cc7f0ec0026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:46.212625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d3831-09cc-4b73-8704-4cc7f0ec0026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:46.214116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d3831-09cc-4b73-8704-4cc7f0ec0026 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:46.232090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:46.239802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:46.249640 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c8339-c46b-4d5d-aae2-e394203366b0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:46.287096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef19b1-7187-4e86-b659-afe6684f9209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:46.287701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef19b1-7187-4e86-b659-afe6684f9209 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:46.287970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef19b1-7187-4e86-b659-afe6684f9209 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:46.288238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef19b1-7187-4e86-b659-afe6684f9209 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:46.288901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef19b1-7187-4e86-b659-afe6684f9209 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:46.289198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef19b1-7187-4e86-b659-afe6684f9209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:46.290656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef19b1-7187-4e86-b659-afe6684f9209 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:46.300100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 156/311] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:46.301002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef19b1-7187-4e86-b659-afe6684f9209 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:46.326125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 156/312] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:46.326125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d3831-09cc-4b73-8704-4cc7f0ec0026 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:46.425955 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef19b1-7187-4e86-b659-afe6684f9209 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:46.435351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d3831-09cc-4b73-8704-4cc7f0ec0026 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:46.453902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:46.463360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8b488-3ced-4312-a616-222a931171f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:46.464103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8b488-3ced-4312-a616-222a931171f8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:46.464377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8b488-3ced-4312-a616-222a931171f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:46.464644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8b488-3ced-4312-a616-222a931171f8 None admin] PATH_INFO: `/v3/users/8461cd9dbbb24458a4a12d7ea9240140` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:46.471164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ada17-50ac-482e-8439-05a39e4581a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:46.471801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ada17-50ac-482e-8439-05a39e4581a0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:46.472077 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ada17-50ac-482e-8439-05a39e4581a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:46.472346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ada17-50ac-482e-8439-05a39e4581a0 None admin] PATH_INFO: `/v3/users/a8d3c15fd64642b3824a5ac799f3c503` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:46.473477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ada17-50ac-482e-8439-05a39e4581a0 None admin] RBAC: Authorizing `identity:get_user(user_id=a8d3c15fd64642b3824a5ac799f3c503)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:46.474979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ada17-50ac-482e-8439-05a39e4581a0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:46.481180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 157/313] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:46 2022] GET /identity/v3/users/a8d3c15fd64642b3824a5ac799f3c503 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:46.481180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ada17-50ac-482e-8439-05a39e4581a0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:46.483134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8b488-3ced-4312-a616-222a931171f8 None admin] RBAC: Authorizing `identity:get_user(user_id=8461cd9dbbb24458a4a12d7ea9240140)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:46.484586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8b488-3ced-4312-a616-222a931171f8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:46.486411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 157/314] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:46 2022] GET /identity/v3/users/8461cd9dbbb24458a4a12d7ea9240140 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:46.491154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8b488-3ced-4312-a616-222a931171f8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:46.505314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:46.589082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ada17-50ac-482e-8439-05a39e4581a0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:46.599127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8b488-3ced-4312-a616-222a931171f8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:46.627890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b020de-0b16-4dd5-aefb-b4146abcb434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:46.628550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b020de-0b16-4dd5-aefb-b4146abcb434 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:46.628820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b020de-0b16-4dd5-aefb-b4146abcb434 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:46.629242 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b020de-0b16-4dd5-aefb-b4146abcb434 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:46.630230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b020de-0b16-4dd5-aefb-b4146abcb434 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:46.631686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b020de-0b16-4dd5-aefb-b4146abcb434 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:46.638360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 158/315] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:46 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:46.638360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b020de-0b16-4dd5-aefb-b4146abcb434 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:46.642068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04581f60-6b9d-4fbc-83c9-f174003ab10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:46.643156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04581f60-6b9d-4fbc-83c9-f174003ab10e None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:46.643437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04581f60-6b9d-4fbc-83c9-f174003ab10e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:46.643712 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04581f60-6b9d-4fbc-83c9-f174003ab10e None admin] PATH_INFO: `/v3/system/users/a8d3c15fd64642b3824a5ac799f3c503/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:46.645507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04581f60-6b9d-4fbc-83c9-f174003ab10e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a8d3c15fd64642b3824a5ac799f3c503, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:46.647253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04581f60-6b9d-4fbc-83c9-f174003ab10e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:46.658578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 158/316] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Sep 22 21:56:46 2022] PUT /identity/v3/system/users/a8d3c15fd64642b3824a5ac799f3c503/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:56:46.660427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04581f60-6b9d-4fbc-83c9-f174003ab10e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:46.728620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:46.785591 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:46.794315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b020de-0b16-4dd5-aefb-b4146abcb434 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:46.819002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04581f60-6b9d-4fbc-83c9-f174003ab10e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:46.844101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec9375-c8ee-43b8-bd30-041c07657538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:46.844726 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9375-c8ee-43b8-bd30-041c07657538 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:46.845000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9375-c8ee-43b8-bd30-041c07657538 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:46.845330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9375-c8ee-43b8-bd30-041c07657538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:46.846681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec9375-c8ee-43b8-bd30-041c07657538 None admin] RBAC: Adding query filter params (role.id=36b37fbf95184e75911ca9f9e5d963d9, user.id=8461cd9dbbb24458a4a12d7ea9240140, scope.system=all) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:46.846991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec9375-c8ee-43b8-bd30-041c07657538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:46.848432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec9375-c8ee-43b8-bd30-041c07657538 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:46.855993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 159/317] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Sep 22 21:56:46 2022] GET /identity/v3/role_assignments?user.id=8461cd9dbbb24458a4a12d7ea9240140&scope.system=all&role.id=36b37fbf95184e75911ca9f9e5d963d9 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:46.865259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf9ed5-c369-4434-9c77-bd77289a3e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:46.866213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf9ed5-c369-4434-9c77-bd77289a3e0e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:46.866706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf9ed5-c369-4434-9c77-bd77289a3e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:46.867117 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf9ed5-c369-4434-9c77-bd77289a3e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:46.868027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf9ed5-c369-4434-9c77-bd77289a3e0e None admin] RBAC: Adding query filter params (role.id=36b37fbf95184e75911ca9f9e5d963d9, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4, user.id=c9e95237bc2c4c4bb998217158939d90) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:46.868524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf9ed5-c369-4434-9c77-bd77289a3e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:46.870237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf9ed5-c369-4434-9c77-bd77289a3e0e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:46.879433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 159/318] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:56:46 2022] GET /identity/v3/role_assignments?user.id=c9e95237bc2c4c4bb998217158939d90&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=36b37fbf95184e75911ca9f9e5d963d9 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:47.821902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8268-0900-4459-a849-a43323df8b52 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:47.822763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8268-0900-4459-a849-a43323df8b52 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:47.823032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8268-0900-4459-a849-a43323df8b52 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:47.824494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 160/319] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:47.829976 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64582910-a0c2-401b-93a4-92a1f9688099 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:47.830397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64582910-a0c2-401b-93a4-92a1f9688099 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:47.830467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64582910-a0c2-401b-93a4-92a1f9688099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:47.850225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-64582910-a0c2-401b-93a4-92a1f9688099 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:47.851398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-64582910-a0c2-401b-93a4-92a1f9688099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:47.920140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 160/320] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:48.194093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8268-0900-4459-a849-a43323df8b52 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:48.298465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8268-0900-4459-a849-a43323df8b52 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:48.315928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:48.334410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4f915-a7b1-446d-b24c-c8f615c514c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:48.335044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4f915-a7b1-446d-b24c-c8f615c514c2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:48.335317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4f915-a7b1-446d-b24c-c8f615c514c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:48.335925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4f915-a7b1-446d-b24c-c8f615c514c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:48.337042 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4f915-a7b1-446d-b24c-c8f615c514c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:48.338791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4f915-a7b1-446d-b24c-c8f615c514c2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:48.340638 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 161/321] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:56:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:48.346322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64582910-a0c2-401b-93a4-92a1f9688099 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:48.415176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:48.446764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64582910-a0c2-401b-93a4-92a1f9688099 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:48.481033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b4ff-6251-4e5b-8f2a-38070c108623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:48.481665 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b4ff-6251-4e5b-8f2a-38070c108623 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:48.481966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b4ff-6251-4e5b-8f2a-38070c108623 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:48.482234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b4ff-6251-4e5b-8f2a-38070c108623 None admin] PATH_INFO: `/v3/groups` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:48.482882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b4ff-6251-4e5b-8f2a-38070c108623 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:48.484329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b4ff-6251-4e5b-8f2a-38070c108623 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:48.504717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 161/322] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Sep 22 21:56:48 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:56:48.860079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa06986-be8a-485f-927f-1e50f6112ad4 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:48.860587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa06986-be8a-485f-927f-1e50f6112ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:48.860587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa06986-be8a-485f-927f-1e50f6112ad4 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:48.862095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 162/323] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:48.867271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246b938-82bb-47fb-b504-0f243ee6f1bd None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:48.868104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246b938-82bb-47fb-b504-0f243ee6f1bd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:48.868752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246b938-82bb-47fb-b504-0f243ee6f1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:48.888330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d246b938-82bb-47fb-b504-0f243ee6f1bd None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:48.889667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d246b938-82bb-47fb-b504-0f243ee6f1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:48.971124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 162/324] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:49.034345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d42ecb-df2d-46fe-a45f-999610f08250 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:49.034345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d42ecb-df2d-46fe-a45f-999610f08250 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:49.034345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d42ecb-df2d-46fe-a45f-999610f08250 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:49.034914 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 163/325] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:49.040510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55989-3220-4e8c-9f80-e88918277ec4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:49.040999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55989-3220-4e8c-9f80-e88918277ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:49.041353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55989-3220-4e8c-9f80-e88918277ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:49.063289 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0ab55989-3220-4e8c-9f80-e88918277ec4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:49.064486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0ab55989-3220-4e8c-9f80-e88918277ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:49.129377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:49.141282 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 163/326] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:49.269356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d42ecb-df2d-46fe-a45f-999610f08250 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:49.395021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d42ecb-df2d-46fe-a45f-999610f08250 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:49.430223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab55989-3220-4e8c-9f80-e88918277ec4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:49.436381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90a9c-0fe7-4f75-8d42-da0f0e09f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:49.437194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90a9c-0fe7-4f75-8d42-da0f0e09f0da None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:49.437471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90a9c-0fe7-4f75-8d42-da0f0e09f0da None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:49.437738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90a9c-0fe7-4f75-8d42-da0f0e09f0da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:49.449577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b90a9c-0fe7-4f75-8d42-da0f0e09f0da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e5b90a9c-0fe7-4f75-8d42-da0f0e09f0da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:49.454933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:49.455790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:49.456573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 164/327] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:49.463039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90a9c-0fe7-4f75-8d42-da0f0e09f0da None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:49.523198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:49.590071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab55989-3220-4e8c-9f80-e88918277ec4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:49.617237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90a9c-0fe7-4f75-8d42-da0f0e09f0da None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:49.670572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b8d2a-6c75-41a7-a09e-13b24b9758fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:49.671251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8d2a-6c75-41a7-a09e-13b24b9758fa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:49.671515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8d2a-6c75-41a7-a09e-13b24b9758fa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:49.671779 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8d2a-6c75-41a7-a09e-13b24b9758fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:49.678600 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e01fc-6826-407a-a1c7-a581da657059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:49.679793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e01fc-6826-407a-a1c7-a581da657059 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:49.680473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e01fc-6826-407a-a1c7-a581da657059 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:49.681153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e01fc-6826-407a-a1c7-a581da657059 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:49.682505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e01fc-6826-407a-a1c7-a581da657059 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:49.683213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e01fc-6826-407a-a1c7-a581da657059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:49.684897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e01fc-6826-407a-a1c7-a581da657059 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:49.702754 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 165/328] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:49.704564 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b8d2a-6c75-41a7-a09e-13b24b9758fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:49.708216 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e01fc-6826-407a-a1c7-a581da657059 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c45b8d2a-6c75-41a7-a09e-13b24b9758fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:49.719748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:49.720600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:49.721377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:49.729414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 164/329] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:49.730615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b8d2a-6c75-41a7-a09e-13b24b9758fa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:49.853398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:49.865569 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e01fc-6826-407a-a1c7-a581da657059 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:49.881529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:49.924888 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b8d2a-6c75-41a7-a09e-13b24b9758fa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:49.935162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38014a91-8429-45a5-bdcb-1375acdf2411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:49.936138 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38014a91-8429-45a5-bdcb-1375acdf2411 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:49.936639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38014a91-8429-45a5-bdcb-1375acdf2411 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:49.937100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38014a91-8429-45a5-bdcb-1375acdf2411 None admin] PATH_INFO: `/v3/users/a8d3c15fd64642b3824a5ac799f3c503` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:49.942554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38014a91-8429-45a5-bdcb-1375acdf2411 None admin] RBAC: Authorizing `identity:get_user(user_id=a8d3c15fd64642b3824a5ac799f3c503)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:49.944281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38014a91-8429-45a5-bdcb-1375acdf2411 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:49.946562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 166/330] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:49 2022] GET /identity/v3/users/a8d3c15fd64642b3824a5ac799f3c503 => generated 293 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:49.951940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38014a91-8429-45a5-bdcb-1375acdf2411 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:49.968993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac66d6-a059-4e02-a7e3-59e599d0284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:49.970241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac66d6-a059-4e02-a7e3-59e599d0284a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:49.970838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac66d6-a059-4e02-a7e3-59e599d0284a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:49.971502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac66d6-a059-4e02-a7e3-59e599d0284a None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:49.972897 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac66d6-a059-4e02-a7e3-59e599d0284a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:49.973601 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac66d6-a059-4e02-a7e3-59e599d0284a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:49.976371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac66d6-a059-4e02-a7e3-59e599d0284a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:49.987329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 165/331] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:49.993256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac66d6-a059-4e02-a7e3-59e599d0284a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:50.112141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac66d6-a059-4e02-a7e3-59e599d0284a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:50.127444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:50.133616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38014a91-8429-45a5-bdcb-1375acdf2411 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:50.151117 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfa3e0-162c-44e1-9f84-8f52a3cd672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:50.152058 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa3e0-162c-44e1-9f84-8f52a3cd672b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:50.152528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa3e0-162c-44e1-9f84-8f52a3cd672b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:50.152962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa3e0-162c-44e1-9f84-8f52a3cd672b None admin] PATH_INFO: `/v3/users/8461cd9dbbb24458a4a12d7ea9240140` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:50.154466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfa3e0-162c-44e1-9f84-8f52a3cd672b None admin] RBAC: Authorizing `identity:get_user(user_id=8461cd9dbbb24458a4a12d7ea9240140)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:50.156180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfa3e0-162c-44e1-9f84-8f52a3cd672b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:50.157987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 166/332] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:49 2022] GET /identity/v3/users/8461cd9dbbb24458a4a12d7ea9240140 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:50.166834 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfa3e0-162c-44e1-9f84-8f52a3cd672b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:50.195101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e491f-f44b-4f15-b1bd-aeac23b94857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:50.195726 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e491f-f44b-4f15-b1bd-aeac23b94857 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:50.196003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e491f-f44b-4f15-b1bd-aeac23b94857 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:50.196267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e491f-f44b-4f15-b1bd-aeac23b94857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:50.197044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e491f-f44b-4f15-b1bd-aeac23b94857 None admin] RBAC: Adding query filter params (role.id=92f2004a6ac04948af8cd639d0d09f09, user.id=a8d3c15fd64642b3824a5ac799f3c503, scope.system=all) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:50.197449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e491f-f44b-4f15-b1bd-aeac23b94857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:50.198828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e491f-f44b-4f15-b1bd-aeac23b94857 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:50.221454 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 167/333] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Sep 22 21:56:49 2022] GET /identity/v3/role_assignments?user.id=a8d3c15fd64642b3824a5ac799f3c503&scope.system=all&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 510 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:50.349876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfa3e0-162c-44e1-9f84-8f52a3cd672b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:50.389406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419d80a-34fa-4959-86ee-ac06d4c36fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:50.390025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d80a-34fa-4959-86ee-ac06d4c36fea None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:50.390301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d80a-34fa-4959-86ee-ac06d4c36fea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:50.390574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d80a-34fa-4959-86ee-ac06d4c36fea None admin] PATH_INFO: `/v3/system/users/8461cd9dbbb24458a4a12d7ea9240140/roles/36b37fbf95184e75911ca9f9e5d963d9` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:50.391995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419d80a-34fa-4959-86ee-ac06d4c36fea None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8461cd9dbbb24458a4a12d7ea9240140, role_id=36b37fbf95184e75911ca9f9e5d963d9)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:50.393383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419d80a-34fa-4959-86ee-ac06d4c36fea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:50.417569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 167/334] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Sep 22 21:56:50 2022] PUT /identity/v3/system/users/8461cd9dbbb24458a4a12d7ea9240140/roles/36b37fbf95184e75911ca9f9e5d963d9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:56:51.676821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a6c5-f09c-4624-a363-247c4100365c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:51.677905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a6c5-f09c-4624-a363-247c4100365c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:51.678414 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a6c5-f09c-4624-a363-247c4100365c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:51.680433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 168/335] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:51.687211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7051-b8f4-49ff-b410-cff015e67f46 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:51.688168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7051-b8f4-49ff-b410-cff015e67f46 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:51.688640 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7051-b8f4-49ff-b410-cff015e67f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:51.712293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-444c7051-b8f4-49ff-b410-cff015e67f46 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:51.713936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-444c7051-b8f4-49ff-b410-cff015e67f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:51.771053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:51.800719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 168/336] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:51.845714 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe098-c2f0-44ac-b40e-a7ae972df6fd None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:51.846064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe098-c2f0-44ac-b40e-a7ae972df6fd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:51.846283 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe098-c2f0-44ac-b40e-a7ae972df6fd None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:51.848049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 169/337] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:51.859511 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56863161-5f5f-49c1-97b0-76ffd1334133 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:51.859786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56863161-5f5f-49c1-97b0-76ffd1334133 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:51.860064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56863161-5f5f-49c1-97b0-76ffd1334133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:51.882563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-56863161-5f5f-49c1-97b0-76ffd1334133 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:51.883848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-56863161-5f5f-49c1-97b0-76ffd1334133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:51.976448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 169/338] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:52.153166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafe098-c2f0-44ac-b40e-a7ae972df6fd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:52.191102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:52.264020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafe098-c2f0-44ac-b40e-a7ae972df6fd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:52.300744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4155f7-c39a-41ec-a4e0-b70031c20385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:52.301544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4155f7-c39a-41ec-a4e0-b70031c20385 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:52.301883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4155f7-c39a-41ec-a4e0-b70031c20385 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:52.302119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4155f7-c39a-41ec-a4e0-b70031c20385 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:52.316817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4155f7-c39a-41ec-a4e0-b70031c20385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-fa4155f7-c39a-41ec-a4e0-b70031c20385 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:52.322180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:52.323132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:52.323917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:52.326327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 170/339] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:52.331792 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56863161-5f5f-49c1-97b0-76ffd1334133 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:52.457761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56863161-5f5f-49c1-97b0-76ffd1334133 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:52.467028 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:52.494778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd1540-9ebd-484b-984f-3835e61490d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:52.495408 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd1540-9ebd-484b-984f-3835e61490d2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:52.495686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd1540-9ebd-484b-984f-3835e61490d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:52.496014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd1540-9ebd-484b-984f-3835e61490d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:52.496689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd1540-9ebd-484b-984f-3835e61490d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:52.497004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd1540-9ebd-484b-984f-3835e61490d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:52.498551 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd1540-9ebd-484b-984f-3835e61490d2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:52.513883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 170/340] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:52.519824 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4155f7-c39a-41ec-a4e0-b70031c20385 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:52.538902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd1540-9ebd-484b-984f-3835e61490d2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:52.691313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:52.709386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4155f7-c39a-41ec-a4e0-b70031c20385 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:52.723257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd1540-9ebd-484b-984f-3835e61490d2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:52.771738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3b317-8932-4b55-ae6d-ada054fdf222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:52.772343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3b317-8932-4b55-ae6d-ada054fdf222 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:52.772621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3b317-8932-4b55-ae6d-ada054fdf222 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:52.772889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3b317-8932-4b55-ae6d-ada054fdf222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:52.791158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec113e35-2581-4c2f-8387-ccab83398052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:52.791832 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec113e35-2581-4c2f-8387-ccab83398052 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:52.792110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec113e35-2581-4c2f-8387-ccab83398052 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:52.792381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec113e35-2581-4c2f-8387-ccab83398052 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:52.816977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec113e35-2581-4c2f-8387-ccab83398052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ec113e35-2581-4c2f-8387-ccab83398052 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:52.823825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:52.824738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:52.825536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 171/341] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:56:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:52.829356 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ccb7a-69d2-47ed-8986-e25e01bfc0a0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:52.829632 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ccb7a-69d2-47ed-8986-e25e01bfc0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:52.829936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ccb7a-69d2-47ed-8986-e25e01bfc0a0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:52.833489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 172/342] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:52.835235 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ccb7a-69d2-47ed-8986-e25e01bfc0a0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:52.889616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:52.904507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3b317-8932-4b55-ae6d-ada054fdf222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:52.906028 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3b317-8932-4b55-ae6d-ada054fdf222 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:52.991711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ccb7a-69d2-47ed-8986-e25e01bfc0a0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:53.027081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d2464-7b4d-43aa-8e35-afeb5b4e1cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:53.027622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2464-7b4d-43aa-8e35-afeb5b4e1cad None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:53.027904 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2464-7b4d-43aa-8e35-afeb5b4e1cad None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:53.028177 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2464-7b4d-43aa-8e35-afeb5b4e1cad None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:53.028853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d2464-7b4d-43aa-8e35-afeb5b4e1cad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:53.029158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d2464-7b4d-43aa-8e35-afeb5b4e1cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:53.032657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d2464-7b4d-43aa-8e35-afeb5b4e1cad None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:53.034115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:53.042676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 173/343] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:56:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:53.043492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 171/344] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:53.044469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e9930-a497-407a-a6d4-4bd54c475a49 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:53.044749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e9930-a497-407a-a6d4-4bd54c475a49 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:53.044910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ab54b-a046-4e2d-93f1-e71eb7583669 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:53.045070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e9930-a497-407a-a6d4-4bd54c475a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:53.045217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ab54b-a046-4e2d-93f1-e71eb7583669 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:53.045364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ab54b-a046-4e2d-93f1-e71eb7583669 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:53.046941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 172/345] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:53.047793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ab54b-a046-4e2d-93f1-e71eb7583669 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:53.069417 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-766e9930-a497-407a-a6d4-4bd54c475a49 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:53.070813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-766e9930-a497-407a-a6d4-4bd54c475a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:53.151384 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 174/346] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:53.152409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e9930-a497-407a-a6d4-4bd54c475a49 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:53.174865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ab54b-a046-4e2d-93f1-e71eb7583669 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:53.175211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:53.218222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a84c9d-e57f-4eee-a18c-96a77bd29d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:53.219113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a84c9d-e57f-4eee-a18c-96a77bd29d53 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:53.219385 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a84c9d-e57f-4eee-a18c-96a77bd29d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:53.219655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a84c9d-e57f-4eee-a18c-96a77bd29d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:53.270377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e9930-a497-407a-a6d4-4bd54c475a49 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:53.306842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:53.317166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a84c9d-e57f-4eee-a18c-96a77bd29d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:53.318696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a84c9d-e57f-4eee-a18c-96a77bd29d53 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:53.321570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbc3c5-118e-4471-b4d0-e2433b731b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:53.322802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbc3c5-118e-4471-b4d0-e2433b731b0a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:53.325357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbc3c5-118e-4471-b4d0-e2433b731b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:53.325357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbc3c5-118e-4471-b4d0-e2433b731b0a None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:53.325357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbc3c5-118e-4471-b4d0-e2433b731b0a None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:53.326464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbc3c5-118e-4471-b4d0-e2433b731b0a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:53.329119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 175/347] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:53 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:53.330628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ebce-909d-4b0b-93de-e2926c9f5110 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:53.330995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ebce-909d-4b0b-93de-e2926c9f5110 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:53.331693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ebce-909d-4b0b-93de-e2926c9f5110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:53.352233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f7a9ebce-909d-4b0b-93de-e2926c9f5110 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:53.353529 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f7a9ebce-909d-4b0b-93de-e2926c9f5110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:53.432087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 176/348] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:53.432964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9ebce-909d-4b0b-93de-e2926c9f5110 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:53.442269 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 173/349] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 21:56:53.446730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a84c9d-e57f-4eee-a18c-96a77bd29d53 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:53.467269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:53.559521 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:53.566124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a84c9d-e57f-4eee-a18c-96a77bd29d53 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:53.607072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670efd2-e371-41d5-8553-c38774d255be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:53.607842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670efd2-e371-41d5-8553-c38774d255be None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:53.608113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670efd2-e371-41d5-8553-c38774d255be None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:53.608378 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670efd2-e371-41d5-8553-c38774d255be None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:53.610174 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670efd2-e371-41d5-8553-c38774d255be None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:53.611760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670efd2-e371-41d5-8553-c38774d255be None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:53.613527 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 174/350] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:53 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:53.614899 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9ebce-909d-4b0b-93de-e2926c9f5110 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:53.620502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670efd2-e371-41d5-8553-c38774d255be None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:53.670467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cac39-fbc6-4281-b747-2df009a85f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:53.671182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cac39-fbc6-4281-b747-2df009a85f6c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:53.671462 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cac39-fbc6-4281-b747-2df009a85f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:53.671730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cac39-fbc6-4281-b747-2df009a85f6c None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:53.682395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cac39-fbc6-4281-b747-2df009a85f6c None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:53.683974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cac39-fbc6-4281-b747-2df009a85f6c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:53.685925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 177/351] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:56:53 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:53.691913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cac39-fbc6-4281-b747-2df009a85f6c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:53.739948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670efd2-e371-41d5-8553-c38774d255be None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:53.777816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d217c7-72c2-4699-bcf6-8cb32becda0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:53.778739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d217c7-72c2-4699-bcf6-8cb32becda0b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:53.779236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d217c7-72c2-4699-bcf6-8cb32becda0b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:53.779634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d217c7-72c2-4699-bcf6-8cb32becda0b None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:53.780885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d217c7-72c2-4699-bcf6-8cb32becda0b None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:53.782499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d217c7-72c2-4699-bcf6-8cb32becda0b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:53.789226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 175/352] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:56:53 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:53.790445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d217c7-72c2-4699-bcf6-8cb32becda0b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:53.822372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:53.836278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:53.872868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cac39-fbc6-4281-b747-2df009a85f6c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:53.907657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d217c7-72c2-4699-bcf6-8cb32becda0b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:53.934586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8fcf4-d3b1-4bff-b030-fcba5f302dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:53.935214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8fcf4-d3b1-4bff-b030-fcba5f302dfe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:53.935483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8fcf4-d3b1-4bff-b030-fcba5f302dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:53.935747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8fcf4-d3b1-4bff-b030-fcba5f302dfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:53.936477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8fcf4-d3b1-4bff-b030-fcba5f302dfe None admin] RBAC: Adding query filter params (group.id=599cc3d09f88463b937646dc5f30bc2a, role.id=92f2004a6ac04948af8cd639d0d09f09, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:53.937024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8fcf4-d3b1-4bff-b030-fcba5f302dfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:53.938678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8fcf4-d3b1-4bff-b030-fcba5f302dfe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:53.945025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 178/353] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 22 21:56:53 2022] GET /identity/v3/role_assignments?group.id=599cc3d09f88463b937646dc5f30bc2a&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:53.946170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8fcf4-d3b1-4bff-b030-fcba5f302dfe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:53.954787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2255-a71e-4655-a902-ba7fa72c73e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:53.956875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2255-a71e-4655-a902-ba7fa72c73e2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:53.957400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2255-a71e-4655-a902-ba7fa72c73e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:53.959956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2255-a71e-4655-a902-ba7fa72c73e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:53.985085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2255-a71e-4655-a902-ba7fa72c73e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-641d2255-a71e-4655-a902-ba7fa72c73e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:53.991683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:53.992656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:53.993528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:54.000546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 176/354] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:54.002497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d49e6c-5140-4273-aefd-e2fe69550270 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:54.004288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d49e6c-5140-4273-aefd-e2fe69550270 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:54.005535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d49e6c-5140-4273-aefd-e2fe69550270 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:54.007304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 177/355] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:54.009455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d49e6c-5140-4273-aefd-e2fe69550270 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:54.114141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8fcf4-d3b1-4bff-b030-fcba5f302dfe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:54.131826 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:54.146429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d49e6c-5140-4273-aefd-e2fe69550270 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:54.161582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154afb8-7579-463b-b460-533a71546d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:54.162590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154afb8-7579-463b-b460-533a71546d27 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:54.163008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154afb8-7579-463b-b460-533a71546d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:54.163499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154afb8-7579-463b-b460-533a71546d27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:54.164384 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154afb8-7579-463b-b460-533a71546d27 None admin] RBAC: Adding query filter params (group.id=599cc3d09f88463b937646dc5f30bc2a, role.id=dcc8ff85c52344698c38ecafb6b0978c, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:54.164944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154afb8-7579-463b-b460-533a71546d27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:54.166729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154afb8-7579-463b-b460-533a71546d27 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:54.174500 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 179/356] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 22 21:56:53 2022] GET /identity/v3/role_assignments?group.id=599cc3d09f88463b937646dc5f30bc2a&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=dcc8ff85c52344698c38ecafb6b0978c => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:54.176020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154afb8-7579-463b-b460-533a71546d27 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:54.185694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999590a-ef01-421d-a85f-7704fc8722c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:54.186789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999590a-ef01-421d-a85f-7704fc8722c7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:54.187063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999590a-ef01-421d-a85f-7704fc8722c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:54.187335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999590a-ef01-421d-a85f-7704fc8722c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:54.199909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:54.204855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999590a-ef01-421d-a85f-7704fc8722c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f999590a-ef01-421d-a85f-7704fc8722c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:54.213071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:54.214064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:54.214830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 178/357] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:56:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:54.218510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5053-6bee-4de4-a793-6e6404bd4bb5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:54.218788 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5053-6bee-4de4-a793-6e6404bd4bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:54.219063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5053-6bee-4de4-a793-6e6404bd4bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:54.244621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c93f5053-6bee-4de4-a793-6e6404bd4bb5 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:54.245904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c93f5053-6bee-4de4-a793-6e6404bd4bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:54.330844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 179/358] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:54.333380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123427-a803-44d4-b1d6-9fe5bff7c6ba None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:54.335356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123427-a803-44d4-b1d6-9fe5bff7c6ba None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:54.336966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123427-a803-44d4-b1d6-9fe5bff7c6ba None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:54.339347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 180/359] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:54.340650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11123427-a803-44d4-b1d6-9fe5bff7c6ba None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:54.348241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154afb8-7579-463b-b460-533a71546d27 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:54.427211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7f779-d83e-453a-ad5d-c6a560c3f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:54.427763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f779-d83e-453a-ad5d-c6a560c3f978 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:54.428035 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f779-d83e-453a-ad5d-c6a560c3f978 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:54.428301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f779-d83e-453a-ad5d-c6a560c3f978 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:54.428980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f779-d83e-453a-ad5d-c6a560c3f978 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:54.429286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f779-d83e-453a-ad5d-c6a560c3f978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:54.430710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f779-d83e-453a-ad5d-c6a560c3f978 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:54.437183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:54.449808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 180/360] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:54.451017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab3cc-a6b3-496e-a523-cad92448a3fa None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:54.451305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab3cc-a6b3-496e-a523-cad92448a3fa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:54.451577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab3cc-a6b3-496e-a523-cad92448a3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:54.464564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11123427-a803-44d4-b1d6-9fe5bff7c6ba None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:54.490903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-833ab3cc-a6b3-496e-a523-cad92448a3fa None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:54.492110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-833ab3cc-a6b3-496e-a523-cad92448a3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:54.504722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f1c62-4043-440a-8a27-16d52ea99574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:54.505722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f1c62-4043-440a-8a27-16d52ea99574 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:54.506210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f1c62-4043-440a-8a27-16d52ea99574 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:54.506686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f1c62-4043-440a-8a27-16d52ea99574 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:54.507551 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f1c62-4043-440a-8a27-16d52ea99574 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:54.508498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f1c62-4043-440a-8a27-16d52ea99574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:54.510581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f1c62-4043-440a-8a27-16d52ea99574 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:54.522838 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 181/361] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:56:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:54.524013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f1c62-4043-440a-8a27-16d52ea99574 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:54.642913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f1c62-4043-440a-8a27-16d52ea99574 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:54.671524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 181/362] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:54.672483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab3cc-a6b3-496e-a523-cad92448a3fa None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:54.675003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:54.683458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ef81a-3de0-49be-af91-b5ec0ecd400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:54.684766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ef81a-3de0-49be-af91-b5ec0ecd400b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:54.685250 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ef81a-3de0-49be-af91-b5ec0ecd400b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:54.685704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ef81a-3de0-49be-af91-b5ec0ecd400b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:54.700586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:54.778314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ef81a-3de0-49be-af91-b5ec0ecd400b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:54.779790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ef81a-3de0-49be-af91-b5ec0ecd400b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:54.891237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab3cc-a6b3-496e-a523-cad92448a3fa None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:54.960066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dbd3e-5bac-4062-8c2b-6f98b6ec8e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:54.960947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dbd3e-5bac-4062-8c2b-6f98b6ec8e47 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:54.961216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dbd3e-5bac-4062-8c2b-6f98b6ec8e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:54.961479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dbd3e-5bac-4062-8c2b-6f98b6ec8e47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:54.983320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 182/363] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:54.984212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ef81a-3de0-49be-af91-b5ec0ecd400b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:55.039432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:55.075066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dbd3e-5bac-4062-8c2b-6f98b6ec8e47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:55.076892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dbd3e-5bac-4062-8c2b-6f98b6ec8e47 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:55.079759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:55.117581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ef81a-3de0-49be-af91-b5ec0ecd400b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:55.162240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7235a-c234-48b7-a6a0-a9e1a4776ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:55.162967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7235a-c234-48b7-a6a0-a9e1a4776ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:55.163302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7235a-c234-48b7-a6a0-a9e1a4776ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:55.163629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7235a-c234-48b7-a6a0-a9e1a4776ed0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:55.176523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7235a-c234-48b7-a6a0-a9e1a4776ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-12e7235a-c234-48b7-a6a0-a9e1a4776ed0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:55.182928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:55.183831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:56:55.184646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 183/364] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:55.185316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7235a-c234-48b7-a6a0-a9e1a4776ed0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:55.204895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 182/365] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:55.206018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dbd3e-5bac-4062-8c2b-6f98b6ec8e47 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:55.324810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7235a-c234-48b7-a6a0-a9e1a4776ed0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:55.330175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:55.334438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dbd3e-5bac-4062-8c2b-6f98b6ec8e47 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:55.336735 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:55.383467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbe1b7-60d2-46ad-9003-c0abb367b04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:55.383467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbe1b7-60d2-46ad-9003-c0abb367b04e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:55.383467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbe1b7-60d2-46ad-9003-c0abb367b04e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:55.383467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbe1b7-60d2-46ad-9003-c0abb367b04e None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:55.385578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbe1b7-60d2-46ad-9003-c0abb367b04e None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:55.387588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbe1b7-60d2-46ad-9003-c0abb367b04e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:55.389260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 184/366] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:55 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:55.389475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47495464-83dd-4cf3-8b47-e6c1ee6738cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:55.390142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbe1b7-60d2-46ad-9003-c0abb367b04e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:55.390609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47495464-83dd-4cf3-8b47-e6c1ee6738cb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:55.391073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47495464-83dd-4cf3-8b47-e6c1ee6738cb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:55.391542 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47495464-83dd-4cf3-8b47-e6c1ee6738cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:55.405547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47495464-83dd-4cf3-8b47-e6c1ee6738cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-47495464-83dd-4cf3-8b47-e6c1ee6738cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:55.412615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:55.413486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:56:55.414315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:55.415761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 183/367] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:55.422370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47495464-83dd-4cf3-8b47-e6c1ee6738cb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:55.540697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbe1b7-60d2-46ad-9003-c0abb367b04e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:55.549242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47495464-83dd-4cf3-8b47-e6c1ee6738cb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:55.581496 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917a20e-b995-4cfa-a685-6a36e7c06e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:55.582071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917a20e-b995-4cfa-a685-6a36e7c06e19 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:55.582332 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917a20e-b995-4cfa-a685-6a36e7c06e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:55.582601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917a20e-b995-4cfa-a685-6a36e7c06e19 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:55.583249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917a20e-b995-4cfa-a685-6a36e7c06e19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:55.583598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917a20e-b995-4cfa-a685-6a36e7c06e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:55.584969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917a20e-b995-4cfa-a685-6a36e7c06e19 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:55.594753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 185/368] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:55.595471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917a20e-b995-4cfa-a685-6a36e7c06e19 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:55.595876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed68e0-9267-4c0d-a0b4-047ba769eb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:55.596750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed68e0-9267-4c0d-a0b4-047ba769eb3e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:55.597224 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed68e0-9267-4c0d-a0b4-047ba769eb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:55.597685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed68e0-9267-4c0d-a0b4-047ba769eb3e None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:55.600285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed68e0-9267-4c0d-a0b4-047ba769eb3e None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:55.602078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed68e0-9267-4c0d-a0b4-047ba769eb3e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:55.604054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 184/369] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:55 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:55.605045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed68e0-9267-4c0d-a0b4-047ba769eb3e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:55.630351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:55.647121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:55.725247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed68e0-9267-4c0d-a0b4-047ba769eb3e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:55.733827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917a20e-b995-4cfa-a685-6a36e7c06e19 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:55.762517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e18ca-514f-4e99-8b9a-0907e5883982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:55.763138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e18ca-514f-4e99-8b9a-0907e5883982 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:55.763490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e18ca-514f-4e99-8b9a-0907e5883982 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:55.763691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e18ca-514f-4e99-8b9a-0907e5883982 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:55.764336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e18ca-514f-4e99-8b9a-0907e5883982 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:55.764709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e18ca-514f-4e99-8b9a-0907e5883982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:55.766177 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e18ca-514f-4e99-8b9a-0907e5883982 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:55.773477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b094fb-e129-4c73-8967-ca9ca2962608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:55.774513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b094fb-e129-4c73-8967-ca9ca2962608 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:55.775167 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b094fb-e129-4c73-8967-ca9ca2962608 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:55.775742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b094fb-e129-4c73-8967-ca9ca2962608 None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:55.776298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 185/370] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:55.780557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e18ca-514f-4e99-8b9a-0907e5883982 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:55.781564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b094fb-e129-4c73-8967-ca9ca2962608 None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:55.783618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b094fb-e129-4c73-8967-ca9ca2962608 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:55.785417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 186/371] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:56:55 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:55.786083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b094fb-e129-4c73-8967-ca9ca2962608 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:55.890237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:55.897680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e18ca-514f-4e99-8b9a-0907e5883982 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:55.909175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:55.913746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b094fb-e129-4c73-8967-ca9ca2962608 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:55.944420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361bd76-61ce-47a7-a52c-2cdb8f65f4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:55.945103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361bd76-61ce-47a7-a52c-2cdb8f65f4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:55.945437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361bd76-61ce-47a7-a52c-2cdb8f65f4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:55.945709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361bd76-61ce-47a7-a52c-2cdb8f65f4e8 None admin] PATH_INFO: `/v3/users/8461cd9dbbb24458a4a12d7ea9240140` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:55.947699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361bd76-61ce-47a7-a52c-2cdb8f65f4e8 None admin] RBAC: Authorizing `identity:get_user(user_id=8461cd9dbbb24458a4a12d7ea9240140)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:55.949261 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361bd76-61ce-47a7-a52c-2cdb8f65f4e8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:55.950906 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 186/372] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:56:55 2022] GET /identity/v3/users/8461cd9dbbb24458a4a12d7ea9240140 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:55.951737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361bd76-61ce-47a7-a52c-2cdb8f65f4e8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:55.953219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd064c07-5ec8-4633-9ea6-ce4416f2845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:55.953989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd064c07-5ec8-4633-9ea6-ce4416f2845d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:55.954276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd064c07-5ec8-4633-9ea6-ce4416f2845d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:55.954543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd064c07-5ec8-4633-9ea6-ce4416f2845d None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:55.958139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd064c07-5ec8-4633-9ea6-ce4416f2845d None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:55.959581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd064c07-5ec8-4633-9ea6-ce4416f2845d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:55.961851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 187/373] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:56:55 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:55.962709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd064c07-5ec8-4633-9ea6-ce4416f2845d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:56.062552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361bd76-61ce-47a7-a52c-2cdb8f65f4e8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:56.066699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd064c07-5ec8-4633-9ea6-ce4416f2845d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:56.102905 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc7f73-ab47-45b2-83bd-abd5a92ae62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:56.103523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7f73-ab47-45b2-83bd-abd5a92ae62d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:56.103800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7f73-ab47-45b2-83bd-abd5a92ae62d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:56.104067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7f73-ab47-45b2-83bd-abd5a92ae62d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:56.114299 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7257944-9831-4d10-a61e-519d2d4dd063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:56.114913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257944-9831-4d10-a61e-519d2d4dd063 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:56.115188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257944-9831-4d10-a61e-519d2d4dd063 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:56.115457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257944-9831-4d10-a61e-519d2d4dd063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:56.116226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7257944-9831-4d10-a61e-519d2d4dd063 None admin] RBAC: Adding query filter params (group.id=599cc3d09f88463b937646dc5f30bc2a, role.id=92f2004a6ac04948af8cd639d0d09f09, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:56.117026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7257944-9831-4d10-a61e-519d2d4dd063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:56.118809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7257944-9831-4d10-a61e-519d2d4dd063 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:56.127921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 188/374] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 22 21:56:55 2022] GET /identity/v3/role_assignments?group.id=599cc3d09f88463b937646dc5f30bc2a&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:56.128637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7257944-9831-4d10-a61e-519d2d4dd063 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:56.160171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:56.219515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:56.229415 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc7f73-ab47-45b2-83bd-abd5a92ae62d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:56.230966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc7f73-ab47-45b2-83bd-abd5a92ae62d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:56.351115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 187/375] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:56:56.351999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc7f73-ab47-45b2-83bd-abd5a92ae62d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:56.360401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7257944-9831-4d10-a61e-519d2d4dd063 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:56.403971 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2eacb-cf8d-4dab-a829-242fa25011ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:56.404602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2eacb-cf8d-4dab-a829-242fa25011ba None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:56.404880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2eacb-cf8d-4dab-a829-242fa25011ba None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:56.405150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2eacb-cf8d-4dab-a829-242fa25011ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:56.406065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2eacb-cf8d-4dab-a829-242fa25011ba None admin] RBAC: Adding query filter params (role.id=36b37fbf95184e75911ca9f9e5d963d9, user.id=8461cd9dbbb24458a4a12d7ea9240140, scope.system=all) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:56.406464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2eacb-cf8d-4dab-a829-242fa25011ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:56.407952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2eacb-cf8d-4dab-a829-242fa25011ba None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:56.417499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:56.425273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 189/376] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Sep 22 21:56:56 2022] GET /identity/v3/role_assignments?user.id=8461cd9dbbb24458a4a12d7ea9240140&scope.system=all&role.id=36b37fbf95184e75911ca9f9e5d963d9 => generated 510 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:56.426206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2eacb-cf8d-4dab-a829-242fa25011ba None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:56.473470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc7f73-ab47-45b2-83bd-abd5a92ae62d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:56.515695 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8e66-e38f-432a-8879-56640df47740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:56.516330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8e66-e38f-432a-8879-56640df47740 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:56.516608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8e66-e38f-432a-8879-56640df47740 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:56.516881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8e66-e38f-432a-8879-56640df47740 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:56.517925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8e66-e38f-432a-8879-56640df47740 None admin] RBAC: Adding query filter params (group.id=599cc3d09f88463b937646dc5f30bc2a, role.id=dcc8ff85c52344698c38ecafb6b0978c, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:56.518444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8e66-e38f-432a-8879-56640df47740 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:56.520974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8e66-e38f-432a-8879-56640df47740 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:56.529479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 188/377] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 22 21:56:56 2022] GET /identity/v3/role_assignments?group.id=599cc3d09f88463b937646dc5f30bc2a&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=dcc8ff85c52344698c38ecafb6b0978c => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:56.623404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:56.635898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2eacb-cf8d-4dab-a829-242fa25011ba None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:56.686752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac51421-e628-4e4e-8b6d-4e03609978a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:56.687313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac51421-e628-4e4e-8b6d-4e03609978a3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:56.687584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac51421-e628-4e4e-8b6d-4e03609978a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:56.687851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac51421-e628-4e4e-8b6d-4e03609978a3 None admin] PATH_INFO: `/v3/projects/1af96ba5f937450aabed914f12909978` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:56.688981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac51421-e628-4e4e-8b6d-4e03609978a3 None admin] RBAC: Authorizing `identity:get_project(project_id=1af96ba5f937450aabed914f12909978)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:56.690539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac51421-e628-4e4e-8b6d-4e03609978a3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:56.692182 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 190/378] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:56 2022] GET /identity/v3/projects/1af96ba5f937450aabed914f12909978 => generated 344 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:56.692307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc89f1-d760-46d9-8e99-91a115bbe31b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:56.692718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc89f1-d760-46d9-8e99-91a115bbe31b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:56.693067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc89f1-d760-46d9-8e99-91a115bbe31b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:56.694749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 189/379] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:56.697953 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac51421-e628-4e4e-8b6d-4e03609978a3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:56.709682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e0763-12fe-4cca-919d-d232c4e9d951 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:56.709983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e0763-12fe-4cca-919d-d232c4e9d951 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:56.710260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e0763-12fe-4cca-919d-d232c4e9d951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:56.735472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-255e0763-12fe-4cca-919d-d232c4e9d951 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:56.737053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-255e0763-12fe-4cca-919d-d232c4e9d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:56.826662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 190/380] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:56.881704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac51421-e628-4e4e-8b6d-4e03609978a3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:56.924527 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea5487-9f7d-44a7-a5ce-d8a7c394f6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:56.925166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea5487-9f7d-44a7-a5ce-d8a7c394f6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:56.925436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea5487-9f7d-44a7-a5ce-d8a7c394f6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:56.925705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea5487-9f7d-44a7-a5ce-d8a7c394f6a0 None admin] PATH_INFO: `/v3/groups/ee1beb85ee714621a8192981c47d46fe` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:56.936020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea5487-9f7d-44a7-a5ce-d8a7c394f6a0 None admin] RBAC: Authorizing `identity:get_group(group_id=ee1beb85ee714621a8192981c47d46fe)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:56.937589 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea5487-9f7d-44a7-a5ce-d8a7c394f6a0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:56.939583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 191/381] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:56:56 2022] GET /identity/v3/groups/ee1beb85ee714621a8192981c47d46fe => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:56.946498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e0763-12fe-4cca-919d-d232c4e9d951 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:56.955979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321bbde-2e4f-41ac-bdce-d595fa1054aa None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:56.956276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321bbde-2e4f-41ac-bdce-d595fa1054aa None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:56.956519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321bbde-2e4f-41ac-bdce-d595fa1054aa None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:56.958639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 192/382] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:56.968338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168d5c1-f420-41b5-8f32-1088441c4fb0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:56.968603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168d5c1-f420-41b5-8f32-1088441c4fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:56.968875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168d5c1-f420-41b5-8f32-1088441c4fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:57.006900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f168d5c1-f420-41b5-8f32-1088441c4fb0 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:57.008107 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f168d5c1-f420-41b5-8f32-1088441c4fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:57.024338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:57.043823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:57.064462 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e0763-12fe-4cca-919d-d232c4e9d951 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:57.103207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2accd3-cf9c-474c-8b4f-789445a536c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:57.104560 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2accd3-cf9c-474c-8b4f-789445a536c9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:57.105045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2accd3-cf9c-474c-8b4f-789445a536c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:57.105523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2accd3-cf9c-474c-8b4f-789445a536c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:57.106476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2accd3-cf9c-474c-8b4f-789445a536c9 None admin] RBAC: Adding query filter params (group.id=ee1beb85ee714621a8192981c47d46fe, role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=1af96ba5f937450aabed914f12909978) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:57.107939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2accd3-cf9c-474c-8b4f-789445a536c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:57.109767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2accd3-cf9c-474c-8b4f-789445a536c9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:57.116757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 191/383] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 22 21:56:56 2022] GET /identity/v3/role_assignments?group.id=ee1beb85ee714621a8192981c47d46fe&scope.project.id=1af96ba5f937450aabed914f12909978&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:57.163656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 193/384] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:57.229076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2accd3-cf9c-474c-8b4f-789445a536c9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:57.369432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2accd3-cf9c-474c-8b4f-789445a536c9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:57.392037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:57.419958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a07446-854a-440c-b937-fe6a3008add9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:57.420613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07446-854a-440c-b937-fe6a3008add9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:57.420892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07446-854a-440c-b937-fe6a3008add9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:57.421167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07446-854a-440c-b937-fe6a3008add9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:57.436188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a07446-854a-440c-b937-fe6a3008add9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a1a07446-854a-440c-b937-fe6a3008add9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:57.442394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:57.443237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:57.444018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 192/385] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:57.451152 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168d5c1-f420-41b5-8f32-1088441c4fb0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:57.564479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a07446-854a-440c-b937-fe6a3008add9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:57.592734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168d5c1-f420-41b5-8f32-1088441c4fb0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:57.654861 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b688a3-921f-4cfd-b422-7558e29fb47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:57.655470 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b688a3-921f-4cfd-b422-7558e29fb47f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:57.655740 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b688a3-921f-4cfd-b422-7558e29fb47f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:57.656001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b688a3-921f-4cfd-b422-7558e29fb47f None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:57.656660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b688a3-921f-4cfd-b422-7558e29fb47f None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:57.656958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b688a3-921f-4cfd-b422-7558e29fb47f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:57.658360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b688a3-921f-4cfd-b422-7558e29fb47f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:57.674040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 194/386] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:57.682904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b688a3-921f-4cfd-b422-7558e29fb47f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:57.710018 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:57.740168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a07446-854a-440c-b937-fe6a3008add9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:57.783306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70e3df-e1df-4e11-a142-43695d32dc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:57.783949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e3df-e1df-4e11-a142-43695d32dc9a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:57.784221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e3df-e1df-4e11-a142-43695d32dc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:57.784485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e3df-e1df-4e11-a142-43695d32dc9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:57.800164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70e3df-e1df-4e11-a142-43695d32dc9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1b70e3df-e1df-4e11-a142-43695d32dc9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:57.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:57.813251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:57.814079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 193/387] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:56:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:57.820106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70e3df-e1df-4e11-a142-43695d32dc9a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:57.870744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b688a3-921f-4cfd-b422-7558e29fb47f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:57.905050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:57.951030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda214-0481-4d14-b615-78c064c80f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:57.951700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda214-0481-4d14-b615-78c064c80f72 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:57.951959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda214-0481-4d14-b615-78c064c80f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:57.952229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda214-0481-4d14-b615-78c064c80f72 None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:57.956094 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbda214-0481-4d14-b615-78c064c80f72 None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:57.957576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbda214-0481-4d14-b615-78c064c80f72 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:57.964187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 195/388] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:56:57 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:57.965064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda214-0481-4d14-b615-78c064c80f72 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:58.015766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70e3df-e1df-4e11-a142-43695d32dc9a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:58.061593 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a588a0-b3e3-4ace-90db-43725d0e052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:58.062252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a588a0-b3e3-4ace-90db-43725d0e052e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:58.062530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a588a0-b3e3-4ace-90db-43725d0e052e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:58.062800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a588a0-b3e3-4ace-90db-43725d0e052e None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:58.063486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a588a0-b3e3-4ace-90db-43725d0e052e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:56:58.063788 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a588a0-b3e3-4ace-90db-43725d0e052e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:58.065167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a588a0-b3e3-4ace-90db-43725d0e052e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:58.085373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 194/389] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:56:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:58.091505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a588a0-b3e3-4ace-90db-43725d0e052e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:58.128268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:58.158337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda214-0481-4d14-b615-78c064c80f72 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:58.220404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28270501-8e61-4cbb-a381-0894c909f4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:58.221096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270501-8e61-4cbb-a381-0894c909f4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:58.221371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270501-8e61-4cbb-a381-0894c909f4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:58.221637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270501-8e61-4cbb-a381-0894c909f4c9 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:58.223332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:58.226766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28270501-8e61-4cbb-a381-0894c909f4c9 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:58.227029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a588a0-b3e3-4ace-90db-43725d0e052e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:58.228712 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28270501-8e61-4cbb-a381-0894c909f4c9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:58.230970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 196/390] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:57 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:58.236526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28270501-8e61-4cbb-a381-0894c909f4c9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:58.268097 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01504408-2d28-4cf6-bf73-de82d6ceb676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:58.268743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01504408-2d28-4cf6-bf73-de82d6ceb676 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:58.269207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01504408-2d28-4cf6-bf73-de82d6ceb676 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:58.269634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01504408-2d28-4cf6-bf73-de82d6ceb676 None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:58.270944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01504408-2d28-4cf6-bf73-de82d6ceb676 None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:58.272815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01504408-2d28-4cf6-bf73-de82d6ceb676 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:58.275321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 195/391] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:56:58 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:56:58.280212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01504408-2d28-4cf6-bf73-de82d6ceb676 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:58.397801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01504408-2d28-4cf6-bf73-de82d6ceb676 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:58.439473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1479b7-2d53-4657-8f0a-c1396dabc240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:58.440657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1479b7-2d53-4657-8f0a-c1396dabc240 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:58.441102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1479b7-2d53-4657-8f0a-c1396dabc240 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:58.441688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1479b7-2d53-4657-8f0a-c1396dabc240 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:58.443027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1479b7-2d53-4657-8f0a-c1396dabc240 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:58.444623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1479b7-2d53-4657-8f0a-c1396dabc240 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:58.447208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 196/392] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:56:58 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:56:58.452262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1479b7-2d53-4657-8f0a-c1396dabc240 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:58.484688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28270501-8e61-4cbb-a381-0894c909f4c9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:58.503691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:58.536621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3d6d4-bbf7-41d8-802b-a4bf02c4cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:58.537575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3d6d4-bbf7-41d8-802b-a4bf02c4cd23 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:58.538041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3d6d4-bbf7-41d8-802b-a4bf02c4cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:58.538441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3d6d4-bbf7-41d8-802b-a4bf02c4cd23 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/groups/599cc3d09f88463b937646dc5f30bc2a/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:58.544139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3d6d4-bbf7-41d8-802b-a4bf02c4cd23 None admin] RBAC: Authorizing `identity:create_grant(project_id=4426e8bcefe54612af19bbbfa1a25f80, group_id=599cc3d09f88463b937646dc5f30bc2a, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:58.545625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3d6d4-bbf7-41d8-802b-a4bf02c4cd23 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:58.567320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 197/393] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Sep 22 21:56:58 2022] PUT /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/groups/599cc3d09f88463b937646dc5f30bc2a/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 21:56:58.585031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1479b7-2d53-4657-8f0a-c1396dabc240 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:58.632909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8015542-cd46-4134-a4e8-4dc1f6e8c5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:58.633612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8015542-cd46-4134-a4e8-4dc1f6e8c5bf None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:58.633971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8015542-cd46-4134-a4e8-4dc1f6e8c5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:58.634497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8015542-cd46-4134-a4e8-4dc1f6e8c5bf None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/groups/599cc3d09f88463b937646dc5f30bc2a/roles/dcc8ff85c52344698c38ecafb6b0978c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:58.637496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8015542-cd46-4134-a4e8-4dc1f6e8c5bf None admin] RBAC: Authorizing `identity:create_grant(project_id=4426e8bcefe54612af19bbbfa1a25f80, group_id=599cc3d09f88463b937646dc5f30bc2a, role_id=dcc8ff85c52344698c38ecafb6b0978c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:56:58.639158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8015542-cd46-4134-a4e8-4dc1f6e8c5bf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:56:58.669025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 197/394] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Sep 22 21:56:58 2022] PUT /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80/groups/599cc3d09f88463b937646dc5f30bc2a/roles/dcc8ff85c52344698c38ecafb6b0978c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:56:59.266894 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346238-50ad-430c-b973-f887a1739644 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:59.268458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346238-50ad-430c-b973-f887a1739644 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:59.269121 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346238-50ad-430c-b973-f887a1739644 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:59.272241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 198/395] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:56:59.281756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c57dc-c2ac-4509-8a32-d0d5e51bc537 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:59.283043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c57dc-c2ac-4509-8a32-d0d5e51bc537 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:59.283686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c57dc-c2ac-4509-8a32-d0d5e51bc537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:59.309481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a01c57dc-c2ac-4509-8a32-d0d5e51bc537 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:59.311524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a01c57dc-c2ac-4509-8a32-d0d5e51bc537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:59.384642 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74708f7-f48f-442a-8213-eecfacf133dd None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:59.385269 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74708f7-f48f-442a-8213-eecfacf133dd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:59.385765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74708f7-f48f-442a-8213-eecfacf133dd None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:59.387385 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 199/396] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:59.392743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638280a-0fb7-4cfe-b76f-6a8b576b93d0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:59.393215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638280a-0fb7-4cfe-b76f-6a8b576b93d0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:59.393620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638280a-0fb7-4cfe-b76f-6a8b576b93d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:59.421168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 198/397] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:56:59.434055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f638280a-0fb7-4cfe-b76f-6a8b576b93d0 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:59.435586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f638280a-0fb7-4cfe-b76f-6a8b576b93d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:59.443836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:59.525913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 200/398] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:59.743656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c57dc-c2ac-4509-8a32-d0d5e51bc537 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:59.773360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:56:59.809327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490742-446e-4c9d-9afe-6262440355b8 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:59.809947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490742-446e-4c9d-9afe-6262440355b8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:59.810405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490742-446e-4c9d-9afe-6262440355b8 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:59.811952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 201/399] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:56:59.818853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e27b45-d77f-4add-ad58-fdf461dd8caa None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:59.819402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e27b45-d77f-4add-ad58-fdf461dd8caa None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:59.819880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e27b45-d77f-4add-ad58-fdf461dd8caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:59.840411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-67e27b45-d77f-4add-ad58-fdf461dd8caa None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:56:59.841992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-67e27b45-d77f-4add-ad58-fdf461dd8caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:56:59.871833 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c57dc-c2ac-4509-8a32-d0d5e51bc537 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:56:59.916370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 202/400] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:56:59.935639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e27b45-d77f-4add-ad58-fdf461dd8caa None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:56:59.950556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e1000-0a18-46b8-830c-e83e1bc58ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:56:59.951214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e1000-0a18-46b8-830c-e83e1bc58ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:56:59.951489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e1000-0a18-46b8-830c-e83e1bc58ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:56:59.951753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e1000-0a18-46b8-830c-e83e1bc58ef8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:56:59.973235 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e1000-0a18-46b8-830c-e83e1bc58ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-210e1000-0a18-46b8-830c-e83e1bc58ef8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:56:59.978391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:56:59.979387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:56:59.980621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 199/401] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:56:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:56:59.987149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e1000-0a18-46b8-830c-e83e1bc58ef8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:00.017646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:00.049603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e27b45-d77f-4add-ad58-fdf461dd8caa None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:00.083684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967a482-7802-4dfc-801e-ded0a1090843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:00.084686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967a482-7802-4dfc-801e-ded0a1090843 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:00.085181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967a482-7802-4dfc-801e-ded0a1090843 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:00.086049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967a482-7802-4dfc-801e-ded0a1090843 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:00.096560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967a482-7802-4dfc-801e-ded0a1090843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0967a482-7802-4dfc-801e-ded0a1090843 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:00.101791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:00.102692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:57:00.103922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:00.106529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 203/402] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:56:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:00.114541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967a482-7802-4dfc-801e-ded0a1090843 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:00.182624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:00.208776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e1000-0a18-46b8-830c-e83e1bc58ef8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:00.272292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17271372-43eb-432f-9440-1f17ea18ec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:00.272902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271372-43eb-432f-9440-1f17ea18ec5d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:00.273176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271372-43eb-432f-9440-1f17ea18ec5d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:00.273436 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271372-43eb-432f-9440-1f17ea18ec5d None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:00.274120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17271372-43eb-432f-9440-1f17ea18ec5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:00.274465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17271372-43eb-432f-9440-1f17ea18ec5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:00.275852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17271372-43eb-432f-9440-1f17ea18ec5d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:00.289048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 200/403] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:56:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:00.289977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17271372-43eb-432f-9440-1f17ea18ec5d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:00.307003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967a482-7802-4dfc-801e-ded0a1090843 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:00.345415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:00.353864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254e88e-b4ba-43e2-a9fe-1a0e941409f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:00.354954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254e88e-b4ba-43e2-a9fe-1a0e941409f3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:00.355290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254e88e-b4ba-43e2-a9fe-1a0e941409f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:00.355815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254e88e-b4ba-43e2-a9fe-1a0e941409f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:00.356489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254e88e-b4ba-43e2-a9fe-1a0e941409f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:00.357024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254e88e-b4ba-43e2-a9fe-1a0e941409f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:00.359059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254e88e-b4ba-43e2-a9fe-1a0e941409f3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:00.370185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 204/404] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:00.373989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254e88e-b4ba-43e2-a9fe-1a0e941409f3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:00.406154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17271372-43eb-432f-9440-1f17ea18ec5d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:00.441658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee25d19-43f5-4b68-bcca-cd2f4ff5f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:00.442359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee25d19-43f5-4b68-bcca-cd2f4ff5f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:00.442688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee25d19-43f5-4b68-bcca-cd2f4ff5f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:00.442964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee25d19-43f5-4b68-bcca-cd2f4ff5f7b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:00.454511 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee25d19-43f5-4b68-bcca-cd2f4ff5f7b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4ee25d19-43f5-4b68-bcca-cd2f4ff5f7b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:00.460995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:00.461912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:00.463374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 201/405] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:00.465225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee25d19-43f5-4b68-bcca-cd2f4ff5f7b4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:00.478060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:00.505015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254e88e-b4ba-43e2-a9fe-1a0e941409f3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:00.550052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4f8a4-f0a5-46f2-8b69-99edbe7cdd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:00.550999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4f8a4-f0a5-46f2-8b69-99edbe7cdd6b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:00.551409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4f8a4-f0a5-46f2-8b69-99edbe7cdd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:00.551809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4f8a4-f0a5-46f2-8b69-99edbe7cdd6b None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:00.553539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4f8a4-f0a5-46f2-8b69-99edbe7cdd6b None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:00.555648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4f8a4-f0a5-46f2-8b69-99edbe7cdd6b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:00.558659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 205/406] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:57:00 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:00.559663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4f8a4-f0a5-46f2-8b69-99edbe7cdd6b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:00.587046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee25d19-43f5-4b68-bcca-cd2f4ff5f7b4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:00.626958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac0bfc-07a4-4716-b621-fefddbb9a614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:00.627536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0bfc-07a4-4716-b621-fefddbb9a614 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:00.627807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0bfc-07a4-4716-b621-fefddbb9a614 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:00.628073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0bfc-07a4-4716-b621-fefddbb9a614 None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:00.629483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac0bfc-07a4-4716-b621-fefddbb9a614 None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:00.630969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac0bfc-07a4-4716-b621-fefddbb9a614 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:00.636267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:00.637910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 202/407] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:57:00 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:00.638794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac0bfc-07a4-4716-b621-fefddbb9a614 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:00.682571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4f8a4-f0a5-46f2-8b69-99edbe7cdd6b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:00.717294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ae383-f81d-4fc9-9013-dd98579ffe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:00.718174 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ae383-f81d-4fc9-9013-dd98579ffe58 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:00.718683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ae383-f81d-4fc9-9013-dd98579ffe58 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:00.719136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ae383-f81d-4fc9-9013-dd98579ffe58 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:00.720020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ae383-f81d-4fc9-9013-dd98579ffe58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:00.720549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ae383-f81d-4fc9-9013-dd98579ffe58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:00.722114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ae383-f81d-4fc9-9013-dd98579ffe58 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:00.724666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:00.736497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 206/408] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:00.737693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ae383-f81d-4fc9-9013-dd98579ffe58 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:00.749806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac0bfc-07a4-4716-b621-fefddbb9a614 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:00.786109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fc78a-4106-4b26-91b8-f1cf826565bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:00.786744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fc78a-4106-4b26-91b8-f1cf826565bc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:00.787017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fc78a-4106-4b26-91b8-f1cf826565bc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:00.787282 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fc78a-4106-4b26-91b8-f1cf826565bc None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:00.788434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fc78a-4106-4b26-91b8-f1cf826565bc None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:00.790117 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fc78a-4106-4b26-91b8-f1cf826565bc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:00.791873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 203/409] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:57:00 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:00.792643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fc78a-4106-4b26-91b8-f1cf826565bc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:00.842920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ae383-f81d-4fc9-9013-dd98579ffe58 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:00.866020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:00.877997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d8b69-b60c-4682-bf02-68b986f0ac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:00.878960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d8b69-b60c-4682-bf02-68b986f0ac3a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:00.879444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d8b69-b60c-4682-bf02-68b986f0ac3a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:00.879897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d8b69-b60c-4682-bf02-68b986f0ac3a None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:00.881240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d8b69-b60c-4682-bf02-68b986f0ac3a None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:00.882908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d8b69-b60c-4682-bf02-68b986f0ac3a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:00.885540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 207/410] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:57:00 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:00.886603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d8b69-b60c-4682-bf02-68b986f0ac3a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:00.910548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fc78a-4106-4b26-91b8-f1cf826565bc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:00.947075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7623ec-1233-44cb-8ef9-92fec2bfdfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:00.947828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7623ec-1233-44cb-8ef9-92fec2bfdfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:00.948104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7623ec-1233-44cb-8ef9-92fec2bfdfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:00.948378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7623ec-1233-44cb-8ef9-92fec2bfdfb4 None admin] PATH_INFO: `/v3/groups/ee1beb85ee714621a8192981c47d46fe` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:00.949582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7623ec-1233-44cb-8ef9-92fec2bfdfb4 None admin] RBAC: Authorizing `identity:get_group(group_id=ee1beb85ee714621a8192981c47d46fe)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:00.951098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7623ec-1233-44cb-8ef9-92fec2bfdfb4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:00.952889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 204/411] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:57:00 2022] GET /identity/v3/groups/ee1beb85ee714621a8192981c47d46fe => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:00.957523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7623ec-1233-44cb-8ef9-92fec2bfdfb4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:00.973302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:00.998354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d8b69-b60c-4682-bf02-68b986f0ac3a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:01.034399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7878fa-be40-44ce-bc87-86a5439555f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:01.035440 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7878fa-be40-44ce-bc87-86a5439555f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:01.035933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7878fa-be40-44ce-bc87-86a5439555f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:01.036406 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7878fa-be40-44ce-bc87-86a5439555f3 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/groups/599cc3d09f88463b937646dc5f30bc2a/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:01.038572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7878fa-be40-44ce-bc87-86a5439555f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b8d315d35194c14b0a0b17d94801ce4, group_id=599cc3d09f88463b937646dc5f30bc2a, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:01.040369 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7878fa-be40-44ce-bc87-86a5439555f3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:01.064190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 208/412] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Sep 22 21:57:00 2022] PUT /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/groups/599cc3d09f88463b937646dc5f30bc2a/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:57:01.065445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7878fa-be40-44ce-bc87-86a5439555f3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:01.078622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7623ec-1233-44cb-8ef9-92fec2bfdfb4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:01.130424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:01.152034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946e079-e6ff-4a51-bd14-55c4fff25c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:01.153327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946e079-e6ff-4a51-bd14-55c4fff25c7e None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:01.153871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946e079-e6ff-4a51-bd14-55c4fff25c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:01.154352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946e079-e6ff-4a51-bd14-55c4fff25c7e None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/groups/599cc3d09f88463b937646dc5f30bc2a/roles/dcc8ff85c52344698c38ecafb6b0978c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:01.164195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946e079-e6ff-4a51-bd14-55c4fff25c7e None admin] RBAC: Authorizing `identity:create_grant(project_id=2b8d315d35194c14b0a0b17d94801ce4, group_id=599cc3d09f88463b937646dc5f30bc2a, role_id=dcc8ff85c52344698c38ecafb6b0978c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:01.166230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946e079-e6ff-4a51-bd14-55c4fff25c7e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:01.198234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7878fa-be40-44ce-bc87-86a5439555f3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:01.198596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 205/413] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Sep 22 21:57:00 2022] PUT /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4/groups/599cc3d09f88463b937646dc5f30bc2a/roles/dcc8ff85c52344698c38ecafb6b0978c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:57:01.254569 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1a1d0-2ca8-49ca-b505-ff4fc4f45380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:01.255301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1a1d0-2ca8-49ca-b505-ff4fc4f45380 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:01.255618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1a1d0-2ca8-49ca-b505-ff4fc4f45380 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:01.255889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1a1d0-2ca8-49ca-b505-ff4fc4f45380 None admin] PATH_INFO: `/v3/projects/1af96ba5f937450aabed914f12909978` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:01.257199 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1a1d0-2ca8-49ca-b505-ff4fc4f45380 None admin] RBAC: Authorizing `identity:get_project(project_id=1af96ba5f937450aabed914f12909978)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:01.259135 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1a1d0-2ca8-49ca-b505-ff4fc4f45380 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:01.260925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 209/414] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:57:01 2022] GET /identity/v3/projects/1af96ba5f937450aabed914f12909978 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:01.267496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946e079-e6ff-4a51-bd14-55c4fff25c7e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:01.298957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfb9e-958c-4e2a-9e72-b3d50d78d81b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:01.299309 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfb9e-958c-4e2a-9e72-b3d50d78d81b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:01.299505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfb9e-958c-4e2a-9e72-b3d50d78d81b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:01.301328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 210/415] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:01.307760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afe95a-e3e7-4c2a-9e6a-f7c34e02a1ed None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:01.308390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afe95a-e3e7-4c2a-9e6a-f7c34e02a1ed None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:01.308390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afe95a-e3e7-4c2a-9e6a-f7c34e02a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:01.342602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e4afe95a-e3e7-4c2a-9e6a-f7c34e02a1ed None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:01.346038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e4afe95a-e3e7-4c2a-9e6a-f7c34e02a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:01.398205 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:01.447634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 211/416] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:01.460324 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946e079-e6ff-4a51-bd14-55c4fff25c7e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:01.504198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb010a70-e922-49da-b83c-ea98c3d3fc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:01.504923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb010a70-e922-49da-b83c-ea98c3d3fc40 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:01.505210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb010a70-e922-49da-b83c-ea98c3d3fc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:01.505477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb010a70-e922-49da-b83c-ea98c3d3fc40 None admin] PATH_INFO: `/v3/projects/1af96ba5f937450aabed914f12909978/groups/ee1beb85ee714621a8192981c47d46fe/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:01.511164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb010a70-e922-49da-b83c-ea98c3d3fc40 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af96ba5f937450aabed914f12909978, group_id=ee1beb85ee714621a8192981c47d46fe, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:01.512689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb010a70-e922-49da-b83c-ea98c3d3fc40 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:01.535030 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 206/417] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Sep 22 21:57:01 2022] PUT /identity/v3/projects/1af96ba5f937450aabed914f12909978/groups/ee1beb85ee714621a8192981c47d46fe/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:57:01.641523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29269-2668-4363-a5da-a39e21413f8e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:01.641874 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29269-2668-4363-a5da-a39e21413f8e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:01.642111 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29269-2668-4363-a5da-a39e21413f8e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:01.643834 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 212/418] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:01.649939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e216-7bb3-4d4d-9771-d97807bf9c69 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:01.650192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e216-7bb3-4d4d-9771-d97807bf9c69 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:01.650480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e216-7bb3-4d4d-9771-d97807bf9c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:01.675038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c0a8e216-7bb3-4d4d-9771-d97807bf9c69 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:01.676332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c0a8e216-7bb3-4d4d-9771-d97807bf9c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:01.772220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 207/419] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:01.794005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a29269-2668-4363-a5da-a39e21413f8e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:01.853940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:01.913339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a29269-2668-4363-a5da-a39e21413f8e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:01.953387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b7789-c62a-47b3-9bd2-0db6917e317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:01.954046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7789-c62a-47b3-9bd2-0db6917e317b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:01.954320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7789-c62a-47b3-9bd2-0db6917e317b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:01.954585 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7789-c62a-47b3-9bd2-0db6917e317b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:01.970302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b7789-c62a-47b3-9bd2-0db6917e317b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a85b7789-c62a-47b3-9bd2-0db6917e317b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:01.975213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:01.976092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:01.977295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 213/420] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:57:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:01.982691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8e216-7bb3-4d4d-9771-d97807bf9c69 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:02.070307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:02.106101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8e216-7bb3-4d4d-9771-d97807bf9c69 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:02.112304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b7789-c62a-47b3-9bd2-0db6917e317b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:02.147891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d643ae-c876-471a-acd5-8b5e712d7f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:02.148504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d643ae-c876-471a-acd5-8b5e712d7f53 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:02.148775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d643ae-c876-471a-acd5-8b5e712d7f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:02.149038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d643ae-c876-471a-acd5-8b5e712d7f53 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:02.151216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d643ae-c876-471a-acd5-8b5e712d7f53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:02.151522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d643ae-c876-471a-acd5-8b5e712d7f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:02.153796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d643ae-c876-471a-acd5-8b5e712d7f53 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:02.173104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 208/421] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:02.178680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d643ae-c876-471a-acd5-8b5e712d7f53 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:02.283396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d643ae-c876-471a-acd5-8b5e712d7f53 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:02.314543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:02.317773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b7789-c62a-47b3-9bd2-0db6917e317b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:02.322968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6d8d3-237b-4d4a-9e74-336b0e120788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:02.323596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6d8d3-237b-4d4a-9e74-336b0e120788 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:02.324331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6d8d3-237b-4d4a-9e74-336b0e120788 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:02.324603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6d8d3-237b-4d4a-9e74-336b0e120788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:02.342170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:02.362720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ed936-1d08-4d89-b2ea-e2fee42934f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:02.363626 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ed936-1d08-4d89-b2ea-e2fee42934f5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:02.363900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ed936-1d08-4d89-b2ea-e2fee42934f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:02.364162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ed936-1d08-4d89-b2ea-e2fee42934f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:02.374844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ed936-1d08-4d89-b2ea-e2fee42934f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-5c0ed936-1d08-4d89-b2ea-e2fee42934f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:02.380437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:02.381336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:02.382158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 214/422] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:02.394783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ed936-1d08-4d89-b2ea-e2fee42934f5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:02.441048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6d8d3-237b-4d4a-9e74-336b0e120788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:02.442468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6d8d3-237b-4d4a-9e74-336b0e120788 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:02.546731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 209/423] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:02.552565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6d8d3-237b-4d4a-9e74-336b0e120788 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:02.600692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:02.654593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ed936-1d08-4d89-b2ea-e2fee42934f5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:02.727897 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6d8d3-237b-4d4a-9e74-336b0e120788 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:02.735899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38d438-bca4-4fa4-b604-60f5fe7e68db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:02.736523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38d438-bca4-4fa4-b604-60f5fe7e68db None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:02.736791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38d438-bca4-4fa4-b604-60f5fe7e68db None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:02.737053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38d438-bca4-4fa4-b604-60f5fe7e68db None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:02.737729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38d438-bca4-4fa4-b604-60f5fe7e68db None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:02.738079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38d438-bca4-4fa4-b604-60f5fe7e68db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:02.739578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38d438-bca4-4fa4-b604-60f5fe7e68db None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:02.759710 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 215/424] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:02.764710 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38d438-bca4-4fa4-b604-60f5fe7e68db None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:02.765571 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad1fe6-5b11-40c6-b64c-b383ae8e9bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:02.766394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad1fe6-5b11-40c6-b64c-b383ae8e9bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:02.766737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad1fe6-5b11-40c6-b64c-b383ae8e9bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:02.767073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad1fe6-5b11-40c6-b64c-b383ae8e9bd1 None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:02.768514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad1fe6-5b11-40c6-b64c-b383ae8e9bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:02.770058 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad1fe6-5b11-40c6-b64c-b383ae8e9bd1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:02.771960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 210/425] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:57:02 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:02.783394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad1fe6-5b11-40c6-b64c-b383ae8e9bd1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:02.800024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:02.902229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:02.914815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad1fe6-5b11-40c6-b64c-b383ae8e9bd1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:02.941797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38d438-bca4-4fa4-b604-60f5fe7e68db None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:03.002571 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440af09-d7e2-45aa-8aed-7de8d43993a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:03.003236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440af09-d7e2-45aa-8aed-7de8d43993a0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:03.003511 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440af09-d7e2-45aa-8aed-7de8d43993a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:03.003780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440af09-d7e2-45aa-8aed-7de8d43993a0 None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:03.005565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440af09-d7e2-45aa-8aed-7de8d43993a0 None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:03.007057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440af09-d7e2-45aa-8aed-7de8d43993a0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:03.008891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 211/426] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:57:02 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:03.016479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440af09-d7e2-45aa-8aed-7de8d43993a0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:03.019681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfa05a-7103-4417-a166-397ceb977c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:03.020313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfa05a-7103-4417-a166-397ceb977c64 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:03.020583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfa05a-7103-4417-a166-397ceb977c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:03.020844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfa05a-7103-4417-a166-397ceb977c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:03.136775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440af09-d7e2-45aa-8aed-7de8d43993a0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:03.177826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed967c-7ca1-47ab-9c51-a5b97c90ef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:03.178590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed967c-7ca1-47ab-9c51-a5b97c90ef47 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:03.178927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed967c-7ca1-47ab-9c51-a5b97c90ef47 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:03.179204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed967c-7ca1-47ab-9c51-a5b97c90ef47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:03.180065 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed967c-7ca1-47ab-9c51-a5b97c90ef47 None admin] RBAC: Adding query filter params (group.id=599cc3d09f88463b937646dc5f30bc2a, role.id=dcc8ff85c52344698c38ecafb6b0978c, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:03.180531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed967c-7ca1-47ab-9c51-a5b97c90ef47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:03.182250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed967c-7ca1-47ab-9c51-a5b97c90ef47 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:03.189649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 212/427] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 22 21:57:03 2022] GET /identity/v3/role_assignments?group.id=599cc3d09f88463b937646dc5f30bc2a&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=dcc8ff85c52344698c38ecafb6b0978c => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:03.207987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfa05a-7103-4417-a166-397ceb977c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:03.209478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfa05a-7103-4417-a166-397ceb977c64 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:03.261670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:03.374928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 216/428] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 21:57:03.381181 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed967c-7ca1-47ab-9c51-a5b97c90ef47 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:03.430342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:03.504878 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed967c-7ca1-47ab-9c51-a5b97c90ef47 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:03.545646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b967fe6-fe1e-4e57-b4e1-608609ffc93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:03.546829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b967fe6-fe1e-4e57-b4e1-608609ffc93a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:03.547249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b967fe6-fe1e-4e57-b4e1-608609ffc93a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:03.547642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b967fe6-fe1e-4e57-b4e1-608609ffc93a None admin] PATH_INFO: `/v3/projects/4426e8bcefe54612af19bbbfa1a25f80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:03.549070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b967fe6-fe1e-4e57-b4e1-608609ffc93a None admin] RBAC: Authorizing `identity:get_project(project_id=4426e8bcefe54612af19bbbfa1a25f80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:03.550821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b967fe6-fe1e-4e57-b4e1-608609ffc93a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:03.552958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 213/429] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:57:03 2022] GET /identity/v3/projects/4426e8bcefe54612af19bbbfa1a25f80 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:03.560386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfa05a-7103-4417-a166-397ceb977c64 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:03.691392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfa05a-7103-4417-a166-397ceb977c64 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:03.750292 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:03.760794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e0d04-90d8-4312-83be-6edaa65ab6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:03.761763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e0d04-90d8-4312-83be-6edaa65ab6ec None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:03.762231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e0d04-90d8-4312-83be-6edaa65ab6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:03.762734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e0d04-90d8-4312-83be-6edaa65ab6ec None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:03.764255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e0d04-90d8-4312-83be-6edaa65ab6ec None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:03.765929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e0d04-90d8-4312-83be-6edaa65ab6ec None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:03.768062 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 217/430] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:57:03 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:03.774029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b967fe6-fe1e-4e57-b4e1-608609ffc93a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:03.783421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76379c78-a414-4156-b09b-8307d8ae70d2 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:03.783769 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76379c78-a414-4156-b09b-8307d8ae70d2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:03.783964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76379c78-a414-4156-b09b-8307d8ae70d2 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:03.785745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 218/431] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:03.792329 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77718e4-8148-4700-996f-3c3da71822af None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:03.792614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77718e4-8148-4700-996f-3c3da71822af None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:03.792870 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77718e4-8148-4700-996f-3c3da71822af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:03.817799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e77718e4-8148-4700-996f-3c3da71822af None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:03.818715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e77718e4-8148-4700-996f-3c3da71822af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:03.892826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:03.902278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b967fe6-fe1e-4e57-b4e1-608609ffc93a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:03.904572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 219/432] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:57:03.906221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6bb0-11c2-48fd-8b45-a720dbb92dfd None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:03.906503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6bb0-11c2-48fd-8b45-a720dbb92dfd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:03.906771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6bb0-11c2-48fd-8b45-a720dbb92dfd None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:03.908155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 220/433] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:03.913415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd66c81-e8f8-49e5-baca-876bddec13cf None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:03.913692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd66c81-e8f8-49e5-baca-876bddec13cf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:03.914001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd66c81-e8f8-49e5-baca-876bddec13cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:03.935908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7dd66c81-e8f8-49e5-baca-876bddec13cf None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:03.937108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7dd66c81-e8f8-49e5-baca-876bddec13cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:03.949409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a00ac3-e4fa-4fca-8a2f-4a90a47309d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:03.950617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a00ac3-e4fa-4fca-8a2f-4a90a47309d1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:03.951086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a00ac3-e4fa-4fca-8a2f-4a90a47309d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:03.951611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a00ac3-e4fa-4fca-8a2f-4a90a47309d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:03.952448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a00ac3-e4fa-4fca-8a2f-4a90a47309d1 None admin] RBAC: Adding query filter params (group.id=599cc3d09f88463b937646dc5f30bc2a, role.id=92f2004a6ac04948af8cd639d0d09f09, scope.project.id=4426e8bcefe54612af19bbbfa1a25f80) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:03.952849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a00ac3-e4fa-4fca-8a2f-4a90a47309d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:03.955194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a00ac3-e4fa-4fca-8a2f-4a90a47309d1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:03.963330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 214/434] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 22 21:57:03 2022] GET /identity/v3/role_assignments?group.id=599cc3d09f88463b937646dc5f30bc2a&scope.project.id=4426e8bcefe54612af19bbbfa1a25f80&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:04.022519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 221/435] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:57:04.183776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a00ac3-e4fa-4fca-8a2f-4a90a47309d1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:04.295206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a00ac3-e4fa-4fca-8a2f-4a90a47309d1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:04.301338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd66c81-e8f8-49e5-baca-876bddec13cf None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:04.337968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe4217-4b83-498e-bb3e-c81e581cfde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:04.339039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe4217-4b83-498e-bb3e-c81e581cfde2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:04.339515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe4217-4b83-498e-bb3e-c81e581cfde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:04.340003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe4217-4b83-498e-bb3e-c81e581cfde2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:04.356393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe4217-4b83-498e-bb3e-c81e581cfde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-9efe4217-4b83-498e-bb3e-c81e581cfde2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:04.361808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:04.362720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:04.363522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 215/436] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:04.369137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe4217-4b83-498e-bb3e-c81e581cfde2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:04.382684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:04.394647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:04.444969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd66c81-e8f8-49e5-baca-876bddec13cf None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:04.490730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242d23-989e-43e6-8603-f7144d0de612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:04.492179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242d23-989e-43e6-8603-f7144d0de612 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:04.492179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242d23-989e-43e6-8603-f7144d0de612 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:04.492179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242d23-989e-43e6-8603-f7144d0de612 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:04.494072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe4217-4b83-498e-bb3e-c81e581cfde2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:04.503249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242d23-989e-43e6-8603-f7144d0de612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-58242d23-989e-43e6-8603-f7144d0de612 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:04.508328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:04.509498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:57:04.510331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:04.510934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 222/437] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:57:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:04.516630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242d23-989e-43e6-8603-f7144d0de612 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:04.540296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a05795-61e4-4f7d-9c0b-c75e2a41550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:04.541033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a05795-61e4-4f7d-9c0b-c75e2a41550f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:04.541283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a05795-61e4-4f7d-9c0b-c75e2a41550f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:04.541552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a05795-61e4-4f7d-9c0b-c75e2a41550f None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:04.542293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a05795-61e4-4f7d-9c0b-c75e2a41550f None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:04.542593 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a05795-61e4-4f7d-9c0b-c75e2a41550f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:04.543977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a05795-61e4-4f7d-9c0b-c75e2a41550f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:04.553176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 216/438] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:57:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:04.554629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b204-ea78-4714-a72a-e0b6677e8cb5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:04.554906 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b204-ea78-4714-a72a-e0b6677e8cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:04.555230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b204-ea78-4714-a72a-e0b6677e8cb5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:04.558329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 217/439] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:04.559519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b204-ea78-4714-a72a-e0b6677e8cb5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:04.639117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242d23-989e-43e6-8603-f7144d0de612 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:04.648073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:04.656870 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:04.670599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b204-ea78-4714-a72a-e0b6677e8cb5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:04.673544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14842301-3f29-4270-a41e-15d8cce5c434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:04.674203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14842301-3f29-4270-a41e-15d8cce5c434 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:04.674477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14842301-3f29-4270-a41e-15d8cce5c434 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:04.674742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14842301-3f29-4270-a41e-15d8cce5c434 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:04.675401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14842301-3f29-4270-a41e-15d8cce5c434 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:04.675698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14842301-3f29-4270-a41e-15d8cce5c434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:04.677083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14842301-3f29-4270-a41e-15d8cce5c434 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:04.684856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 223/440] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:04.687108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d3be-ee88-4bf7-9129-839601431d12 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:04.687391 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d3be-ee88-4bf7-9129-839601431d12 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:04.687685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d3be-ee88-4bf7-9129-839601431d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:04.703525 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1465d-255d-4bb0-97f3-d43b4bf55e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:04.704064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1465d-255d-4bb0-97f3-d43b4bf55e8a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:04.704340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1465d-255d-4bb0-97f3-d43b4bf55e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:04.704612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1465d-255d-4bb0-97f3-d43b4bf55e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:04.705333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c502d3be-ee88-4bf7-9129-839601431d12 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:04.706572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c502d3be-ee88-4bf7-9129-839601431d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:04.771870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1465d-255d-4bb0-97f3-d43b4bf55e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:04.772847 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 224/441] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:04.773342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1465d-255d-4bb0-97f3-d43b4bf55e8a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:04.773678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502d3be-ee88-4bf7-9129-839601431d12 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:04.855275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:04.879389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 218/442] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 21:57:04.879769 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502d3be-ee88-4bf7-9129-839601431d12 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:04.885188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1465d-255d-4bb0-97f3-d43b4bf55e8a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:04.895009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:04.920980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d3e3f-b205-46c1-a264-bcb347671e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:04.921582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d3e3f-b205-46c1-a264-bcb347671e61 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:04.921874 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d3e3f-b205-46c1-a264-bcb347671e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:04.922142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d3e3f-b205-46c1-a264-bcb347671e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:04.988424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d3e3f-b205-46c1-a264-bcb347671e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:04.989893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d3e3f-b205-46c1-a264-bcb347671e61 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:04.995556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1465d-255d-4bb0-97f3-d43b4bf55e8a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:05.035206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bc1f5-05c2-4541-b182-892f2ced8195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:05.035853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bc1f5-05c2-4541-b182-892f2ced8195 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:05.036129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bc1f5-05c2-4541-b182-892f2ced8195 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:05.036405 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bc1f5-05c2-4541-b182-892f2ced8195 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:05.037540 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bc1f5-05c2-4541-b182-892f2ced8195 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:05.039134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bc1f5-05c2-4541-b182-892f2ced8195 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:05.045130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 219/443] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:57:04 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:05.045130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bc1f5-05c2-4541-b182-892f2ced8195 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:05.089854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 225/444] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:05.090712 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d3e3f-b205-46c1-a264-bcb347671e61 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:05.097046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:05.101705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:05.143489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bc1f5-05c2-4541-b182-892f2ced8195 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:05.178524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24930ba1-db14-40ae-915a-e4a28bb9e720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:05.179429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24930ba1-db14-40ae-915a-e4a28bb9e720 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:05.179844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24930ba1-db14-40ae-915a-e4a28bb9e720 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:05.180276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24930ba1-db14-40ae-915a-e4a28bb9e720 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:05.190645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24930ba1-db14-40ae-915a-e4a28bb9e720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:05.191684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d3e3f-b205-46c1-a264-bcb347671e61 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-24930ba1-db14-40ae-915a-e4a28bb9e720 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:05.195383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:05.196453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:05.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:05.201501 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 220/445] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:05.202704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24930ba1-db14-40ae-915a-e4a28bb9e720 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:05.230902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f151ba-1f2d-4ec9-a1ee-0a6226a58aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:05.231818 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f151ba-1f2d-4ec9-a1ee-0a6226a58aea None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:05.232205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f151ba-1f2d-4ec9-a1ee-0a6226a58aea None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:05.232607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f151ba-1f2d-4ec9-a1ee-0a6226a58aea None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:05.233807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f151ba-1f2d-4ec9-a1ee-0a6226a58aea None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:05.235822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f151ba-1f2d-4ec9-a1ee-0a6226a58aea None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:05.237753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 226/446] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:57:05 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:05.238999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f151ba-1f2d-4ec9-a1ee-0a6226a58aea None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:05.317463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24930ba1-db14-40ae-915a-e4a28bb9e720 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:05.323320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:05.324955 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:05.346859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f151ba-1f2d-4ec9-a1ee-0a6226a58aea None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:05.351775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fa8ac-6c85-4aaa-8039-d3dd81a058b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:05.352422 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fa8ac-6c85-4aaa-8039-d3dd81a058b8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:05.352711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fa8ac-6c85-4aaa-8039-d3dd81a058b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:05.352969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fa8ac-6c85-4aaa-8039-d3dd81a058b8 None admin] PATH_INFO: `/v3/projects/2b8d315d35194c14b0a0b17d94801ce4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:05.354267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fa8ac-6c85-4aaa-8039-d3dd81a058b8 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8d315d35194c14b0a0b17d94801ce4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:05.356127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fa8ac-6c85-4aaa-8039-d3dd81a058b8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:05.358142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 221/447] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:57:05 2022] GET /identity/v3/projects/2b8d315d35194c14b0a0b17d94801ce4 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:05.359209 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fa8ac-6c85-4aaa-8039-d3dd81a058b8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:05.385434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dee40e-9204-4829-90ba-9128673117a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:05.386072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dee40e-9204-4829-90ba-9128673117a3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:05.386346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dee40e-9204-4829-90ba-9128673117a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:05.386609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dee40e-9204-4829-90ba-9128673117a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:05.387276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dee40e-9204-4829-90ba-9128673117a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:05.387574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dee40e-9204-4829-90ba-9128673117a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:05.388967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dee40e-9204-4829-90ba-9128673117a3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:05.396850 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 227/448] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:05.397625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dee40e-9204-4829-90ba-9128673117a3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:05.459446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fa8ac-6c85-4aaa-8039-d3dd81a058b8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:05.492573 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c38b18-ce37-4404-a7ed-5e2acdf05ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:05.493115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c38b18-ce37-4404-a7ed-5e2acdf05ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:05.493603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c38b18-ce37-4404-a7ed-5e2acdf05ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:05.493708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c38b18-ce37-4404-a7ed-5e2acdf05ac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:05.494435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c38b18-ce37-4404-a7ed-5e2acdf05ac9 None admin] RBAC: Adding query filter params (group.id=599cc3d09f88463b937646dc5f30bc2a, role.id=92f2004a6ac04948af8cd639d0d09f09, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:05.494739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c38b18-ce37-4404-a7ed-5e2acdf05ac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:05.495662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dee40e-9204-4829-90ba-9128673117a3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:05.496165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c38b18-ce37-4404-a7ed-5e2acdf05ac9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:05.501951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 222/449] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 22 21:57:05 2022] GET /identity/v3/role_assignments?group.id=599cc3d09f88463b937646dc5f30bc2a&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=92f2004a6ac04948af8cd639d0d09f09 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:05.502734 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c38b18-ce37-4404-a7ed-5e2acdf05ac9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:05.538826 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721834-6c38-42f3-9ace-db1b3665f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:05.539480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721834-6c38-42f3-9ace-db1b3665f21d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:05.539754 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721834-6c38-42f3-9ace-db1b3665f21d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:05.540169 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721834-6c38-42f3-9ace-db1b3665f21d None admin] PATH_INFO: `/v3/groups/599cc3d09f88463b937646dc5f30bc2a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:05.541635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69721834-6c38-42f3-9ace-db1b3665f21d None admin] RBAC: Authorizing `identity:get_group(group_id=599cc3d09f88463b937646dc5f30bc2a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:05.543190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69721834-6c38-42f3-9ace-db1b3665f21d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:05.545144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 228/450] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:57:05 2022] GET /identity/v3/groups/599cc3d09f88463b937646dc5f30bc2a => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:05.550657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721834-6c38-42f3-9ace-db1b3665f21d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:05.559876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:05.569445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:05.630138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c38b18-ce37-4404-a7ed-5e2acdf05ac9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:05.669398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003e2b-0972-4033-abe2-82c076d19b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:05.670077 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003e2b-0972-4033-abe2-82c076d19b77 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:05.670407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003e2b-0972-4033-abe2-82c076d19b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:05.670686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003e2b-0972-4033-abe2-82c076d19b77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:05.679524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721834-6c38-42f3-9ace-db1b3665f21d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:05.727614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165fa2a-519f-494b-aba8-42e8ce609c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:05.728231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165fa2a-519f-494b-aba8-42e8ce609c1c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:05.728590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165fa2a-519f-494b-aba8-42e8ce609c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:05.728859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165fa2a-519f-494b-aba8-42e8ce609c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:05.729691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165fa2a-519f-494b-aba8-42e8ce609c1c None admin] RBAC: Adding query filter params (group.id=599cc3d09f88463b937646dc5f30bc2a, role.id=dcc8ff85c52344698c38ecafb6b0978c, scope.project.id=2b8d315d35194c14b0a0b17d94801ce4) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:05.730125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165fa2a-519f-494b-aba8-42e8ce609c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:05.731556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165fa2a-519f-494b-aba8-42e8ce609c1c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:05.737533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 229/451] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 22 21:57:05 2022] GET /identity/v3/role_assignments?group.id=599cc3d09f88463b937646dc5f30bc2a&scope.project.id=2b8d315d35194c14b0a0b17d94801ce4&role.id=dcc8ff85c52344698c38ecafb6b0978c => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:05.753467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003e2b-0972-4033-abe2-82c076d19b77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:05.755024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003e2b-0972-4033-abe2-82c076d19b77 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:05.801067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:05.868693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 223/452] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:05.875198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165fa2a-519f-494b-aba8-42e8ce609c1c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:05.955802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:05.987350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165fa2a-519f-494b-aba8-42e8ce609c1c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:06.021907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d099f1-28d3-446b-9c1f-ece6a9b99331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:06.022467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d099f1-28d3-446b-9c1f-ece6a9b99331 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:06.022738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d099f1-28d3-446b-9c1f-ece6a9b99331 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:06.023009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d099f1-28d3-446b-9c1f-ece6a9b99331 None admin] PATH_INFO: `/v3/projects/1af96ba5f937450aabed914f12909978` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:06.024115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d099f1-28d3-446b-9c1f-ece6a9b99331 None admin] RBAC: Authorizing `identity:get_project(project_id=1af96ba5f937450aabed914f12909978)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:06.025618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d099f1-28d3-446b-9c1f-ece6a9b99331 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:06.027375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 230/453] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:57:05 2022] GET /identity/v3/projects/1af96ba5f937450aabed914f12909978 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:06.033136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003e2b-0972-4033-abe2-82c076d19b77 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:06.137490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003e2b-0972-4033-abe2-82c076d19b77 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:06.173792 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfe94-3ca3-4445-9e22-ba91afab714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:06.174455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfe94-3ca3-4445-9e22-ba91afab714b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:06.174732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfe94-3ca3-4445-9e22-ba91afab714b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:06.175003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfe94-3ca3-4445-9e22-ba91afab714b None admin] PATH_INFO: `/v3/groups/ee1beb85ee714621a8192981c47d46fe` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:06.176120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bfe94-3ca3-4445-9e22-ba91afab714b None admin] RBAC: Authorizing `identity:get_group(group_id=ee1beb85ee714621a8192981c47d46fe)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:06.177556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bfe94-3ca3-4445-9e22-ba91afab714b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:06.179169 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 224/454] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 22 21:57:06 2022] GET /identity/v3/groups/ee1beb85ee714621a8192981c47d46fe => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:06.188918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d099f1-28d3-446b-9c1f-ece6a9b99331 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:06.303810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d099f1-28d3-446b-9c1f-ece6a9b99331 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:06.342096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8f912-e30d-4984-b227-4689a4402c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:06.343011 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8f912-e30d-4984-b227-4689a4402c40 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:06.343428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8f912-e30d-4984-b227-4689a4402c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:06.343839 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8f912-e30d-4984-b227-4689a4402c40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:06.344966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8f912-e30d-4984-b227-4689a4402c40 None admin] RBAC: Adding query filter params (group.id=ee1beb85ee714621a8192981c47d46fe, role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=1af96ba5f937450aabed914f12909978) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:06.345446 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8f912-e30d-4984-b227-4689a4402c40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:06.347794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8f912-e30d-4984-b227-4689a4402c40 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:06.355885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 231/455] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 22 21:57:06 2022] GET /identity/v3/role_assignments?group.id=ee1beb85ee714621a8192981c47d46fe&scope.project.id=1af96ba5f937450aabed914f12909978&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:08.856687 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a110b7d-81a6-42a8-85b6-42cbbd651b3a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:08.857208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a110b7d-81a6-42a8-85b6-42cbbd651b3a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:08.857208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a110b7d-81a6-42a8-85b6-42cbbd651b3a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:08.858857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 225/456] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:08.876658 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238d787-f7a2-475f-bfaa-7c203f89fd58 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:08.877589 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238d787-f7a2-475f-bfaa-7c203f89fd58 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:08.878094 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238d787-f7a2-475f-bfaa-7c203f89fd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:08.888371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:08.906881 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4238d787-f7a2-475f-bfaa-7c203f89fd58 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:08.908097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4238d787-f7a2-475f-bfaa-7c203f89fd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:08.991407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 232/457] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:09.315413 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbeb0f-aa1a-4284-8060-de9e787d61cb None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:09.315587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbeb0f-aa1a-4284-8060-de9e787d61cb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:09.315850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbeb0f-aa1a-4284-8060-de9e787d61cb None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:09.317746 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 226/458] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:09.323731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a061f-2c02-4c67-98bd-c9b9f254ced2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:09.324217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a061f-2c02-4c67-98bd-c9b9f254ced2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:09.324621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a061f-2c02-4c67-98bd-c9b9f254ced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:09.341942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bde35-59c4-415e-9fad-c6ab0d46dab0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:09.342435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bde35-59c4-415e-9fad-c6ab0d46dab0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:09.342841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bde35-59c4-415e-9fad-c6ab0d46dab0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:09.344824 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 227/459] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:09.347655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-589a061f-2c02-4c67-98bd-c9b9f254ced2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:09.348860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-589a061f-2c02-4c67-98bd-c9b9f254ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:09.350646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112bf57-5991-4750-9268-6e80dc30973a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:09.351087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112bf57-5991-4750-9268-6e80dc30973a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:09.351489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112bf57-5991-4750-9268-6e80dc30973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:09.378200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:09.385579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1112bf57-5991-4750-9268-6e80dc30973a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:09.388371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1112bf57-5991-4750-9268-6e80dc30973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:09.446429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 233/460] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:09.447539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a061f-2c02-4c67-98bd-c9b9f254ced2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:09.475750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 228/461] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:57:09.535231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:09.567085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a061f-2c02-4c67-98bd-c9b9f254ced2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:09.602581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2f5a-d8fe-4fc3-b2f4-23d7bd2f0ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:09.603301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2f5a-d8fe-4fc3-b2f4-23d7bd2f0ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:09.603575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2f5a-d8fe-4fc3-b2f4-23d7bd2f0ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:09.603840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2f5a-d8fe-4fc3-b2f4-23d7bd2f0ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:09.614476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2f5a-d8fe-4fc3-b2f4-23d7bd2f0ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:09.615927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2f5a-d8fe-4fc3-b2f4-23d7bd2f0ff6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-90ac2f5a-d8fe-4fc3-b2f4-23d7bd2f0ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:09.631976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:09.632918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:09.633995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:09.633995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:09.633995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:09.633995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 234/462] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:09.639756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112bf57-5991-4750-9268-6e80dc30973a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:09.724005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2f5a-d8fe-4fc3-b2f4-23d7bd2f0ff6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:09.801514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112bf57-5991-4750-9268-6e80dc30973a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:09.855923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734955b-c1cf-40f7-a2f2-b1616422abbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:09.856993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734955b-c1cf-40f7-a2f2-b1616422abbb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:09.857942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734955b-c1cf-40f7-a2f2-b1616422abbb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:09.858412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734955b-c1cf-40f7-a2f2-b1616422abbb None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:09.859351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734955b-c1cf-40f7-a2f2-b1616422abbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:09.859977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734955b-c1cf-40f7-a2f2-b1616422abbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:09.861562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734955b-c1cf-40f7-a2f2-b1616422abbb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:09.864651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:09.869058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2f5a-d8fe-4fc3-b2f4-23d7bd2f0ff6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:09.874811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 229/463] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:09.876989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a83c4-1e12-4dea-a73c-9d9ee8f7b168 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:09.876989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a83c4-1e12-4dea-a73c-9d9ee8f7b168 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:09.876989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a83c4-1e12-4dea-a73c-9d9ee8f7b168 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:09.881784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 230/464] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:09.882583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a83c4-1e12-4dea-a73c-9d9ee8f7b168 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:09.887128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:09.906617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324bd7a-b366-46f8-a02d-5514af1153bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:09.907244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324bd7a-b366-46f8-a02d-5514af1153bc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:09.907521 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324bd7a-b366-46f8-a02d-5514af1153bc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:09.907784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324bd7a-b366-46f8-a02d-5514af1153bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:09.918680 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324bd7a-b366-46f8-a02d-5514af1153bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:09.920192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324bd7a-b366-46f8-a02d-5514af1153bc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3324bd7a-b366-46f8-a02d-5514af1153bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:09.934475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:09.935561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:09.936439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:09.936439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:09.936439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:09.936439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 235/465] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:09.936646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324bd7a-b366-46f8-a02d-5514af1153bc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:09.997819 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a83c4-1e12-4dea-a73c-9d9ee8f7b168 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:10.034448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54139d0e-7d48-49d5-b650-0fa4d67914aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:10.035192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54139d0e-7d48-49d5-b650-0fa4d67914aa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:10.035471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54139d0e-7d48-49d5-b650-0fa4d67914aa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:10.035893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54139d0e-7d48-49d5-b650-0fa4d67914aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:10.041343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324bd7a-b366-46f8-a02d-5514af1153bc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:10.049381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54139d0e-7d48-49d5-b650-0fa4d67914aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:10.051345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54139d0e-7d48-49d5-b650-0fa4d67914aa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-54139d0e-7d48-49d5-b650-0fa4d67914aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:10.067365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:10.068401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:10.069364 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:10.069364 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:10.069364 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:10.070750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 231/466] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:10.072338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393b3cf-f9a9-4ef1-aeec-d9cbe943ec60 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:10.072755 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393b3cf-f9a9-4ef1-aeec-d9cbe943ec60 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:10.073157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393b3cf-f9a9-4ef1-aeec-d9cbe943ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:10.081794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e8ba7-7cef-4356-a552-f8c346a2fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:10.082515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e8ba7-7cef-4356-a552-f8c346a2fcb6 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:10.082787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e8ba7-7cef-4356-a552-f8c346a2fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:10.083050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e8ba7-7cef-4356-a552-f8c346a2fcb6 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:10.083697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e8ba7-7cef-4356-a552-f8c346a2fcb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:10.085146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e8ba7-7cef-4356-a552-f8c346a2fcb6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:10.094341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0393b3cf-f9a9-4ef1-aeec-d9cbe943ec60 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:10.095740 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0393b3cf-f9a9-4ef1-aeec-d9cbe943ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:10.111212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 236/467] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:57:09 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:57:10.112272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e8ba7-7cef-4356-a552-f8c346a2fcb6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:10.141289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:10.167288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:10.196565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 232/468] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:10.197669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393b3cf-f9a9-4ef1-aeec-d9cbe943ec60 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:10.246890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e8ba7-7cef-4356-a552-f8c346a2fcb6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:10.316400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20550b-e11b-4511-b368-4d057e16f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:10.317161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20550b-e11b-4511-b368-4d057e16f285 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:10.317368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20550b-e11b-4511-b368-4d057e16f285 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:10.317547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20550b-e11b-4511-b368-4d057e16f285 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:10.319119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20550b-e11b-4511-b368-4d057e16f285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:10.320063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20550b-e11b-4511-b368-4d057e16f285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:10.321718 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20550b-e11b-4511-b368-4d057e16f285 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:10.348243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 237/469] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:10.355255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20550b-e11b-4511-b368-4d057e16f285 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:10.376414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393b3cf-f9a9-4ef1-aeec-d9cbe943ec60 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:10.420168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741539-e28a-4abf-9e78-e0a173093214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:10.420923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741539-e28a-4abf-9e78-e0a173093214 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:10.421200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741539-e28a-4abf-9e78-e0a173093214 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:10.421614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741539-e28a-4abf-9e78-e0a173093214 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:10.422333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9741539-e28a-4abf-9e78-e0a173093214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:10.422631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9741539-e28a-4abf-9e78-e0a173093214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:10.424182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9741539-e28a-4abf-9e78-e0a173093214 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:10.441104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 233/470] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:10.447158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741539-e28a-4abf-9e78-e0a173093214 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:10.482222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:10.495723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:10.502393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20550b-e11b-4511-b368-4d057e16f285 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:10.540597 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3917ee-b573-44c6-9af3-588104596371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:10.541205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3917ee-b573-44c6-9af3-588104596371 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:10.541476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3917ee-b573-44c6-9af3-588104596371 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:10.541739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3917ee-b573-44c6-9af3-588104596371 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:10.542618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3917ee-b573-44c6-9af3-588104596371 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:10.543855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3917ee-b573-44c6-9af3-588104596371 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:10.567957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741539-e28a-4abf-9e78-e0a173093214 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:10.569763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 238/471] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:57:10 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:57:10.570653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3917ee-b573-44c6-9af3-588104596371 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:10.618387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4e6a6-332f-4408-8c73-bce44d130470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:10.619272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4e6a6-332f-4408-8c73-bce44d130470 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:10.619599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4e6a6-332f-4408-8c73-bce44d130470 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:10.619929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4e6a6-332f-4408-8c73-bce44d130470 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:10.620707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4e6a6-332f-4408-8c73-bce44d130470 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:10.622300 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4e6a6-332f-4408-8c73-bce44d130470 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:10.655836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 234/472] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:57:10 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:57:10.657759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbd30a-56fc-4d98-84c9-0c65f580d7b5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:10.658070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbd30a-56fc-4d98-84c9-0c65f580d7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:10.658394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbd30a-56fc-4d98-84c9-0c65f580d7b5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:10.661731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 235/473] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:10.668441 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c9e91-88fc-41f2-b594-acecb2931ed2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:10.669509 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c9e91-88fc-41f2-b594-acecb2931ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:10.669949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c9e91-88fc-41f2-b594-acecb2931ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:10.697037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d47c9e91-88fc-41f2-b594-acecb2931ed2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:10.698180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3917ee-b573-44c6-9af3-588104596371 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:10.698300 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d47c9e91-88fc-41f2-b594-acecb2931ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:10.750014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b663d5-9b6e-487c-987c-05bed4e05d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:10.750935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b663d5-9b6e-487c-987c-05bed4e05d0d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:10.751297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b663d5-9b6e-487c-987c-05bed4e05d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:10.751677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b663d5-9b6e-487c-987c-05bed4e05d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:10.764008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:10.769301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b663d5-9b6e-487c-987c-05bed4e05d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:10.771059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b663d5-9b6e-487c-987c-05bed4e05d0d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-49b663d5-9b6e-487c-987c-05bed4e05d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:10.792218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:10.793170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:10.794133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:10.794133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:10.794133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:10.794321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 236/474] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:10.795606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 239/475] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:10.801821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c9e91-88fc-41f2-b594-acecb2931ed2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:10.835548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:10.924110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c9e91-88fc-41f2-b594-acecb2931ed2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:10.960313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edd1ad-c847-40f0-8def-4bc23e2ce247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:10.961289 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edd1ad-c847-40f0-8def-4bc23e2ce247 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:10.961562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edd1ad-c847-40f0-8def-4bc23e2ce247 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:10.961877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edd1ad-c847-40f0-8def-4bc23e2ce247 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:10.962540 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edd1ad-c847-40f0-8def-4bc23e2ce247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:10.962840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edd1ad-c847-40f0-8def-4bc23e2ce247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:10.964229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edd1ad-c847-40f0-8def-4bc23e2ce247 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:10.976400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 237/476] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:10.982175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b663d5-9b6e-487c-987c-05bed4e05d0d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:11.091523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b663d5-9b6e-487c-987c-05bed4e05d0d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:11.126693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe762-6a55-4cd9-a70c-a077a7750457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:11.127358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe762-6a55-4cd9-a70c-a077a7750457 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:11.127633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe762-6a55-4cd9-a70c-a077a7750457 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:11.127901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe762-6a55-4cd9-a70c-a077a7750457 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:11.128564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fe762-6a55-4cd9-a70c-a077a7750457 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:11.130027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fe762-6a55-4cd9-a70c-a077a7750457 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:11.134658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edd1ad-c847-40f0-8def-4bc23e2ce247 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:11.157449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 240/477] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:57:10 2022] POST /identity/v3/users => generated 249 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:57:11.235087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:11.254925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edd1ad-c847-40f0-8def-4bc23e2ce247 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:11.292713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450de72a-63a0-46e7-b763-b53a5a10c789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:11.293696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450de72a-63a0-46e7-b763-b53a5a10c789 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:11.294180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450de72a-63a0-46e7-b763-b53a5a10c789 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:11.294616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450de72a-63a0-46e7-b763-b53a5a10c789 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:11.295475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450de72a-63a0-46e7-b763-b53a5a10c789 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:11.297041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450de72a-63a0-46e7-b763-b53a5a10c789 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:11.306742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.sql.core [None req-450de72a-63a0-46e7-b763-b53a5a10c789 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 21:57:11.306742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 21:57:11.306742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [parameters: {'id': '7d2d4a986f72428b863b503bbb28e9e3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 21:57:11.306742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81638) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-450de72a-63a0-46e7-b763-b53a5a10c789 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Sep 22 21:57:11.325503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return ref.to_dict() Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 21:57:11.326473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application yield resource Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise self.value Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application session.commit() Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 21:57:11.327367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.flush() Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application compat.raise_( Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 21:57:11.328352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 21:57:11.329596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 21:57:11.330517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [parameters: {'id': '7d2d4a986f72428b863b503bbb28e9e3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:11.331359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 21:57:11.332248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:11.339420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 238/478] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Sep 22 21:57:11 2022] POST /identity/v3/roles => generated 144 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:11.342125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe762-6a55-4cd9-a70c-a077a7750457 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:11.421700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:11.479038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe762-6a55-4cd9-a70c-a077a7750457 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:11.519282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc8a8a-5986-42fc-8270-28862943e60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:11.519840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc8a8a-5986-42fc-8270-28862943e60f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:11.520115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc8a8a-5986-42fc-8270-28862943e60f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:11.520437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc8a8a-5986-42fc-8270-28862943e60f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:11.530791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc8a8a-5986-42fc-8270-28862943e60f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b5bc8a8a-5986-42fc-8270-28862943e60f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:11.536061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:11.537009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:11.538008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 241/479] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:57:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:11.545449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450de72a-63a0-46e7-b763-b53a5a10c789 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:11.649269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450de72a-63a0-46e7-b763-b53a5a10c789 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:11.685549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89a892-a61a-4908-b4e6-b9ebc6b87e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:11.686586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a892-a61a-4908-b4e6-b9ebc6b87e03 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:11.687052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a892-a61a-4908-b4e6-b9ebc6b87e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:11.687504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a892-a61a-4908-b4e6-b9ebc6b87e03 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:11.688358 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89a892-a61a-4908-b4e6-b9ebc6b87e03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:11.688844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89a892-a61a-4908-b4e6-b9ebc6b87e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:11.690443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89a892-a61a-4908-b4e6-b9ebc6b87e03 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:11.700614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 239/480] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:13.124330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b4590-6a91-4899-a940-1c8dd60a1be3 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:13.124862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b4590-6a91-4899-a940-1c8dd60a1be3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:13.124960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b4590-6a91-4899-a940-1c8dd60a1be3 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:13.126508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 242/481] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:13.131607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779100f-c5c2-4f1b-92d0-c5e5703098e7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:13.132004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779100f-c5c2-4f1b-92d0-c5e5703098e7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:13.132167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779100f-c5c2-4f1b-92d0-c5e5703098e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:13.158825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b779100f-c5c2-4f1b-92d0-c5e5703098e7 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:13.160039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b779100f-c5c2-4f1b-92d0-c5e5703098e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:13.163308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:13.203745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0c7be-207f-4e35-a4f2-33b35be3c08a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:13.204114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0c7be-207f-4e35-a4f2-33b35be3c08a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:13.204284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0c7be-207f-4e35-a4f2-33b35be3c08a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:13.205677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 243/482] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:13.225363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf80a-97c4-4428-9068-2bd77a39ceec None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:13.225815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf80a-97c4-4428-9068-2bd77a39ceec None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:13.226453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf80a-97c4-4428-9068-2bd77a39ceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:13.245369 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 240/483] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:13.253976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bdecf80a-97c4-4428-9068-2bd77a39ceec None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:13.255318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bdecf80a-97c4-4428-9068-2bd77a39ceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:13.344376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 244/484] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:13.561454 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36817d1-cdea-4b3b-bfb7-432ae690dc17 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:13.562012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36817d1-cdea-4b3b-bfb7-432ae690dc17 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:13.562446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36817d1-cdea-4b3b-bfb7-432ae690dc17 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:13.563932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 241/485] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:13.569410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc19ad-af58-46af-acc9-74f8fec77290 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:13.569699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc19ad-af58-46af-acc9-74f8fec77290 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:13.569993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc19ad-af58-46af-acc9-74f8fec77290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:13.585339 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36817d1-cdea-4b3b-bfb7-432ae690dc17 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:13.610150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e7fc19ad-af58-46af-acc9-74f8fec77290 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:13.611357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e7fc19ad-af58-46af-acc9-74f8fec77290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:13.670244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:13.733962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 245/486] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:13.735225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc19ad-af58-46af-acc9-74f8fec77290 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:13.753747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36817d1-cdea-4b3b-bfb7-432ae690dc17 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:13.812110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be1792-1df1-4653-b701-a753ac1b0783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:13.812728 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be1792-1df1-4653-b701-a753ac1b0783 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:13.813009 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be1792-1df1-4653-b701-a753ac1b0783 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:13.813282 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be1792-1df1-4653-b701-a753ac1b0783 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:13.837083 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be1792-1df1-4653-b701-a753ac1b0783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:13.846211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b1be1792-1df1-4653-b701-a753ac1b0783 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:13.851900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:13.852916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:13.854138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 242/487] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:13.859707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be1792-1df1-4653-b701-a753ac1b0783 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:13.931643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc19ad-af58-46af-acc9-74f8fec77290 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:14.008861 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a244c3-8266-4230-bf31-ac0eaec85f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:14.009583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a244c3-8266-4230-bf31-ac0eaec85f7e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.009827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a244c3-8266-4230-bf31-ac0eaec85f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.010116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a244c3-8266-4230-bf31-ac0eaec85f7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.030819 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a244c3-8266-4230-bf31-ac0eaec85f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b4a244c3-8266-4230-bf31-ac0eaec85f7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:14.035972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:14.038089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 246/488] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:14.040348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a244c3-8266-4230-bf31-ac0eaec85f7e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:14.043884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be1792-1df1-4653-b701-a753ac1b0783 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:14.074188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:14.079080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b59f6b-05cb-4bc1-a3d1-eeafcb64f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:14.079772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59f6b-05cb-4bc1-a3d1-eeafcb64f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.080048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59f6b-05cb-4bc1-a3d1-eeafcb64f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.080313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59f6b-05cb-4bc1-a3d1-eeafcb64f2b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.081047 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b59f6b-05cb-4bc1-a3d1-eeafcb64f2b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:14.081396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b59f6b-05cb-4bc1-a3d1-eeafcb64f2b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:14.082870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b59f6b-05cb-4bc1-a3d1-eeafcb64f2b8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:14.093351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 243/489] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:14.094412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b59f6b-05cb-4bc1-a3d1-eeafcb64f2b8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:14.155208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a244c3-8266-4230-bf31-ac0eaec85f7e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:14.160105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:14.193658 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464ad45-159c-4bfc-a1e9-962dd3598e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:14.194328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464ad45-159c-4bfc-a1e9-962dd3598e7d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.194603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464ad45-159c-4bfc-a1e9-962dd3598e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.194874 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464ad45-159c-4bfc-a1e9-962dd3598e7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.202794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b59f6b-05cb-4bc1-a3d1-eeafcb64f2b8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:14.206215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464ad45-159c-4bfc-a1e9-962dd3598e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e464ad45-159c-4bfc-a1e9-962dd3598e7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:14.211535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:14.213744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:14.215991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:14.218051 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 247/490] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:14.219093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464ad45-159c-4bfc-a1e9-962dd3598e7d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:14.245159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb274ac-92e7-4965-bf08-71533e305b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:14.246303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb274ac-92e7-4965-bf08-71533e305b16 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.246852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb274ac-92e7-4965-bf08-71533e305b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.247347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb274ac-92e7-4965-bf08-71533e305b16 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.248192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb274ac-92e7-4965-bf08-71533e305b16 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:14.248678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb274ac-92e7-4965-bf08-71533e305b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:14.250471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb274ac-92e7-4965-bf08-71533e305b16 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:14.267579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 244/491] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:14.267579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a312da-dfaa-4b76-bea1-c7090740ab0d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.267579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a312da-dfaa-4b76-bea1-c7090740ab0d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.267579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a312da-dfaa-4b76-bea1-c7090740ab0d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.267579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 245/492] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:14.267579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a312da-dfaa-4b76-bea1-c7090740ab0d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:14.319716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:14.333878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464ad45-159c-4bfc-a1e9-962dd3598e7d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:14.367242 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61087009-0124-4403-ab78-b1de9d8789a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:14.367888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61087009-0124-4403-ab78-b1de9d8789a4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.368204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61087009-0124-4403-ab78-b1de9d8789a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.368504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61087009-0124-4403-ab78-b1de9d8789a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.373436 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a312da-dfaa-4b76-bea1-c7090740ab0d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:14.378685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61087009-0124-4403-ab78-b1de9d8789a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:14.380148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61087009-0124-4403-ab78-b1de9d8789a4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-61087009-0124-4403-ab78-b1de9d8789a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:14.394519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:14.395403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:14.396404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:14.396404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:14.396404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:14.396404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 248/493] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:14.396404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61087009-0124-4403-ab78-b1de9d8789a4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:14.398121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:14.409477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6b34-9724-44eb-a26e-5b73a90d852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:14.410111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6b34-9724-44eb-a26e-5b73a90d852b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.410383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6b34-9724-44eb-a26e-5b73a90d852b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.410647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6b34-9724-44eb-a26e-5b73a90d852b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.411339 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6b34-9724-44eb-a26e-5b73a90d852b None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:14.411634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6b34-9724-44eb-a26e-5b73a90d852b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:14.412970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6b34-9724-44eb-a26e-5b73a90d852b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:14.421288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 246/494] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:14.422458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2591-37e5-4b50-b450-5a71a1ee5285 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.422733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2591-37e5-4b50-b450-5a71a1ee5285 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.422997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2591-37e5-4b50-b450-5a71a1ee5285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.446204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-619c2591-37e5-4b50-b450-5a71a1ee5285 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:14.447928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-619c2591-37e5-4b50-b450-5a71a1ee5285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:14.500982 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61087009-0124-4403-ab78-b1de9d8789a4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:14.520628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 247/495] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:14.521911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7fa61-aa2a-4a7e-867c-719aae347662 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.522198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7fa61-aa2a-4a7e-867c-719aae347662 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.522469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7fa61-aa2a-4a7e-867c-719aae347662 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.523713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 248/496] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:14.528213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7fa61-aa2a-4a7e-867c-719aae347662 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:14.542163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b29a6-d1bf-4fd9-b496-3ff748a6be60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:14.542798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b29a6-d1bf-4fd9-b496-3ff748a6be60 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.543076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b29a6-d1bf-4fd9-b496-3ff748a6be60 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.543337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b29a6-d1bf-4fd9-b496-3ff748a6be60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.553335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:14.556602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b29a6-d1bf-4fd9-b496-3ff748a6be60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:14.558196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b29a6-d1bf-4fd9-b496-3ff748a6be60 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-465b29a6-d1bf-4fd9-b496-3ff748a6be60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:14.573434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:14.574368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:14.575237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:14.575237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:14.575237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:14.575237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 249/497] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:14.575460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b29a6-d1bf-4fd9-b496-3ff748a6be60 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:14.639834 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7fa61-aa2a-4a7e-867c-719aae347662 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:14.659631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:14.679596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b29a6-d1bf-4fd9-b496-3ff748a6be60 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:14.681081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfd4c7-9abe-4008-82b1-02650362617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:14.681771 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd4c7-9abe-4008-82b1-02650362617e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.682147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd4c7-9abe-4008-82b1-02650362617e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.682482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd4c7-9abe-4008-82b1-02650362617e None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.683232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfd4c7-9abe-4008-82b1-02650362617e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:14.683597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfd4c7-9abe-4008-82b1-02650362617e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:14.684978 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfd4c7-9abe-4008-82b1-02650362617e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:14.697636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 249/498] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:14.699306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95544-1150-4e2a-93eb-575c0700b3b7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.699806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95544-1150-4e2a-93eb-575c0700b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.700265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95544-1150-4e2a-93eb-575c0700b3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.720436 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b0b95544-1150-4e2a-93eb-575c0700b3b7 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:14.721817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b0b95544-1150-4e2a-93eb-575c0700b3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:14.725507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccec7-a86f-43e2-ab8d-f220bd5a6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:14.726214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccec7-a86f-43e2-ab8d-f220bd5a6d26 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.726490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccec7-a86f-43e2-ab8d-f220bd5a6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.726752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccec7-a86f-43e2-ab8d-f220bd5a6d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.737942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ccec7-a86f-43e2-ab8d-f220bd5a6d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:14.739421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ccec7-a86f-43e2-ab8d-f220bd5a6d26 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-124ccec7-a86f-43e2-ab8d-f220bd5a6d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:14.754574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:14.755535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:14.761444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:14.761444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:14.761444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:14.761444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 250/499] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:14.761444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccec7-a86f-43e2-ab8d-f220bd5a6d26 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:14.805696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 250/500] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:14.807010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b95544-1150-4e2a-93eb-575c0700b3b7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:14.814000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:14.876909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccec7-a86f-43e2-ab8d-f220bd5a6d26 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:14.909582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aab38-998a-4cea-9fdc-f5e1b64970d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:14.910128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aab38-998a-4cea-9fdc-f5e1b64970d0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.910404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aab38-998a-4cea-9fdc-f5e1b64970d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.910668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aab38-998a-4cea-9fdc-f5e1b64970d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.911307 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aab38-998a-4cea-9fdc-f5e1b64970d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:14.911603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aab38-998a-4cea-9fdc-f5e1b64970d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:14.912964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aab38-998a-4cea-9fdc-f5e1b64970d0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:14.923470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b95544-1150-4e2a-93eb-575c0700b3b7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:14.925176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 251/501] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:14.925871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aab38-998a-4cea-9fdc-f5e1b64970d0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:14.933075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:14.961172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bfe61-c231-475e-86ea-a97ff8807d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:14.962887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfe61-c231-475e-86ea-a97ff8807d51 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:14.963172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfe61-c231-475e-86ea-a97ff8807d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:14.963435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfe61-c231-475e-86ea-a97ff8807d51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:14.970605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bfe61-c231-475e-86ea-a97ff8807d51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:14.972064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bfe61-c231-475e-86ea-a97ff8807d51 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e06bfe61-c231-475e-86ea-a97ff8807d51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:14.985402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:14.986336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:14.987232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:14.987232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:14.987232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:14.987232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:14.987232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:14.987232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:14.987232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:14.987232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:14.987232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:14.987232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:14.987232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 251/502] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 22 21:57:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:14.987777 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bfe61-c231-475e-86ea-a97ff8807d51 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:15.039790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aab38-998a-4cea-9fdc-f5e1b64970d0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.043115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:15.076557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f31f4f-e6a6-4254-aab0-a592157b9ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:15.077153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f31f4f-e6a6-4254-aab0-a592157b9ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:15.077427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f31f4f-e6a6-4254-aab0-a592157b9ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:15.077697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f31f4f-e6a6-4254-aab0-a592157b9ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:15.078377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f31f4f-e6a6-4254-aab0-a592157b9ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:15.078771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f31f4f-e6a6-4254-aab0-a592157b9ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:15.080166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f31f4f-e6a6-4254-aab0-a592157b9ea6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:15.092652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 252/503] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:15.093628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f31f4f-e6a6-4254-aab0-a592157b9ea6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:15.106507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bfe61-c231-475e-86ea-a97ff8807d51 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.140642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20a8dc-4673-4f7c-8293-52c8c534f590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:15.141287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20a8dc-4673-4f7c-8293-52c8c534f590 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:15.141564 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20a8dc-4673-4f7c-8293-52c8c534f590 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:15.141864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20a8dc-4673-4f7c-8293-52c8c534f590 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:15.152524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20a8dc-4673-4f7c-8293-52c8c534f590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ee20a8dc-4673-4f7c-8293-52c8c534f590 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:15.158141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:15.159136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 252/504] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:15.159985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20a8dc-4673-4f7c-8293-52c8c534f590 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:15.191655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:15.197164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f31f4f-e6a6-4254-aab0-a592157b9ea6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.232076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7266b-2d62-4ea8-8111-b78dc8dc9d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:15.232694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7266b-2d62-4ea8-8111-b78dc8dc9d17 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:15.232963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7266b-2d62-4ea8-8111-b78dc8dc9d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:15.233226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7266b-2d62-4ea8-8111-b78dc8dc9d17 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:15.241381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7266b-2d62-4ea8-8111-b78dc8dc9d17 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:15.242874 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7266b-2d62-4ea8-8111-b78dc8dc9d17 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-cbf7266b-2d62-4ea8-8111-b78dc8dc9d17 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:15.255153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:15.256279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 253/505] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:15.257382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7266b-2d62-4ea8-8111-b78dc8dc9d17 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:15.269810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20a8dc-4673-4f7c-8293-52c8c534f590 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.282595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:15.307595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57846-8f00-4c8f-bb06-5a04693eca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:15.308215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57846-8f00-4c8f-bb06-5a04693eca50 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:15.308496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57846-8f00-4c8f-bb06-5a04693eca50 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:15.308745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57846-8f00-4c8f-bb06-5a04693eca50 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:15.309930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d57846-8f00-4c8f-bb06-5a04693eca50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:15.310395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d57846-8f00-4c8f-bb06-5a04693eca50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:15.311862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d57846-8f00-4c8f-bb06-5a04693eca50 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:15.350405 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 253/506] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 22 21:57:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:15.351350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57846-8f00-4c8f-bb06-5a04693eca50 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:15.359218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7266b-2d62-4ea8-8111-b78dc8dc9d17 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.392312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe85a7-3c18-4714-bca2-9954d7d0d7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:15.392950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe85a7-3c18-4714-bca2-9954d7d0d7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:15.393224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe85a7-3c18-4714-bca2-9954d7d0d7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:15.393493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe85a7-3c18-4714-bca2-9954d7d0d7a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:15.404352 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe85a7-3c18-4714-bca2-9954d7d0d7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:15.405805 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe85a7-3c18-4714-bca2-9954d7d0d7a1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-1ebe85a7-3c18-4714-bca2-9954d7d0d7a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:15.419842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:15.420704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:15.421526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:15.421526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:15.421526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:15.421526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 254/507] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:15.421732 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe85a7-3c18-4714-bca2-9954d7d0d7a1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:15.443563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:15.460556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57846-8f00-4c8f-bb06-5a04693eca50 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.494801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fed67-8fca-465f-801e-cd7bee9bdf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:15.495439 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fed67-8fca-465f-801e-cd7bee9bdf52 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:15.495715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fed67-8fca-465f-801e-cd7bee9bdf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:15.495982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fed67-8fca-465f-801e-cd7bee9bdf52 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:15.502133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:15.502949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259fed67-8fca-465f-801e-cd7bee9bdf52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:15.504408 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259fed67-8fca-465f-801e-cd7bee9bdf52 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-259fed67-8fca-465f-801e-cd7bee9bdf52 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:15.516309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:15.517365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 254/508] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:15.518617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fed67-8fca-465f-801e-cd7bee9bdf52 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:15.528695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe85a7-3c18-4714-bca2-9954d7d0d7a1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.561738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b665d9-86e0-4f48-ae1f-668869227c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:15.562361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b665d9-86e0-4f48-ae1f-668869227c51 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:15.562654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b665d9-86e0-4f48-ae1f-668869227c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:15.562922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b665d9-86e0-4f48-ae1f-668869227c51 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:15.563588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b665d9-86e0-4f48-ae1f-668869227c51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:15.563897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b665d9-86e0-4f48-ae1f-668869227c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:15.565261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b665d9-86e0-4f48-ae1f-668869227c51 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:15.573125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 255/509] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:15.573936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b665d9-86e0-4f48-ae1f-668869227c51 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:15.624225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fed67-8fca-465f-801e-cd7bee9bdf52 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.656953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dba3e-a43c-4933-9761-891235d0af8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:15.657551 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dba3e-a43c-4933-9761-891235d0af8b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:15.657824 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dba3e-a43c-4933-9761-891235d0af8b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:15.658114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dba3e-a43c-4933-9761-891235d0af8b None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:15.658833 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dba3e-a43c-4933-9761-891235d0af8b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:15.659130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dba3e-a43c-4933-9761-891235d0af8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:15.660595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dba3e-a43c-4933-9761-891235d0af8b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:15.673727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b665d9-86e0-4f48-ae1f-668869227c51 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.678313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 255/510] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 22 21:57:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:15.679111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dba3e-a43c-4933-9761-891235d0af8b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:15.681697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:15.711760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d54e2e-7304-400c-8eb2-ef9734ca645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:15.712468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d54e2e-7304-400c-8eb2-ef9734ca645a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:15.712744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d54e2e-7304-400c-8eb2-ef9734ca645a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:15.713010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d54e2e-7304-400c-8eb2-ef9734ca645a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:15.721751 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:15.780413 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dba3e-a43c-4933-9761-891235d0af8b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.780602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d54e2e-7304-400c-8eb2-ef9734ca645a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:15.781966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d54e2e-7304-400c-8eb2-ef9734ca645a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:15.813972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb2c9f-7c91-4586-ab47-65b9f7d1dbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:15.814578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb2c9f-7c91-4586-ab47-65b9f7d1dbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:15.814848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb2c9f-7c91-4586-ab47-65b9f7d1dbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:15.815107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb2c9f-7c91-4586-ab47-65b9f7d1dbc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:15.815738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb2c9f-7c91-4586-ab47-65b9f7d1dbc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:15.816033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb2c9f-7c91-4586-ab47-65b9f7d1dbc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:15.817409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb2c9f-7c91-4586-ab47-65b9f7d1dbc4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:15.828251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 256/511] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:15.829307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb2c9f-7c91-4586-ab47-65b9f7d1dbc4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:15.878697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 256/512] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:15.879619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d54e2e-7304-400c-8eb2-ef9734ca645a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:15.886400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:15.920290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:15.924293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb2c9f-7c91-4586-ab47-65b9f7d1dbc4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.957113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8a196-29f8-4546-9c5f-856fffcb0cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:15.957726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8a196-29f8-4546-9c5f-856fffcb0cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:15.958147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8a196-29f8-4546-9c5f-856fffcb0cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:15.958423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8a196-29f8-4546-9c5f-856fffcb0cf3 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:15.959161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8a196-29f8-4546-9c5f-856fffcb0cf3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:15.959464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8a196-29f8-4546-9c5f-856fffcb0cf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:15.961249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8a196-29f8-4546-9c5f-856fffcb0cf3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:15.979030 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 257/513] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 22 21:57:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:15.982083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d54e2e-7304-400c-8eb2-ef9734ca645a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:15.982726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8a196-29f8-4546-9c5f-856fffcb0cf3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:16.016428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640c7e6-e563-41b6-9382-63ca301a52fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:16.017044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c7e6-e563-41b6-9382-63ca301a52fa None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:16.017314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c7e6-e563-41b6-9382-63ca301a52fa None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:16.017575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c7e6-e563-41b6-9382-63ca301a52fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:16.027277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640c7e6-e563-41b6-9382-63ca301a52fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:16.028745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640c7e6-e563-41b6-9382-63ca301a52fa None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8640c7e6-e563-41b6-9382-63ca301a52fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:16.043065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:16.044184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:16.045031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:16.045031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:16.045031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:16.045031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 257/514] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:16.045244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640c7e6-e563-41b6-9382-63ca301a52fa None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:16.085157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8a196-29f8-4546-9c5f-856fffcb0cf3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:16.105419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:16.119172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe451c-9c21-4106-98f6-d01b8dc65791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:16.119780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe451c-9c21-4106-98f6-d01b8dc65791 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:16.120051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe451c-9c21-4106-98f6-d01b8dc65791 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:16.120315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe451c-9c21-4106-98f6-d01b8dc65791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:16.133892 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:16.144495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640c7e6-e563-41b6-9382-63ca301a52fa None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:16.182561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b84dc-ebf4-4b1f-8465-1341f488a4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:16.183097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b84dc-ebf4-4b1f-8465-1341f488a4e9 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:16.183377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b84dc-ebf4-4b1f-8465-1341f488a4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:16.183648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b84dc-ebf4-4b1f-8465-1341f488a4e9 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:16.184299 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b84dc-ebf4-4b1f-8465-1341f488a4e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:16.185757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b84dc-ebf4-4b1f-8465-1341f488a4e9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:16.186325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe451c-9c21-4106-98f6-d01b8dc65791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:16.187794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe451c-9c21-4106-98f6-d01b8dc65791 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:16.207588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 258/515] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:57:16 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:57:16.208528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b84dc-ebf4-4b1f-8465-1341f488a4e9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:16.295372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 258/516] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:16.296776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe451c-9c21-4106-98f6-d01b8dc65791 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:16.321664 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:16.336994 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b84dc-ebf4-4b1f-8465-1341f488a4e9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:16.373248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7f3da-4480-4a0a-82aa-140175d06f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:16.373921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7f3da-4480-4a0a-82aa-140175d06f5c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:16.374196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7f3da-4480-4a0a-82aa-140175d06f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:16.374461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7f3da-4480-4a0a-82aa-140175d06f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:16.386394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7f3da-4480-4a0a-82aa-140175d06f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:16.387868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7f3da-4480-4a0a-82aa-140175d06f5c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:16.395221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-09d7f3da-4480-4a0a-82aa-140175d06f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:16.405393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:16.406427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:16.407306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:16.407306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:16.407306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:16.410041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 259/517] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:16.411043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7f3da-4480-4a0a-82aa-140175d06f5c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:16.413532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe451c-9c21-4106-98f6-d01b8dc65791 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:16.458585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e07051-8178-48c1-9a3c-0d14b33fa9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:16.459118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e07051-8178-48c1-9a3c-0d14b33fa9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:16.459713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e07051-8178-48c1-9a3c-0d14b33fa9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:16.459991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e07051-8178-48c1-9a3c-0d14b33fa9e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:16.527276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7f3da-4480-4a0a-82aa-140175d06f5c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:16.530156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e07051-8178-48c1-9a3c-0d14b33fa9e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:16.531653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e07051-8178-48c1-9a3c-0d14b33fa9e3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:16.554180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:16.565347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0523dc6-5eb1-4f6f-93cd-e9bfb42949e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:16.565992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0523dc6-5eb1-4f6f-93cd-e9bfb42949e0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:16.566272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0523dc6-5eb1-4f6f-93cd-e9bfb42949e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:16.566545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0523dc6-5eb1-4f6f-93cd-e9bfb42949e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:16.567196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0523dc6-5eb1-4f6f-93cd-e9bfb42949e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:16.567496 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0523dc6-5eb1-4f6f-93cd-e9bfb42949e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:16.569170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0523dc6-5eb1-4f6f-93cd-e9bfb42949e0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:16.581987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 260/518] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:16.582663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0523dc6-5eb1-4f6f-93cd-e9bfb42949e0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:16.639583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 259/519] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:16.640430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e07051-8178-48c1-9a3c-0d14b33fa9e3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:16.647392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:16.693061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0523dc6-5eb1-4f6f-93cd-e9bfb42949e0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:16.736762 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7ea98-b795-4eec-bb29-adba912ded14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:16.737436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7ea98-b795-4eec-bb29-adba912ded14 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:16.737651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7ea98-b795-4eec-bb29-adba912ded14 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:16.737942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7ea98-b795-4eec-bb29-adba912ded14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:16.745513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e07051-8178-48c1-9a3c-0d14b33fa9e3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:16.747801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7ea98-b795-4eec-bb29-adba912ded14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:16.749264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7ea98-b795-4eec-bb29-adba912ded14 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2ba7ea98-b795-4eec-bb29-adba912ded14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:16.764952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:16.766064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:16.767055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:16.767055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:16.767055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:16.770821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 261/520] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:16.771669 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7ea98-b795-4eec-bb29-adba912ded14 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:16.771944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:16.789179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308862a-df24-4bc3-949a-2f9ade6472ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:16.790043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308862a-df24-4bc3-949a-2f9ade6472ea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:16.790321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308862a-df24-4bc3-949a-2f9ade6472ea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:16.790784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308862a-df24-4bc3-949a-2f9ade6472ea None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:16.791440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308862a-df24-4bc3-949a-2f9ade6472ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:16.791737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308862a-df24-4bc3-949a-2f9ade6472ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:16.793152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308862a-df24-4bc3-949a-2f9ade6472ea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:16.805672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 260/521] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:16.806750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308862a-df24-4bc3-949a-2f9ade6472ea None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:16.879518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7ea98-b795-4eec-bb29-adba912ded14 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:16.892027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:16.917576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0114245-e9ac-47e6-83b9-da3abe73c557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:16.918190 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308862a-df24-4bc3-949a-2f9ade6472ea None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:16.918301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114245-e9ac-47e6-83b9-da3abe73c557 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:16.918509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114245-e9ac-47e6-83b9-da3abe73c557 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:16.918779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114245-e9ac-47e6-83b9-da3abe73c557 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:16.926559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0114245-e9ac-47e6-83b9-da3abe73c557 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:16.928017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0114245-e9ac-47e6-83b9-da3abe73c557 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f0114245-e9ac-47e6-83b9-da3abe73c557 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:16.939306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:16.940207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:16.941069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:16.941069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:16.941069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:16.941069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:16.941069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:16.941069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:16.941069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:16.941069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:16.941069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 21:57:16.941069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:16.941069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 262/522] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:16.941616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0114245-e9ac-47e6-83b9-da3abe73c557 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:16.956794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61868311-4ad6-4c3c-9ec5-8c62b5602d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:16.957433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868311-4ad6-4c3c-9ec5-8c62b5602d70 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:16.957704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868311-4ad6-4c3c-9ec5-8c62b5602d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:16.957991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868311-4ad6-4c3c-9ec5-8c62b5602d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:16.970014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61868311-4ad6-4c3c-9ec5-8c62b5602d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:16.971407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61868311-4ad6-4c3c-9ec5-8c62b5602d70 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-61868311-4ad6-4c3c-9ec5-8c62b5602d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:16.985898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:16.986861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:16.987717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:16.987717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:16.987717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:16.991587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 261/523] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:16.992424 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61868311-4ad6-4c3c-9ec5-8c62b5602d70 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:17.025019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:17.053503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0114245-e9ac-47e6-83b9-da3abe73c557 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:17.089421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b9ef2-3c81-4802-a1d2-d629542ae4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:17.090068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b9ef2-3c81-4802-a1d2-d629542ae4ba None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:17.090330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b9ef2-3c81-4802-a1d2-d629542ae4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:17.090592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b9ef2-3c81-4802-a1d2-d629542ae4ba None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:17.091228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b9ef2-3c81-4802-a1d2-d629542ae4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:17.091524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b9ef2-3c81-4802-a1d2-d629542ae4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:17.092876 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b9ef2-3c81-4802-a1d2-d629542ae4ba None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:17.095576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61868311-4ad6-4c3c-9ec5-8c62b5602d70 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:17.104831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 263/524] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:17.105656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b9ef2-3c81-4802-a1d2-d629542ae4ba None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:17.138575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff1522-ace7-4f1d-b62b-96ab66ea38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:17.139218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff1522-ace7-4f1d-b62b-96ab66ea38b3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:17.139540 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff1522-ace7-4f1d-b62b-96ab66ea38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:17.139752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff1522-ace7-4f1d-b62b-96ab66ea38b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:17.140322 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:17.148966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff1522-ace7-4f1d-b62b-96ab66ea38b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:17.150550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff1522-ace7-4f1d-b62b-96ab66ea38b3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c4ff1522-ace7-4f1d-b62b-96ab66ea38b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:17.162523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:17.163397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:17.164250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:17.164250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:17.164250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:17.164250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:17.164250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:17.164250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:17.164250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:17.164250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:17.164250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 262/525] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:17.164705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff1522-ace7-4f1d-b62b-96ab66ea38b3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:17.220268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b9ef2-3c81-4802-a1d2-d629542ae4ba None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:17.256147 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261be52-81ef-4f1d-985d-0af7c03eddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:17.257028 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261be52-81ef-4f1d-985d-0af7c03eddee None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:17.257467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261be52-81ef-4f1d-985d-0af7c03eddee None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:17.258022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261be52-81ef-4f1d-985d-0af7c03eddee None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:17.258693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:17.260140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261be52-81ef-4f1d-985d-0af7c03eddee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:17.260614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261be52-81ef-4f1d-985d-0af7c03eddee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:17.262339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261be52-81ef-4f1d-985d-0af7c03eddee None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:17.268019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff1522-ace7-4f1d-b62b-96ab66ea38b3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:17.303698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3aca-ba58-44f2-a7af-9717b31a9172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:17.303698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3aca-ba58-44f2-a7af-9717b31a9172 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:17.303698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3aca-ba58-44f2-a7af-9717b31a9172 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:17.303698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3aca-ba58-44f2-a7af-9717b31a9172 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:17.304191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe3aca-ba58-44f2-a7af-9717b31a9172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:17.304191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe3aca-ba58-44f2-a7af-9717b31a9172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:17.304714 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 264/526] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Sep 22 21:57:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:17.305761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe3aca-ba58-44f2-a7af-9717b31a9172 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:17.306015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261be52-81ef-4f1d-985d-0af7c03eddee None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:17.319032 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 263/527] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:17.319855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3aca-ba58-44f2-a7af-9717b31a9172 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:17.400558 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:17.413668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261be52-81ef-4f1d-985d-0af7c03eddee None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:17.424815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3aca-ba58-44f2-a7af-9717b31a9172 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:17.450801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7435c-4604-4b0f-bcba-98c4650ad47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:17.451433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7435c-4604-4b0f-bcba-98c4650ad47c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:17.451721 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7435c-4604-4b0f-bcba-98c4650ad47c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:17.451968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7435c-4604-4b0f-bcba-98c4650ad47c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:17.458853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7435c-4604-4b0f-bcba-98c4650ad47c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:17.460200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca78fb-15ba-4617-8a77-1b0e2de400c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:17.460318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7435c-4604-4b0f-bcba-98c4650ad47c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:17.461146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca78fb-15ba-4617-8a77-1b0e2de400c5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:17.461420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca78fb-15ba-4617-8a77-1b0e2de400c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:17.461786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca78fb-15ba-4617-8a77-1b0e2de400c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:17.462644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca78fb-15ba-4617-8a77-1b0e2de400c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:17.462945 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca78fb-15ba-4617-8a77-1b0e2de400c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:17.464354 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca78fb-15ba-4617-8a77-1b0e2de400c5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-1bc7435c-4604-4b0f-bcba-98c4650ad47c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:17.472860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:17.473686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:17.474546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:17.474546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:17.474546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:17.474546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:17.474546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:17.474546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:17.474546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:17.474546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:17.474546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 265/528] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:17.475000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7435c-4604-4b0f-bcba-98c4650ad47c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:17.485634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 264/529] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:17.487229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca78fb-15ba-4617-8a77-1b0e2de400c5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:17.504001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:17.578466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7435c-4604-4b0f-bcba-98c4650ad47c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:17.602877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca78fb-15ba-4617-8a77-1b0e2de400c5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:17.616267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049abdee-88a1-4b62-b840-a6977d63fd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:17.616957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abdee-88a1-4b62-b840-a6977d63fd8f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:17.617300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abdee-88a1-4b62-b840-a6977d63fd8f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:17.617663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abdee-88a1-4b62-b840-a6977d63fd8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:17.636556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:17.638277 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169c78f-7b3a-457e-89e0-429e8c7f7289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:17.639013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c78f-7b3a-457e-89e0-429e8c7f7289 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:17.639353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c78f-7b3a-457e-89e0-429e8c7f7289 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:17.639689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c78f-7b3a-457e-89e0-429e8c7f7289 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:17.646967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c78f-7b3a-457e-89e0-429e8c7f7289 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:17.648494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c78f-7b3a-457e-89e0-429e8c7f7289 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4169c78f-7b3a-457e-89e0-429e8c7f7289 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:17.659871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:17.660901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:17.662147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:17.662147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:17.662147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:17.662147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:17.662147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:17.662147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:17.662147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:17.662147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:17.666147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 265/530] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:17.666821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169c78f-7b3a-457e-89e0-429e8c7f7289 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:17.689937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049abdee-88a1-4b62-b840-a6977d63fd8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:17.691513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049abdee-88a1-4b62-b840-a6977d63fd8f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:17.746930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:17.777664 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169c78f-7b3a-457e-89e0-429e8c7f7289 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:17.798827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 266/531] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:17.798827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049abdee-88a1-4b62-b840-a6977d63fd8f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:17.817101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af8b44-fcbb-475d-81a3-a1ccc5b26abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:17.817714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af8b44-fcbb-475d-81a3-a1ccc5b26abf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:17.818020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af8b44-fcbb-475d-81a3-a1ccc5b26abf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:17.818286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af8b44-fcbb-475d-81a3-a1ccc5b26abf None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:17.818980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af8b44-fcbb-475d-81a3-a1ccc5b26abf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:17.819269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af8b44-fcbb-475d-81a3-a1ccc5b26abf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:17.820708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af8b44-fcbb-475d-81a3-a1ccc5b26abf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:17.833465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 266/532] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:17.834110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af8b44-fcbb-475d-81a3-a1ccc5b26abf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:17.852366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:17.908899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049abdee-88a1-4b62-b840-a6977d63fd8f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:17.940929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af8b44-fcbb-475d-81a3-a1ccc5b26abf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:17.944605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba561c8c-2044-46cc-a9e2-55e12ae425c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:17.945370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba561c8c-2044-46cc-a9e2-55e12ae425c1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:17.945782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba561c8c-2044-46cc-a9e2-55e12ae425c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:17.946263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba561c8c-2044-46cc-a9e2-55e12ae425c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:17.947128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba561c8c-2044-46cc-a9e2-55e12ae425c1 None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=a044973e9e84495dbf8d14e19fc84716) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:17.947582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba561c8c-2044-46cc-a9e2-55e12ae425c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:17.949166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba561c8c-2044-46cc-a9e2-55e12ae425c1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:17.955369 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 267/533] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:17 2022] GET /identity/v3/role_assignments?user.id=a044973e9e84495dbf8d14e19fc84716&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:17.956411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba561c8c-2044-46cc-a9e2-55e12ae425c1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:17.982768 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:17.991057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a71cb4-6441-4b8b-b894-ccbc7c54149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:17.992214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a71cb4-6441-4b8b-b894-ccbc7c54149d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:17.992599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a71cb4-6441-4b8b-b894-ccbc7c54149d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:17.993032 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a71cb4-6441-4b8b-b894-ccbc7c54149d None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:17.994238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a71cb4-6441-4b8b-b894-ccbc7c54149d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:17.994647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a71cb4-6441-4b8b-b894-ccbc7c54149d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:17.996561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a71cb4-6441-4b8b-b894-ccbc7c54149d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:18.018109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 267/534] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:18.018109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a71cb4-6441-4b8b-b894-ccbc7c54149d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:18.080432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba561c8c-2044-46cc-a9e2-55e12ae425c1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:18.095509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:18.120723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88470969-0468-47b9-9719-7adf7ec29347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:18.121750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88470969-0468-47b9-9719-7adf7ec29347 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:18.122254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88470969-0468-47b9-9719-7adf7ec29347 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:18.122739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88470969-0468-47b9-9719-7adf7ec29347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:18.134831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88470969-0468-47b9-9719-7adf7ec29347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:18.136665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88470969-0468-47b9-9719-7adf7ec29347 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-88470969-0468-47b9-9719-7adf7ec29347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:18.152079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:18.153016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:18.154255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:18.154255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:18.154255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:18.154448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a71cb4-6441-4b8b-b894-ccbc7c54149d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:18.155812 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 268/535] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:18.156864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88470969-0468-47b9-9719-7adf7ec29347 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:18.197141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ae9f3-917c-4258-b15c-4e08185e8aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:18.197974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ae9f3-917c-4258-b15c-4e08185e8aeb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:18.198322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ae9f3-917c-4258-b15c-4e08185e8aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:18.198665 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ae9f3-917c-4258-b15c-4e08185e8aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:18.199524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ae9f3-917c-4258-b15c-4e08185e8aeb None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=2c639dece626449b9153943b388e52c3) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:18.200000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ae9f3-917c-4258-b15c-4e08185e8aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:18.201637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ae9f3-917c-4258-b15c-4e08185e8aeb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:18.214275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 268/536] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:18 2022] GET /identity/v3/role_assignments?user.id=2c639dece626449b9153943b388e52c3&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:18.215470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ae9f3-917c-4258-b15c-4e08185e8aeb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:18.280895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88470969-0468-47b9-9719-7adf7ec29347 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:18.323273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3d38a-0520-4fb1-9cba-440f466b243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:18.324664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3d38a-0520-4fb1-9cba-440f466b243c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:18.325152 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3d38a-0520-4fb1-9cba-440f466b243c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:18.325597 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3d38a-0520-4fb1-9cba-440f466b243c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:18.327448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3d38a-0520-4fb1-9cba-440f466b243c None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=d22e60fc95af4a0a94b15f9ed9e3e73f) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:18.328043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3d38a-0520-4fb1-9cba-440f466b243c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:18.329789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3d38a-0520-4fb1-9cba-440f466b243c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:18.346507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 269/537] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:18 2022] GET /identity/v3/role_assignments?user.id=d22e60fc95af4a0a94b15f9ed9e3e73f&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:18.348739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:18.437980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ae9f3-917c-4258-b15c-4e08185e8aeb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:18.474903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adbb2b-db82-4745-aa5a-d0cffd0abea0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:18.475542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adbb2b-db82-4745-aa5a-d0cffd0abea0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:18.476103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adbb2b-db82-4745-aa5a-d0cffd0abea0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:18.478023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 270/538] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:18.488971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa16d4c-dfab-477c-b04f-99034c53bae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:18.489610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa16d4c-dfab-477c-b04f-99034c53bae6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:18.489917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa16d4c-dfab-477c-b04f-99034c53bae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:18.490189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa16d4c-dfab-477c-b04f-99034c53bae6 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:18.490857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa16d4c-dfab-477c-b04f-99034c53bae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:18.491155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa16d4c-dfab-477c-b04f-99034c53bae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:18.492566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa16d4c-dfab-477c-b04f-99034c53bae6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:18.496252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362545a-5ae5-4819-b8d4-6639099e8616 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:18.496814 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362545a-5ae5-4819-b8d4-6639099e8616 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:18.497273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362545a-5ae5-4819-b8d4-6639099e8616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:18.509446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 269/539] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:18.521214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa16d4c-dfab-477c-b04f-99034c53bae6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:18.527599 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5362545a-5ae5-4819-b8d4-6639099e8616 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:18.529035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5362545a-5ae5-4819-b8d4-6639099e8616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:18.563274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:18.625647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 271/540] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:57:18.652379 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa16d4c-dfab-477c-b04f-99034c53bae6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:18.670440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:18.693577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3570b-2d9d-4b81-87ff-de551ff30c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:18.694349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3570b-2d9d-4b81-87ff-de551ff30c80 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:18.694631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3570b-2d9d-4b81-87ff-de551ff30c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:18.694908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3570b-2d9d-4b81-87ff-de551ff30c80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:18.704913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3570b-2d9d-4b81-87ff-de551ff30c80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:18.706419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3570b-2d9d-4b81-87ff-de551ff30c80 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-85c3570b-2d9d-4b81-87ff-de551ff30c80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:18.726387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:18.727432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:18.728468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:18.728468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:18.728468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:18.728468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:18.728468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:18.728468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:18.728468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:18.728468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:18.728468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 270/541] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:18.733618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362545a-5ae5-4819-b8d4-6639099e8616 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:18.842198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362545a-5ae5-4819-b8d4-6639099e8616 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:18.877160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529805b0-ee88-48de-8c56-53448668db60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:18.877774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529805b0-ee88-48de-8c56-53448668db60 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:18.878079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529805b0-ee88-48de-8c56-53448668db60 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:18.878348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529805b0-ee88-48de-8c56-53448668db60 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:18.879042 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529805b0-ee88-48de-8c56-53448668db60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:18.879342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529805b0-ee88-48de-8c56-53448668db60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:18.880783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529805b0-ee88-48de-8c56-53448668db60 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:18.899512 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 272/542] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:18.905631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3570b-2d9d-4b81-87ff-de551ff30c80 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:19.028353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3570b-2d9d-4b81-87ff-de551ff30c80 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:19.062382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30614003-dba6-466a-b55d-1780f8b4d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:19.062994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614003-dba6-466a-b55d-1780f8b4d01f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:19.063269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614003-dba6-466a-b55d-1780f8b4d01f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:19.063540 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614003-dba6-466a-b55d-1780f8b4d01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:19.064279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30614003-dba6-466a-b55d-1780f8b4d01f None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=d512b60a42ed456a82dff11d17b77c06) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:19.064586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30614003-dba6-466a-b55d-1780f8b4d01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:19.066108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30614003-dba6-466a-b55d-1780f8b4d01f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:19.072157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 271/543] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:18 2022] GET /identity/v3/role_assignments?user.id=d512b60a42ed456a82dff11d17b77c06&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:19.144656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529805b0-ee88-48de-8c56-53448668db60 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:19.175390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:19.296155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529805b0-ee88-48de-8c56-53448668db60 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:19.334729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01424675-8e89-419c-8c63-1bc96b021b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:19.335098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01424675-8e89-419c-8c63-1bc96b021b75 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:19.335257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01424675-8e89-419c-8c63-1bc96b021b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:19.336184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01424675-8e89-419c-8c63-1bc96b021b75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:19.346859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01424675-8e89-419c-8c63-1bc96b021b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-01424675-8e89-419c-8c63-1bc96b021b75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:19.351720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:19.353827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:19.355893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 273/544] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:19.359103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30614003-dba6-466a-b55d-1780f8b4d01f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:19.436311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:19.507355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30614003-dba6-466a-b55d-1780f8b4d01f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:19.556013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1ad5c-18ca-4666-b649-d0d48765515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:19.556639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ad5c-18ca-4666-b649-d0d48765515a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:19.556917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ad5c-18ca-4666-b649-d0d48765515a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:19.557194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ad5c-18ca-4666-b649-d0d48765515a None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:19.557970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1ad5c-18ca-4666-b649-d0d48765515a None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:19.558255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1ad5c-18ca-4666-b649-d0d48765515a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:19.559694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1ad5c-18ca-4666-b649-d0d48765515a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:19.573254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 272/545] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:19.578963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01424675-8e89-419c-8c63-1bc96b021b75 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:19.707451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:19.739526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01424675-8e89-419c-8c63-1bc96b021b75 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:19.794549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3785ba-c92a-4877-be2a-172a468e9df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:19.795196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3785ba-c92a-4877-be2a-172a468e9df3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:19.795472 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3785ba-c92a-4877-be2a-172a468e9df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:19.795736 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3785ba-c92a-4877-be2a-172a468e9df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:19.806346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3785ba-c92a-4877-be2a-172a468e9df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:19.808381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3785ba-c92a-4877-be2a-172a468e9df3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-1a3785ba-c92a-4877-be2a-172a468e9df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:19.830282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:19.831236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:19.832529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:19.832529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:19.832529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:19.832529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 274/546] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:19.838405 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1ad5c-18ca-4666-b649-d0d48765515a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:20.014659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1ad5c-18ca-4666-b649-d0d48765515a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:20.016205 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:20.061535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390c77e-6062-4e76-99b1-094ba8b0668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:20.062179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390c77e-6062-4e76-99b1-094ba8b0668f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:20.062455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390c77e-6062-4e76-99b1-094ba8b0668f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:20.062727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390c77e-6062-4e76-99b1-094ba8b0668f None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:20.063380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390c77e-6062-4e76-99b1-094ba8b0668f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:20.063684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390c77e-6062-4e76-99b1-094ba8b0668f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:20.065058 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390c77e-6062-4e76-99b1-094ba8b0668f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:20.078132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 273/547] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:20.083331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3785ba-c92a-4877-be2a-172a468e9df3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:20.235214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3785ba-c92a-4877-be2a-172a468e9df3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:20.276176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:20.281881 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0db892-7525-4c72-97ab-c8329bf77877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:20.282515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db892-7525-4c72-97ab-c8329bf77877 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:20.282786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db892-7525-4c72-97ab-c8329bf77877 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:20.283054 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db892-7525-4c72-97ab-c8329bf77877 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:20.294917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0db892-7525-4c72-97ab-c8329bf77877 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:20.296383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0db892-7525-4c72-97ab-c8329bf77877 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-5b0db892-7525-4c72-97ab-c8329bf77877 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:20.311116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:20.312661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:20.313955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:20.313955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:20.313955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:20.313955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:20.313955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:20.313955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:20.313955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:20.313955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:20.313955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:20.313955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:20.313955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 275/548] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:20.318921 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390c77e-6062-4e76-99b1-094ba8b0668f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:20.453175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390c77e-6062-4e76-99b1-094ba8b0668f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:20.470175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d71d50-8e66-4172-a9d9-0e8c02c735e1 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:20.470492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d71d50-8e66-4172-a9d9-0e8c02c735e1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:20.470704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d71d50-8e66-4172-a9d9-0e8c02c735e1 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:20.472242 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 276/549] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:20.477268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a23d7-b3ab-4e3a-866e-a95fdfec3732 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:20.477554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a23d7-b3ab-4e3a-866e-a95fdfec3732 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:20.477820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a23d7-b3ab-4e3a-866e-a95fdfec3732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:20.495475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edbec9-e983-4931-93ab-2842b09f1375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:20.496098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edbec9-e983-4931-93ab-2842b09f1375 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:20.496376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edbec9-e983-4931-93ab-2842b09f1375 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:20.496645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edbec9-e983-4931-93ab-2842b09f1375 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:20.497448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edbec9-e983-4931-93ab-2842b09f1375 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:20.497751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edbec9-e983-4931-93ab-2842b09f1375 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:20.500338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edbec9-e983-4931-93ab-2842b09f1375 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:20.515330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-be3a23d7-b3ab-4e3a-866e-a95fdfec3732 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:20.516537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-be3a23d7-b3ab-4e3a-866e-a95fdfec3732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:20.539630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 274/550] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 22 21:57:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:20.542924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edbec9-e983-4931-93ab-2842b09f1375 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:20.568644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:20.658098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edbec9-e983-4931-93ab-2842b09f1375 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:20.663571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 277/551] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:57:20.695767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21cf00-b167-4edf-adf9-ed9ab841a321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:20.696494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21cf00-b167-4edf-adf9-ed9ab841a321 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:20.696853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21cf00-b167-4edf-adf9-ed9ab841a321 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:20.697127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21cf00-b167-4edf-adf9-ed9ab841a321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:20.767194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21cf00-b167-4edf-adf9-ed9ab841a321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:20.768661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21cf00-b167-4edf-adf9-ed9ab841a321 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:20.790095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:20.875471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 275/552] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:20.880680 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a23d7-b3ab-4e3a-866e-a95fdfec3732 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:20.954562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872ce5-20df-4f01-a936-6e1e0172057b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:20.954898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872ce5-20df-4f01-a936-6e1e0172057b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:20.955088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872ce5-20df-4f01-a936-6e1e0172057b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:20.956584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 276/553] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:20.965574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558655f-415d-4ef2-8307-6f7bdc41ac86 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:20.965864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558655f-415d-4ef2-8307-6f7bdc41ac86 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:20.966139 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558655f-415d-4ef2-8307-6f7bdc41ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:20.998935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1558655f-415d-4ef2-8307-6f7bdc41ac86 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:21.000125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1558655f-415d-4ef2-8307-6f7bdc41ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:21.068620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a23d7-b3ab-4e3a-866e-a95fdfec3732 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:21.097614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:21.107022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 277/554] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 22 21:57:21.108287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558655f-415d-4ef2-8307-6f7bdc41ac86 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:21.113536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdeccb-f8f7-4beb-9086-6389e30e820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:21.114207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdeccb-f8f7-4beb-9086-6389e30e820f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:21.114480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdeccb-f8f7-4beb-9086-6389e30e820f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:21.114742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdeccb-f8f7-4beb-9086-6389e30e820f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:21.128013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdeccb-f8f7-4beb-9086-6389e30e820f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:21.129887 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdeccb-f8f7-4beb-9086-6389e30e820f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-75cdeccb-f8f7-4beb-9086-6389e30e820f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:21.150010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:21.151194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:21.152445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:21.152445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:21.152445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:21.152445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 278/555] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:21.156526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdeccb-f8f7-4beb-9086-6389e30e820f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:21.178597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:21.261799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558655f-415d-4ef2-8307-6f7bdc41ac86 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:21.297231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811eeac-eacd-4014-acb3-05c8bfaf63b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:21.297907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811eeac-eacd-4014-acb3-05c8bfaf63b1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:21.298188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811eeac-eacd-4014-acb3-05c8bfaf63b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:21.298458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811eeac-eacd-4014-acb3-05c8bfaf63b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:21.309751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811eeac-eacd-4014-acb3-05c8bfaf63b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7811eeac-eacd-4014-acb3-05c8bfaf63b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:21.314652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:21.315636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:21.316427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 278/556] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:21.330723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811eeac-eacd-4014-acb3-05c8bfaf63b1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:21.333225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdeccb-f8f7-4beb-9086-6389e30e820f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:21.379562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030d51f-3cb5-4b79-8e99-d205c099c289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:21.382525 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d51f-3cb5-4b79-8e99-d205c099c289 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:21.382807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d51f-3cb5-4b79-8e99-d205c099c289 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:21.383072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d51f-3cb5-4b79-8e99-d205c099c289 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:21.383940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030d51f-3cb5-4b79-8e99-d205c099c289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:21.384250 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030d51f-3cb5-4b79-8e99-d205c099c289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:21.385790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030d51f-3cb5-4b79-8e99-d205c099c289 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:21.408970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 279/557] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:21.414862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030d51f-3cb5-4b79-8e99-d205c099c289 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:21.457352 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:21.509428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811eeac-eacd-4014-acb3-05c8bfaf63b1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:21.520524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:21.544523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef61d6-bd9c-4a4a-9ffb-4b8c44706619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:21.545156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef61d6-bd9c-4a4a-9ffb-4b8c44706619 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:21.545427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef61d6-bd9c-4a4a-9ffb-4b8c44706619 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:21.545616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030d51f-3cb5-4b79-8e99-d205c099c289 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:21.545720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef61d6-bd9c-4a4a-9ffb-4b8c44706619 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:21.546386 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef61d6-bd9c-4a4a-9ffb-4b8c44706619 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:21.546685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef61d6-bd9c-4a4a-9ffb-4b8c44706619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:21.548096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef61d6-bd9c-4a4a-9ffb-4b8c44706619 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:21.558516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 279/558] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:21.560756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef61d6-bd9c-4a4a-9ffb-4b8c44706619 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:21.586806 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905772d7-aa84-403a-806a-043bdf4e9e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:21.587350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905772d7-aa84-403a-806a-043bdf4e9e2b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:21.587628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905772d7-aa84-403a-806a-043bdf4e9e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:21.587889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905772d7-aa84-403a-806a-043bdf4e9e2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:21.594915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905772d7-aa84-403a-806a-043bdf4e9e2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:21.596369 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905772d7-aa84-403a-806a-043bdf4e9e2b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-905772d7-aa84-403a-806a-043bdf4e9e2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:21.607386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:21.608288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:21.609143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:21.609143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:21.609143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:21.609143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:21.609143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:21.609143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:21.609143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:21.609143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:21.609143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 280/559] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:21.609611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22233597-845c-4c5b-863d-54d3cedd3355 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:21.610594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22233597-845c-4c5b-863d-54d3cedd3355 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:21.610594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22233597-845c-4c5b-863d-54d3cedd3355 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:21.613952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 281/560] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:21.613952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22233597-845c-4c5b-863d-54d3cedd3355 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:21.682127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef61d6-bd9c-4a4a-9ffb-4b8c44706619 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:21.718369 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bcb32-6093-4f3a-9b86-14cfbcd820bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:21.719013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bcb32-6093-4f3a-9b86-14cfbcd820bc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:21.719288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bcb32-6093-4f3a-9b86-14cfbcd820bc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:21.719557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bcb32-6093-4f3a-9b86-14cfbcd820bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:21.720188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:21.729781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bcb32-6093-4f3a-9b86-14cfbcd820bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:21.730153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22233597-845c-4c5b-863d-54d3cedd3355 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-882bcb32-6093-4f3a-9b86-14cfbcd820bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:21.735072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:21.736173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:21.737037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 280/561] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:21.737723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bcb32-6093-4f3a-9b86-14cfbcd820bc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:21.767311 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f72bf4-e33e-4b5e-bd8b-178e7d8aaf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:21.767953 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f72bf4-e33e-4b5e-bd8b-178e7d8aaf07 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:21.768235 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f72bf4-e33e-4b5e-bd8b-178e7d8aaf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:21.768498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f72bf4-e33e-4b5e-bd8b-178e7d8aaf07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:21.769299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:21.779023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f72bf4-e33e-4b5e-bd8b-178e7d8aaf07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:21.780510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f72bf4-e33e-4b5e-bd8b-178e7d8aaf07 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-77f72bf4-e33e-4b5e-bd8b-178e7d8aaf07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:21.795126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:21.796133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:21.797020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:21.797020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:21.797020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:21.797020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 282/562] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:21.797506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435152e-a09c-49f3-8227-7e08411caa8e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:21.797673 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435152e-a09c-49f3-8227-7e08411caa8e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:21.797981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435152e-a09c-49f3-8227-7e08411caa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:21.816225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f435152e-a09c-49f3-8227-7e08411caa8e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:21.817426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f435152e-a09c-49f3-8227-7e08411caa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:21.846389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bcb32-6093-4f3a-9b86-14cfbcd820bc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:21.880124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d9f56-18f2-457d-add4-ccdedf99d3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:21.880733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d9f56-18f2-457d-add4-ccdedf99d3dc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:21.881004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d9f56-18f2-457d-add4-ccdedf99d3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:21.881267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d9f56-18f2-457d-add4-ccdedf99d3dc None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:21.881966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d9f56-18f2-457d-add4-ccdedf99d3dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:21.882267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d9f56-18f2-457d-add4-ccdedf99d3dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:21.883933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d9f56-18f2-457d-add4-ccdedf99d3dc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:21.884094 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 283/563] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:21.885289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0ea67-7d9b-481e-b02b-b2e715d3846e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:21.885574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0ea67-7d9b-481e-b02b-b2e715d3846e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:21.885860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0ea67-7d9b-481e-b02b-b2e715d3846e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:21.887259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 284/564] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:21.890611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0ea67-7d9b-481e-b02b-b2e715d3846e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:21.900871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 281/565] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:21.900871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d9f56-18f2-457d-add4-ccdedf99d3dc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:21.986220 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:21.994659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:22.004574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d9f56-18f2-457d-add4-ccdedf99d3dc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:22.014205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0ea67-7d9b-481e-b02b-b2e715d3846e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:22.043353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f14e1d-e6fa-4b17-99c8-4d4db55a4543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:22.044127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14e1d-e6fa-4b17-99c8-4d4db55a4543 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.044492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14e1d-e6fa-4b17-99c8-4d4db55a4543 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.044866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14e1d-e6fa-4b17-99c8-4d4db55a4543 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.045566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f14e1d-e6fa-4b17-99c8-4d4db55a4543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:22.045975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f14e1d-e6fa-4b17-99c8-4d4db55a4543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:22.047437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f14e1d-e6fa-4b17-99c8-4d4db55a4543 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:22.053600 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bb3f5-71ae-4227-ba1c-6a705427fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:22.054633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bb3f5-71ae-4227-ba1c-6a705427fedf None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.054913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bb3f5-71ae-4227-ba1c-6a705427fedf None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.055185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bb3f5-71ae-4227-ba1c-6a705427fedf None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.055915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bb3f5-71ae-4227-ba1c-6a705427fedf None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:22.056222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bb3f5-71ae-4227-ba1c-6a705427fedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:22.057733 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bb3f5-71ae-4227-ba1c-6a705427fedf None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:22.060429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 282/566] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:22.061787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85b718-429d-4ee3-a9e5-67bd91284540 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.062142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85b718-429d-4ee3-a9e5-67bd91284540 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.062415 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85b718-429d-4ee3-a9e5-67bd91284540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.077178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 285/567] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:22.077178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bb3f5-71ae-4227-ba1c-6a705427fedf None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:22.083624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ad85b718-429d-4ee3-a9e5-67bd91284540 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:22.084925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ad85b718-429d-4ee3-a9e5-67bd91284540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:22.162008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 283/568] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:22.162781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85b718-429d-4ee3-a9e5-67bd91284540 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:22.188203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bb3f5-71ae-4227-ba1c-6a705427fedf None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:22.224467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd4556-2ae2-4cfe-acf7-0036dc90bc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:22.225438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd4556-2ae2-4cfe-acf7-0036dc90bc8a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.225933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd4556-2ae2-4cfe-acf7-0036dc90bc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.226394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd4556-2ae2-4cfe-acf7-0036dc90bc8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.227411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd4556-2ae2-4cfe-acf7-0036dc90bc8a None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=f9967ef46a464ff2b5f7e4c459f8abd9) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:22.227888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd4556-2ae2-4cfe-acf7-0036dc90bc8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:22.229510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd4556-2ae2-4cfe-acf7-0036dc90bc8a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:22.232411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:22.235430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 286/569] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:22 2022] GET /identity/v3/role_assignments?user.id=f9967ef46a464ff2b5f7e4c459f8abd9&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:22.236366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd4556-2ae2-4cfe-acf7-0036dc90bc8a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:22.269350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:22.294526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85b718-429d-4ee3-a9e5-67bd91284540 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:22.346137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f113d5d-794b-40f3-bf81-5a44ca7c9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:22.346813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f113d5d-794b-40f3-bf81-5a44ca7c9da2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.349254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f113d5d-794b-40f3-bf81-5a44ca7c9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.349380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f113d5d-794b-40f3-bf81-5a44ca7c9da2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.357961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f113d5d-794b-40f3-bf81-5a44ca7c9da2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:22.359469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f113d5d-794b-40f3-bf81-5a44ca7c9da2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7f113d5d-794b-40f3-bf81-5a44ca7c9da2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:22.372729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:22.373786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:22.374744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:22.374744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:22.374744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:22.374744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:22.374744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:22.374744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:22.374744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:22.374744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:22.374744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:22.374744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:22.378942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 284/570] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 22 21:57:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:22.379823 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f113d5d-794b-40f3-bf81-5a44ca7c9da2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:22.381645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd4556-2ae2-4cfe-acf7-0036dc90bc8a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:22.422339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f119039-0b52-4a6b-9052-300c9cdebd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:22.423363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f119039-0b52-4a6b-9052-300c9cdebd58 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.423906 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f119039-0b52-4a6b-9052-300c9cdebd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.424370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f119039-0b52-4a6b-9052-300c9cdebd58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.435980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f119039-0b52-4a6b-9052-300c9cdebd58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:22.437695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f119039-0b52-4a6b-9052-300c9cdebd58 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9f119039-0b52-4a6b-9052-300c9cdebd58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:22.451903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:22.453027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:22.453929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:22.453929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:22.453929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:22.453929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 287/571] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:22.454251 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f119039-0b52-4a6b-9052-300c9cdebd58 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:22.500788 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f113d5d-794b-40f3-bf81-5a44ca7c9da2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:22.506483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:22.539828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa4b64-24d7-4a26-b4e5-9fc6a2ad7e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:22.540682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa4b64-24d7-4a26-b4e5-9fc6a2ad7e6e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.541018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa4b64-24d7-4a26-b4e5-9fc6a2ad7e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.541364 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa4b64-24d7-4a26-b4e5-9fc6a2ad7e6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.552728 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa4b64-24d7-4a26-b4e5-9fc6a2ad7e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:22.555812 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f119039-0b52-4a6b-9052-300c9cdebd58 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-56aa4b64-24d7-4a26-b4e5-9fc6a2ad7e6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:22.559162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:22.560115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 285/572] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:22.560962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa4b64-24d7-4a26-b4e5-9fc6a2ad7e6e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:22.563198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:22.599794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e501943-43a9-4184-af48-0077bdce9143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:22.600402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e501943-43a9-4184-af48-0077bdce9143 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.600671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e501943-43a9-4184-af48-0077bdce9143 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.600935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e501943-43a9-4184-af48-0077bdce9143 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.601657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e501943-43a9-4184-af48-0077bdce9143 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:22.601982 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e501943-43a9-4184-af48-0077bdce9143 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:22.603564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e501943-43a9-4184-af48-0077bdce9143 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:22.621482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 288/573] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 22 21:57:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:22.622322 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e501943-43a9-4184-af48-0077bdce9143 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:22.680540 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa4b64-24d7-4a26-b4e5-9fc6a2ad7e6e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:22.725992 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08f34-1c4e-449a-8671-6e601c9734cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:22.726168 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e501943-43a9-4184-af48-0077bdce9143 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:22.726630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08f34-1c4e-449a-8671-6e601c9734cc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.726899 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08f34-1c4e-449a-8671-6e601c9734cc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.727194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08f34-1c4e-449a-8671-6e601c9734cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.737780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed08f34-1c4e-449a-8671-6e601c9734cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:22.738181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3ed08f34-1c4e-449a-8671-6e601c9734cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:22.743223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:22.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:22.745025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 286/574] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:22.745716 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08f34-1c4e-449a-8671-6e601c9734cc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:22.768804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ac817-fb63-4733-b1b3-1e0cb3501736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:22.769418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ac817-fb63-4733-b1b3-1e0cb3501736 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.769688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ac817-fb63-4733-b1b3-1e0cb3501736 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.769987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ac817-fb63-4733-b1b3-1e0cb3501736 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.770627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ac817-fb63-4733-b1b3-1e0cb3501736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:22.770935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ac817-fb63-4733-b1b3-1e0cb3501736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:22.772291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ac817-fb63-4733-b1b3-1e0cb3501736 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:22.783933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 289/575] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:22.784729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ac817-fb63-4733-b1b3-1e0cb3501736 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:22.818995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:22.858935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08f34-1c4e-449a-8671-6e601c9734cc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:22.892267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97716fe0-a69f-40a3-8bab-d8dcade76738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:22.892875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97716fe0-a69f-40a3-8bab-d8dcade76738 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.893003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ac817-fb63-4733-b1b3-1e0cb3501736 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:22.893212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97716fe0-a69f-40a3-8bab-d8dcade76738 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.893388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97716fe0-a69f-40a3-8bab-d8dcade76738 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.894093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97716fe0-a69f-40a3-8bab-d8dcade76738 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:22.894401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97716fe0-a69f-40a3-8bab-d8dcade76738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:22.896047 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97716fe0-a69f-40a3-8bab-d8dcade76738 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:22.904641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 287/576] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:22.906704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97716fe0-a69f-40a3-8bab-d8dcade76738 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:22.932836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b215c-3b3c-42c5-807c-3641f4e22773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:22.933389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b215c-3b3c-42c5-807c-3641f4e22773 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:22.933677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b215c-3b3c-42c5-807c-3641f4e22773 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:22.934375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b215c-3b3c-42c5-807c-3641f4e22773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:22.945103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b215c-3b3c-42c5-807c-3641f4e22773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:22.946748 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b215c-3b3c-42c5-807c-3641f4e22773 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-832b215c-3b3c-42c5-807c-3641f4e22773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:22.961520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:22.962681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:22.963574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:22.963574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:22.963574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:22.963574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 290/577] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:22.964094 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b215c-3b3c-42c5-807c-3641f4e22773 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:22.996771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:23.017634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97716fe0-a69f-40a3-8bab-d8dcade76738 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.043351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:23.054723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63fb9c-7cb5-4553-a4d5-54b561a0a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.055401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63fb9c-7cb5-4553-a4d5-54b561a0a12e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.055673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63fb9c-7cb5-4553-a4d5-54b561a0a12e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.055940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63fb9c-7cb5-4553-a4d5-54b561a0a12e None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.056604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63fb9c-7cb5-4553-a4d5-54b561a0a12e None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:23.056900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63fb9c-7cb5-4553-a4d5-54b561a0a12e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.058315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63fb9c-7cb5-4553-a4d5-54b561a0a12e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:23.066057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 288/578] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:23.066842 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63fb9c-7cb5-4553-a4d5-54b561a0a12e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:23.084823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b215c-3b3c-42c5-807c-3641f4e22773 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.122035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8b754-42de-45f2-8240-6a3d6d02efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.122828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b754-42de-45f2-8240-6a3d6d02efca None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.123102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b754-42de-45f2-8240-6a3d6d02efca None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.123367 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b754-42de-45f2-8240-6a3d6d02efca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.132443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8b754-42de-45f2-8240-6a3d6d02efca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.133996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8b754-42de-45f2-8240-6a3d6d02efca None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-73d8b754-42de-45f2-8240-6a3d6d02efca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:23.146002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:23.146937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 291/579] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:23.147859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8b754-42de-45f2-8240-6a3d6d02efca None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:23.187493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63fb9c-7cb5-4553-a4d5-54b561a0a12e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.224303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32313ce7-1f6e-4fe8-84df-533f2fad92a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.224927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32313ce7-1f6e-4fe8-84df-533f2fad92a4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.225548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32313ce7-1f6e-4fe8-84df-533f2fad92a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.225820 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32313ce7-1f6e-4fe8-84df-533f2fad92a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.230667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:23.237693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32313ce7-1f6e-4fe8-84df-533f2fad92a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.239658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32313ce7-1f6e-4fe8-84df-533f2fad92a4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:23.249749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8b754-42de-45f2-8240-6a3d6d02efca None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-32313ce7-1f6e-4fe8-84df-533f2fad92a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:23.254583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:23.255513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:23.261956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:23.261956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:23.261956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:23.261956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 289/580] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:23.261956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32313ce7-1f6e-4fe8-84df-533f2fad92a4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:23.288990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004937c-79d0-468c-89ba-83ba06541fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.289678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004937c-79d0-468c-89ba-83ba06541fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.290048 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004937c-79d0-468c-89ba-83ba06541fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.290325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004937c-79d0-468c-89ba-83ba06541fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.291017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004937c-79d0-468c-89ba-83ba06541fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:23.291323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004937c-79d0-468c-89ba-83ba06541fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.292691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004937c-79d0-468c-89ba-83ba06541fb1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:23.300227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:23.309278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 292/581] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:23.309278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004937c-79d0-468c-89ba-83ba06541fb1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:23.374270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32313ce7-1f6e-4fe8-84df-533f2fad92a4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.411099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be08d7d-42ca-49be-8edb-f252930d32a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.412175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be08d7d-42ca-49be-8edb-f252930d32a9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.412581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be08d7d-42ca-49be-8edb-f252930d32a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.412857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be08d7d-42ca-49be-8edb-f252930d32a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.414088 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004937c-79d0-468c-89ba-83ba06541fb1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.426640 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be08d7d-42ca-49be-8edb-f252930d32a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.428118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be08d7d-42ca-49be-8edb-f252930d32a9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3be08d7d-42ca-49be-8edb-f252930d32a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:23.442910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:23.443908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:23.444838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:23.444838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:23.444838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:23.444838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 290/582] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:23.444838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be08d7d-42ca-49be-8edb-f252930d32a9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:23.457806 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66803a3-bb2a-466c-8023-d5a034deb509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.458869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66803a3-bb2a-466c-8023-d5a034deb509 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.459239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66803a3-bb2a-466c-8023-d5a034deb509 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.459506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66803a3-bb2a-466c-8023-d5a034deb509 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.460610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66803a3-bb2a-466c-8023-d5a034deb509 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:23.461262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66803a3-bb2a-466c-8023-d5a034deb509 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.463705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66803a3-bb2a-466c-8023-d5a034deb509 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:23.479649 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:23.488445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 293/583] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 22 21:57:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:23.489323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66803a3-bb2a-466c-8023-d5a034deb509 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:23.545038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:23.556019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be08d7d-42ca-49be-8edb-f252930d32a9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.591277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66803a3-bb2a-466c-8023-d5a034deb509 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.594869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b91ae-f45d-499f-aa1b-aeb9a3400ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.595491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b91ae-f45d-499f-aa1b-aeb9a3400ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.595768 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b91ae-f45d-499f-aa1b-aeb9a3400ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.596039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b91ae-f45d-499f-aa1b-aeb9a3400ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.596686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b91ae-f45d-499f-aa1b-aeb9a3400ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:23.597344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b91ae-f45d-499f-aa1b-aeb9a3400ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.598866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b91ae-f45d-499f-aa1b-aeb9a3400ff0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:23.616056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 291/584] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:23.616056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b91ae-f45d-499f-aa1b-aeb9a3400ff0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:23.631954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef6f71-b1e9-4c93-bf4a-21cd86b93c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.632584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef6f71-b1e9-4c93-bf4a-21cd86b93c63 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.632856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef6f71-b1e9-4c93-bf4a-21cd86b93c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.633123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef6f71-b1e9-4c93-bf4a-21cd86b93c63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.640140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef6f71-b1e9-4c93-bf4a-21cd86b93c63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.641593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef6f71-b1e9-4c93-bf4a-21cd86b93c63 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-46ef6f71-b1e9-4c93-bf4a-21cd86b93c63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:23.652719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:23.653614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:23.654541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:23.654541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:23.654541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:23.654541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:23.654541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:23.654541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:23.654541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:23.654541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:23.654541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 294/585] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:23.654541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef6f71-b1e9-4c93-bf4a-21cd86b93c63 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:23.718837 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:23.734234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b91ae-f45d-499f-aa1b-aeb9a3400ff0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.761949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef6f71-b1e9-4c93-bf4a-21cd86b93c63 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.772062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b713a1d-ac5e-4793-9828-e0fddc95a963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.772674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b713a1d-ac5e-4793-9828-e0fddc95a963 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.772946 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b713a1d-ac5e-4793-9828-e0fddc95a963 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.773211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b713a1d-ac5e-4793-9828-e0fddc95a963 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.773922 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b713a1d-ac5e-4793-9828-e0fddc95a963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:23.774317 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b713a1d-ac5e-4793-9828-e0fddc95a963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.775648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b713a1d-ac5e-4793-9828-e0fddc95a963 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:23.787488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 292/586] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:23.790742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b713a1d-ac5e-4793-9828-e0fddc95a963 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:23.796671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027d398-5df1-4161-85a3-66ba9b0b2413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.797306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027d398-5df1-4161-85a3-66ba9b0b2413 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.797581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027d398-5df1-4161-85a3-66ba9b0b2413 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.797856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027d398-5df1-4161-85a3-66ba9b0b2413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.804500 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:23.811127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027d398-5df1-4161-85a3-66ba9b0b2413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.814030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027d398-5df1-4161-85a3-66ba9b0b2413 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-5027d398-5df1-4161-85a3-66ba9b0b2413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:23.831080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:23.832031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:23.832896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:23.832896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:23.832896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:23.840083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 295/587] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:23.840083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027d398-5df1-4161-85a3-66ba9b0b2413 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:23.901316 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b713a1d-ac5e-4793-9828-e0fddc95a963 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.936560 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16209da5-4514-4f56-ae5f-33aa258a2af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.937194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209da5-4514-4f56-ae5f-33aa258a2af4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.937460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209da5-4514-4f56-ae5f-33aa258a2af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.937740 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209da5-4514-4f56-ae5f-33aa258a2af4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.939794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027d398-5df1-4161-85a3-66ba9b0b2413 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:23.945515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16209da5-4514-4f56-ae5f-33aa258a2af4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.947280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16209da5-4514-4f56-ae5f-33aa258a2af4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:23.953172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-16209da5-4514-4f56-ae5f-33aa258a2af4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:23.959653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:23.960619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:23.962112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:23.962112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:23.962112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:23.962112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:23.962112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:23.962112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:23.962112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:23.962112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:23.962112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 21:57:23.962112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:23.962112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 293/588] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:23.962813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16209da5-4514-4f56-ae5f-33aa258a2af4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:23.982967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f6aa3-10c9-4084-9f4f-00db34f4a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:23.983670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6aa3-10c9-4084-9f4f-00db34f4a988 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:23.983942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6aa3-10c9-4084-9f4f-00db34f4a988 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:23.984204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6aa3-10c9-4084-9f4f-00db34f4a988 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:23.984883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f6aa3-10c9-4084-9f4f-00db34f4a988 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:23.985183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f6aa3-10c9-4084-9f4f-00db34f4a988 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:23.986776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f6aa3-10c9-4084-9f4f-00db34f4a988 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:24.004598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 296/589] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:24.004598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f6aa3-10c9-4084-9f4f-00db34f4a988 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:24.039438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:24.072118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16209da5-4514-4f56-ae5f-33aa258a2af4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:24.105547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f6aa3-10c9-4084-9f4f-00db34f4a988 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:24.109278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb340-75e6-4158-8703-075ad513a44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:24.109939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb340-75e6-4158-8703-075ad513a44a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.110215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb340-75e6-4158-8703-075ad513a44a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.110482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb340-75e6-4158-8703-075ad513a44a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.118326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bb340-75e6-4158-8703-075ad513a44a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:24.119765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bb340-75e6-4158-8703-075ad513a44a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-110bb340-75e6-4158-8703-075ad513a44a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:24.131070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:24.132074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 294/590] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:24.133003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb340-75e6-4158-8703-075ad513a44a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:24.147409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38626ae6-ac6f-4cbc-8152-2ae021805bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:24.148020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38626ae6-ac6f-4cbc-8152-2ae021805bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.148297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38626ae6-ac6f-4cbc-8152-2ae021805bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.148563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38626ae6-ac6f-4cbc-8152-2ae021805bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.149291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38626ae6-ac6f-4cbc-8152-2ae021805bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:24.149665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38626ae6-ac6f-4cbc-8152-2ae021805bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:24.151081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38626ae6-ac6f-4cbc-8152-2ae021805bc1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:24.163583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 297/591] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:24.164464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38626ae6-ac6f-4cbc-8152-2ae021805bc1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:24.199543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:24.258336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb340-75e6-4158-8703-075ad513a44a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:24.276732 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38626ae6-ac6f-4cbc-8152-2ae021805bc1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:24.292989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:24.301302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023fe5e-e59c-45d3-af69-740411a03778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:24.302208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023fe5e-e59c-45d3-af69-740411a03778 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.302482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023fe5e-e59c-45d3-af69-740411a03778 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.302767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023fe5e-e59c-45d3-af69-740411a03778 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.304006 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023fe5e-e59c-45d3-af69-740411a03778 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:24.304315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023fe5e-e59c-45d3-af69-740411a03778 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:24.306354 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023fe5e-e59c-45d3-af69-740411a03778 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:24.312151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0260066-d345-4770-aaad-f9d32810351b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:24.312818 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0260066-d345-4770-aaad-f9d32810351b None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.313092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0260066-d345-4770-aaad-f9d32810351b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.313416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0260066-d345-4770-aaad-f9d32810351b None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/a044973e9e84495dbf8d14e19fc84716/roles/82675c8ebc84464cbf87641d4ced0f72` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.328821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0260066-d345-4770-aaad-f9d32810351b None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=a044973e9e84495dbf8d14e19fc84716, role_id=82675c8ebc84464cbf87641d4ced0f72)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:24.329728 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 295/592] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 22 21:57:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:24.330318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0260066-d345-4770-aaad-f9d32810351b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:24.330663 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023fe5e-e59c-45d3-af69-740411a03778 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:24.346585 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 298/593] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:57:24 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/a044973e9e84495dbf8d14e19fc84716/roles/82675c8ebc84464cbf87641d4ced0f72 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:57:24.347845 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0260066-d345-4770-aaad-f9d32810351b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:24.450325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:24.456144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023fe5e-e59c-45d3-af69-740411a03778 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:24.472829 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0260066-d345-4770-aaad-f9d32810351b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:24.495527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48966e6c-874e-4e1a-b8c8-3a439ff93d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:24.496165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966e6c-874e-4e1a-b8c8-3a439ff93d00 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.496444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966e6c-874e-4e1a-b8c8-3a439ff93d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.496719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966e6c-874e-4e1a-b8c8-3a439ff93d00 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.497527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48966e6c-874e-4e1a-b8c8-3a439ff93d00 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:24.497854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48966e6c-874e-4e1a-b8c8-3a439ff93d00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:24.499312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48966e6c-874e-4e1a-b8c8-3a439ff93d00 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:24.512129 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e9c7d-308f-4f5d-90e9-f3b6a4b4e1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:24.512691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e9c7d-308f-4f5d-90e9-f3b6a4b4e1de None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.512963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e9c7d-308f-4f5d-90e9-f3b6a4b4e1de None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.513354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e9c7d-308f-4f5d-90e9-f3b6a4b4e1de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.519247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 296/594] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Sep 22 21:57:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:24.520859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e9c7d-308f-4f5d-90e9-f3b6a4b4e1de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:24.522355 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e9c7d-308f-4f5d-90e9-f3b6a4b4e1de None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:24.525876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48966e6c-874e-4e1a-b8c8-3a439ff93d00 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f77e9c7d-308f-4f5d-90e9-f3b6a4b4e1de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:24.537637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:24.538671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:24.539652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:24.539652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:24.539652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:24.539652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:24.539652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:24.539652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:24.539652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:24.539652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:24.541426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 299/595] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:24.542786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26904-d96e-48d5-9382-5f4b3b2517a2 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.543230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26904-d96e-48d5-9382-5f4b3b2517a2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.543640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26904-d96e-48d5-9382-5f4b3b2517a2 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.545257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 300/596] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:24.546147 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be26904-d96e-48d5-9382-5f4b3b2517a2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:24.579760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:24.638208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48966e6c-874e-4e1a-b8c8-3a439ff93d00 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:24.659471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be26904-d96e-48d5-9382-5f4b3b2517a2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:24.672999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcddb3c-ccc2-4a30-93e7-5d1487099f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:24.673634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcddb3c-ccc2-4a30-93e7-5d1487099f5d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.673952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcddb3c-ccc2-4a30-93e7-5d1487099f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.674222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcddb3c-ccc2-4a30-93e7-5d1487099f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.684905 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcddb3c-ccc2-4a30-93e7-5d1487099f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:24.686394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcddb3c-ccc2-4a30-93e7-5d1487099f5d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:24.696742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d44542-11a4-4952-8a78-0d913b172ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:24.697372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44542-11a4-4952-8a78-0d913b172ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.697644 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44542-11a4-4952-8a78-0d913b172ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.697949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44542-11a4-4952-8a78-0d913b172ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4dcddb3c-ccc2-4a30-93e7-5d1487099f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:24.703848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:24.704814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:24.705683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:24.705683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:24.705683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:24.705683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 297/597] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:24.706932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcddb3c-ccc2-4a30-93e7-5d1487099f5d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:24.713880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d44542-11a4-4952-8a78-0d913b172ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:24.715376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d44542-11a4-4952-8a78-0d913b172ff2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:24.718012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-43d44542-11a4-4952-8a78-0d913b172ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:24.732998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:24.734113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:24.739983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:24.739983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:24.739983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:24.739983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 301/598] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:24.739983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2b011-c7cd-426e-8879-dade81d21bd2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.739983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2b011-c7cd-426e-8879-dade81d21bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.739983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2b011-c7cd-426e-8879-dade81d21bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.756432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d2f2b011-c7cd-426e-8879-dade81d21bd2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:24.757613 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d2f2b011-c7cd-426e-8879-dade81d21bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:24.810425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:24.814748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcddb3c-ccc2-4a30-93e7-5d1487099f5d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:24.827063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 302/599] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:24.828161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2b011-c7cd-426e-8879-dade81d21bd2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:24.853197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647520d-0af0-42dd-a237-e3c4a74c1d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:24.854312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647520d-0af0-42dd-a237-e3c4a74c1d2d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.854795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647520d-0af0-42dd-a237-e3c4a74c1d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.855669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647520d-0af0-42dd-a237-e3c4a74c1d2d None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.856834 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647520d-0af0-42dd-a237-e3c4a74c1d2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:24.857327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647520d-0af0-42dd-a237-e3c4a74c1d2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:24.859024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647520d-0af0-42dd-a237-e3c4a74c1d2d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:24.876646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 298/600] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:24.877254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647520d-0af0-42dd-a237-e3c4a74c1d2d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:24.942181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2b011-c7cd-426e-8879-dade81d21bd2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:24.978923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:24.986926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647520d-0af0-42dd-a237-e3c4a74c1d2d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:24.990895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19162fa3-4d97-47f3-8bc6-9b3e8a61b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:24.991657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162fa3-4d97-47f3-8bc6-9b3e8a61b687 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:24.991995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162fa3-4d97-47f3-8bc6-9b3e8a61b687 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:24.992326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162fa3-4d97-47f3-8bc6-9b3e8a61b687 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:24.993421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19162fa3-4d97-47f3-8bc6-9b3e8a61b687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:24.993786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19162fa3-4d97-47f3-8bc6-9b3e8a61b687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:24.995413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19162fa3-4d97-47f3-8bc6-9b3e8a61b687 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:25.007759 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 303/601] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:25.013216 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19162fa3-4d97-47f3-8bc6-9b3e8a61b687 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:25.023325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3df90-1991-482e-84ef-88bb0790fd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:25.023942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3df90-1991-482e-84ef-88bb0790fd3c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:25.024243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3df90-1991-482e-84ef-88bb0790fd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:25.024510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3df90-1991-482e-84ef-88bb0790fd3c None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:25.025220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3df90-1991-482e-84ef-88bb0790fd3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:25.025623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3df90-1991-482e-84ef-88bb0790fd3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:25.027149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3df90-1991-482e-84ef-88bb0790fd3c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:25.039401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 299/602] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:25.040547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3df90-1991-482e-84ef-88bb0790fd3c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:25.060792 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:25.122150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19162fa3-4d97-47f3-8bc6-9b3e8a61b687 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:25.143597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3df90-1991-482e-84ef-88bb0790fd3c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:25.155821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3828cac-1a23-404b-80a4-804ef3a77564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:25.156464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3828cac-1a23-404b-80a4-804ef3a77564 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:25.156737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3828cac-1a23-404b-80a4-804ef3a77564 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:25.157022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3828cac-1a23-404b-80a4-804ef3a77564 None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/2c639dece626449b9153943b388e52c3/roles/82675c8ebc84464cbf87641d4ced0f72` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:25.172247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3828cac-1a23-404b-80a4-804ef3a77564 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=2c639dece626449b9153943b388e52c3, role_id=82675c8ebc84464cbf87641d4ced0f72)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:25.173694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3828cac-1a23-404b-80a4-804ef3a77564 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:25.178458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aa993-8880-4c87-a4ad-967a9ac4a4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:25.179097 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aa993-8880-4c87-a4ad-967a9ac4a4ee None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:25.179353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aa993-8880-4c87-a4ad-967a9ac4a4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:25.179629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aa993-8880-4c87-a4ad-967a9ac4a4ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:25.187076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6aa993-8880-4c87-a4ad-967a9ac4a4ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:25.190046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 304/603] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:57:25 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/2c639dece626449b9153943b388e52c3/roles/82675c8ebc84464cbf87641d4ced0f72 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:57:25.190046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3828cac-1a23-404b-80a4-804ef3a77564 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:25.190240 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6aa993-8880-4c87-a4ad-967a9ac4a4ee None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5d6aa993-8880-4c87-a4ad-967a9ac4a4ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:25.209287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:25.210543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:25.212066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:25.212066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:25.212066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:25.212066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:25.212066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:25.212066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:25.212066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:25.212066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:25.215808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 300/604] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:25.216984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aa993-8880-4c87-a4ad-967a9ac4a4ee None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:25.241574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:25.317105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:25.342303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3828cac-1a23-404b-80a4-804ef3a77564 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:25.346453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aa993-8880-4c87-a4ad-967a9ac4a4ee None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:25.388609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067080c-8168-4955-aaa8-00c0bc634e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:25.389530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067080c-8168-4955-aaa8-00c0bc634e41 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:25.389646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b205a-ef2f-4bb5-a166-089f6bb41547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:25.390085 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067080c-8168-4955-aaa8-00c0bc634e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:25.390326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b205a-ef2f-4bb5-a166-089f6bb41547 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:25.390529 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067080c-8168-4955-aaa8-00c0bc634e41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:25.390640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b205a-ef2f-4bb5-a166-089f6bb41547 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:25.390895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b205a-ef2f-4bb5-a166-089f6bb41547 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:25.398499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b205a-ef2f-4bb5-a166-089f6bb41547 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:25.400046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b205a-ef2f-4bb5-a166-089f6bb41547 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:25.401929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067080c-8168-4955-aaa8-00c0bc634e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8067080c-8168-4955-aaa8-00c0bc634e41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:25.407780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:25.408726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:25.409562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 301/605] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:25.410378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067080c-8168-4955-aaa8-00c0bc634e41 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-634b205a-ef2f-4bb5-a166-089f6bb41547 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:25.413019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:25.413898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:25.414840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:25.414840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:25.414840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:25.414840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:25.414840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:25.414840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:25.414840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:25.414840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:25.414840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 305/606] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:25.422904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b205a-ef2f-4bb5-a166-089f6bb41547 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:25.523350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067080c-8168-4955-aaa8-00c0bc634e41 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:25.548798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:25.557736 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b205a-ef2f-4bb5-a166-089f6bb41547 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:25.562275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91f33b-daf0-4aff-a0b3-37052fd9e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:25.563099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f33b-daf0-4aff-a0b3-37052fd9e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:25.563519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f33b-daf0-4aff-a0b3-37052fd9e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:25.563931 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f33b-daf0-4aff-a0b3-37052fd9e3a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:25.564770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f33b-daf0-4aff-a0b3-37052fd9e3a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:25.565207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f33b-daf0-4aff-a0b3-37052fd9e3a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:25.567006 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f33b-daf0-4aff-a0b3-37052fd9e3a7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:25.576022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:25.586898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 302/607] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:25.588679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91f33b-daf0-4aff-a0b3-37052fd9e3a7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:25.602976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ff649-b532-4b20-babf-279e8318937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:25.603803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ff649-b532-4b20-babf-279e8318937c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:25.604453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ff649-b532-4b20-babf-279e8318937c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:25.604820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ff649-b532-4b20-babf-279e8318937c None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:25.606128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ff649-b532-4b20-babf-279e8318937c None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:25.606530 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ff649-b532-4b20-babf-279e8318937c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:25.608542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ff649-b532-4b20-babf-279e8318937c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:25.625252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 306/608] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:25.627084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ff649-b532-4b20-babf-279e8318937c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:25.702541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91f33b-daf0-4aff-a0b3-37052fd9e3a7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:25.746343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de034e-8c03-47a6-af0b-4a30c7964d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:25.747236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de034e-8c03-47a6-af0b-4a30c7964d4d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:25.747648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de034e-8c03-47a6-af0b-4a30c7964d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:25.748079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de034e-8c03-47a6-af0b-4a30c7964d4d None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:25.748958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de034e-8c03-47a6-af0b-4a30c7964d4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:25.749388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de034e-8c03-47a6-af0b-4a30c7964d4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:25.751055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de034e-8c03-47a6-af0b-4a30c7964d4d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:25.763567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 303/609] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:25.764644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de034e-8c03-47a6-af0b-4a30c7964d4d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:25.766566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ff649-b532-4b20-babf-279e8318937c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:25.803277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6535a-701f-4346-8a34-4c7ec4c76551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:25.804450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6535a-701f-4346-8a34-4c7ec4c76551 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:25.804864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6535a-701f-4346-8a34-4c7ec4c76551 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:25.805353 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6535a-701f-4346-8a34-4c7ec4c76551 None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/d22e60fc95af4a0a94b15f9ed9e3e73f/roles/82675c8ebc84464cbf87641d4ced0f72` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:25.826218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6535a-701f-4346-8a34-4c7ec4c76551 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=d22e60fc95af4a0a94b15f9ed9e3e73f, role_id=82675c8ebc84464cbf87641d4ced0f72)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:25.827905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6535a-701f-4346-8a34-4c7ec4c76551 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:25.835562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:25.859178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 307/610] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:57:25 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/d22e60fc95af4a0a94b15f9ed9e3e73f/roles/82675c8ebc84464cbf87641d4ced0f72 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:57:25.859178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6535a-701f-4346-8a34-4c7ec4c76551 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:25.872693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:25.920851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de034e-8c03-47a6-af0b-4a30c7964d4d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:25.999594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54b92d-2843-461b-a1eb-9ac9a5705c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:26.000449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54b92d-2843-461b-a1eb-9ac9a5705c33 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:26.000821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54b92d-2843-461b-a1eb-9ac9a5705c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:26.001190 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54b92d-2843-461b-a1eb-9ac9a5705c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:26.025022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54b92d-2843-461b-a1eb-9ac9a5705c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:26.030963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54b92d-2843-461b-a1eb-9ac9a5705c33 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:26.061888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6535a-701f-4346-8a34-4c7ec4c76551 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8c54b92d-2843-461b-a1eb-9ac9a5705c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:26.064149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:26.065247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:26.066365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:26.066365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:26.066365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:26.075101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 304/611] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:26.080636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54b92d-2843-461b-a1eb-9ac9a5705c33 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:26.132830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f621efb-4ab1-4086-b552-39f7723513cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:26.134750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f621efb-4ab1-4086-b552-39f7723513cc None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:26.135264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f621efb-4ab1-4086-b552-39f7723513cc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:26.136613 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f621efb-4ab1-4086-b552-39f7723513cc None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/d512b60a42ed456a82dff11d17b77c06/roles/82675c8ebc84464cbf87641d4ced0f72` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:26.160542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f621efb-4ab1-4086-b552-39f7723513cc None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=d512b60a42ed456a82dff11d17b77c06, role_id=82675c8ebc84464cbf87641d4ced0f72)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:26.163288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f621efb-4ab1-4086-b552-39f7723513cc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:26.188559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 308/612] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:57:25 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/d512b60a42ed456a82dff11d17b77c06/roles/82675c8ebc84464cbf87641d4ced0f72 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:57:26.228927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54b92d-2843-461b-a1eb-9ac9a5705c33 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:26.241494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:26.271268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40770e7-fb54-4f1b-97dd-8e9e426ecc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:26.272210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40770e7-fb54-4f1b-97dd-8e9e426ecc0f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:26.272664 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40770e7-fb54-4f1b-97dd-8e9e426ecc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:26.273120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40770e7-fb54-4f1b-97dd-8e9e426ecc0f None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:26.274146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40770e7-fb54-4f1b-97dd-8e9e426ecc0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:26.275201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40770e7-fb54-4f1b-97dd-8e9e426ecc0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:26.276796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40770e7-fb54-4f1b-97dd-8e9e426ecc0f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:26.291607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 305/613] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:26.297646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f621efb-4ab1-4086-b552-39f7723513cc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:26.372419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:26.439593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f621efb-4ab1-4086-b552-39f7723513cc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:26.494943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbb128-cb5d-4ec7-abe2-63caf67f43d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:26.495944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbb128-cb5d-4ec7-abe2-63caf67f43d6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:26.496375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbb128-cb5d-4ec7-abe2-63caf67f43d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:26.496799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbb128-cb5d-4ec7-abe2-63caf67f43d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:26.509784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbb128-cb5d-4ec7-abe2-63caf67f43d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:26.511552 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbb128-cb5d-4ec7-abe2-63caf67f43d6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-62cbb128-cb5d-4ec7-abe2-63caf67f43d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:26.528999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:26.530277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:26.531421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:26.531421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:26.531421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:26.531421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:26.531421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:26.531421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:26.531421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:26.531421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:26.531421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:26.531421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:26.533353 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 309/614] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:26.538979 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257313-910e-49e0-895f-3dd1588b0f32 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:26.539298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbb128-cb5d-4ec7-abe2-63caf67f43d6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:26.539498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257313-910e-49e0-895f-3dd1588b0f32 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:26.540260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257313-910e-49e0-895f-3dd1588b0f32 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:26.542003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 306/615] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:26.555883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489e92-cadf-45ac-9b01-db793485e081 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:26.556243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489e92-cadf-45ac-9b01-db793485e081 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:26.556528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489e92-cadf-45ac-9b01-db793485e081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:26.585383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-58489e92-cadf-45ac-9b01-db793485e081 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:26.587704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-58489e92-cadf-45ac-9b01-db793485e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:26.669529 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 307/616] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:26.679973 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbb128-cb5d-4ec7-abe2-63caf67f43d6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:26.709426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:26.749229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29de18-2082-4451-9ff7-97fb9de112c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:26.749869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29de18-2082-4451-9ff7-97fb9de112c1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:26.750140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29de18-2082-4451-9ff7-97fb9de112c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:26.750401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29de18-2082-4451-9ff7-97fb9de112c1 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:26.751131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29de18-2082-4451-9ff7-97fb9de112c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:26.751424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29de18-2082-4451-9ff7-97fb9de112c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:26.752835 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29de18-2082-4451-9ff7-97fb9de112c1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:26.785876 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 310/617] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 22 21:57:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:26.791991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58489e92-cadf-45ac-9b01-db793485e081 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:26.920540 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58489e92-cadf-45ac-9b01-db793485e081 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:26.942195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:26.966753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8768-2367-4d97-a18b-206000ada247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:26.967553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8768-2367-4d97-a18b-206000ada247 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:26.967935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8768-2367-4d97-a18b-206000ada247 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:26.968304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8768-2367-4d97-a18b-206000ada247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:26.985644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8768-2367-4d97-a18b-206000ada247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:26.987484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8768-2367-4d97-a18b-206000ada247 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:26.997578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29de18-2082-4451-9ff7-97fb9de112c1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-91ac8768-2367-4d97-a18b-206000ada247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:27.006214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:27.007343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:27.008494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:27.008494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:27.008494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:27.008494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 308/618] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:27.021671 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8768-2367-4d97-a18b-206000ada247 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:27.159363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29de18-2082-4451-9ff7-97fb9de112c1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:27.201858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e56dc-0857-4729-ae23-17ebe199e24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:27.202842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e56dc-0857-4729-ae23-17ebe199e24c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:27.203302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e56dc-0857-4729-ae23-17ebe199e24c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:27.203917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e56dc-0857-4729-ae23-17ebe199e24c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:27.223727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e56dc-0857-4729-ae23-17ebe199e24c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d43e56dc-0857-4729-ae23-17ebe199e24c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:27.230407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:27.231703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:27.232722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:27.242077 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8768-2367-4d97-a18b-206000ada247 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:27.247508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 311/619] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:27.253027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e56dc-0857-4729-ae23-17ebe199e24c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:27.280219 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b506c6-dab5-4b6b-8d4d-51fdad12725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:27.281111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b506c6-dab5-4b6b-8d4d-51fdad12725d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:27.281527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b506c6-dab5-4b6b-8d4d-51fdad12725d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:27.281995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b506c6-dab5-4b6b-8d4d-51fdad12725d None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:27.282800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b506c6-dab5-4b6b-8d4d-51fdad12725d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:27.283242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b506c6-dab5-4b6b-8d4d-51fdad12725d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:27.284750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b506c6-dab5-4b6b-8d4d-51fdad12725d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:27.299158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 309/620] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:27.307004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b506c6-dab5-4b6b-8d4d-51fdad12725d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:27.323726 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:27.338820 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:27.444058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e56dc-0857-4729-ae23-17ebe199e24c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:27.471421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b506c6-dab5-4b6b-8d4d-51fdad12725d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:27.516298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d38a5-e9d9-4b6b-9f99-68af2c0fe05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:27.516934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d38a5-e9d9-4b6b-9f99-68af2c0fe05b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:27.517209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d38a5-e9d9-4b6b-9f99-68af2c0fe05b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:27.517478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d38a5-e9d9-4b6b-9f99-68af2c0fe05b None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:27.518210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d38a5-e9d9-4b6b-9f99-68af2c0fe05b None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:27.518515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d38a5-e9d9-4b6b-9f99-68af2c0fe05b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:27.521323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d38a5-e9d9-4b6b-9f99-68af2c0fe05b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:27.541008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a37354-7572-43e8-8032-1fe304655657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:27.541684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a37354-7572-43e8-8032-1fe304655657 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:27.541990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a37354-7572-43e8-8032-1fe304655657 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:27.542263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a37354-7572-43e8-8032-1fe304655657 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:27.544277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 312/621] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:27.551479 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d38a5-e9d9-4b6b-9f99-68af2c0fe05b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:27.556318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a37354-7572-43e8-8032-1fe304655657 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:27.557480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a37354-7572-43e8-8032-1fe304655657 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-32a37354-7572-43e8-8032-1fe304655657 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:27.580677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:27.581700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:27.582639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:27.582639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:27.582639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:27.582639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:27.582639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:27.582639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:27.582639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:27.582639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:27.593448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 310/622] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:27.597778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a37354-7572-43e8-8032-1fe304655657 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:27.686393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:27.693752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d38a5-e9d9-4b6b-9f99-68af2c0fe05b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:27.700745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:27.734807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a37354-7572-43e8-8032-1fe304655657 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:27.744616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339439e1-f0cc-4997-b2ea-bde77ab218fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:27.745930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339439e1-f0cc-4997-b2ea-bde77ab218fb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:27.746659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339439e1-f0cc-4997-b2ea-bde77ab218fb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:27.747124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339439e1-f0cc-4997-b2ea-bde77ab218fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:27.759130 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339439e1-f0cc-4997-b2ea-bde77ab218fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:27.760585 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339439e1-f0cc-4997-b2ea-bde77ab218fb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-339439e1-f0cc-4997-b2ea-bde77ab218fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:27.775777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:27.776766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:27.777641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:27.777641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:27.777641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:27.778439 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f1bac-81db-4d37-b8ce-31dfbdaee79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:27.779313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f1bac-81db-4d37-b8ce-31dfbdaee79b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:27.779788 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f1bac-81db-4d37-b8ce-31dfbdaee79b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:27.780246 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f1bac-81db-4d37-b8ce-31dfbdaee79b None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:27.781141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f1bac-81db-4d37-b8ce-31dfbdaee79b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:27.781575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 313/623] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:27.781860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f1bac-81db-4d37-b8ce-31dfbdaee79b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:27.782876 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607752e4-0a75-4996-b4f6-f8035abe990c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:27.783149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607752e4-0a75-4996-b4f6-f8035abe990c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:27.783408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607752e4-0a75-4996-b4f6-f8035abe990c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:27.784142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f1bac-81db-4d37-b8ce-31dfbdaee79b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:27.784875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 314/624] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:27.785552 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607752e4-0a75-4996-b4f6-f8035abe990c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:27.803967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 311/625] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:27.805338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf0f0-d3af-4a44-be14-6ef87f9f7c3c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:27.805742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf0f0-d3af-4a44-be14-6ef87f9f7c3c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:27.806260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf0f0-d3af-4a44-be14-6ef87f9f7c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:27.825968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b31bf0f0-d3af-4a44-be14-6ef87f9f7c3c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:27.827149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b31bf0f0-d3af-4a44-be14-6ef87f9f7c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:27.908740 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 312/626] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:27.909654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf0f0-d3af-4a44-be14-6ef87f9f7c3c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:27.933375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607752e4-0a75-4996-b4f6-f8035abe990c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:27.985052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:28.015974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521961e2-5b8b-4387-a8ed-8461505c4142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:28.016590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521961e2-5b8b-4387-a8ed-8461505c4142 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:28.016862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521961e2-5b8b-4387-a8ed-8461505c4142 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:28.017129 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521961e2-5b8b-4387-a8ed-8461505c4142 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:28.017776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521961e2-5b8b-4387-a8ed-8461505c4142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:28.018228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521961e2-5b8b-4387-a8ed-8461505c4142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:28.019604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521961e2-5b8b-4387-a8ed-8461505c4142 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:28.047800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 315/627] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:28.052258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521961e2-5b8b-4387-a8ed-8461505c4142 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:28.054173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf0f0-d3af-4a44-be14-6ef87f9f7c3c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:28.072351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:28.131862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07b6d1-2364-4d84-a832-b083bec0b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:28.132544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07b6d1-2364-4d84-a832-b083bec0b490 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:28.132817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07b6d1-2364-4d84-a832-b083bec0b490 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:28.133084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07b6d1-2364-4d84-a832-b083bec0b490 None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/f9967ef46a464ff2b5f7e4c459f8abd9/roles/82675c8ebc84464cbf87641d4ced0f72` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:28.161104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07b6d1-2364-4d84-a832-b083bec0b490 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=f9967ef46a464ff2b5f7e4c459f8abd9, role_id=82675c8ebc84464cbf87641d4ced0f72)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:28.162640 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07b6d1-2364-4d84-a832-b083bec0b490 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:28.189163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 313/628] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:57:27 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/f9967ef46a464ff2b5f7e4c459f8abd9/roles/82675c8ebc84464cbf87641d4ced0f72 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:57:28.226159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521961e2-5b8b-4387-a8ed-8461505c4142 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:28.242373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07b6d1-2364-4d84-a832-b083bec0b490 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:28.291675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c2120-d371-4696-b948-66471ce277a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:28.294149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c2120-d371-4696-b948-66471ce277a5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:28.294441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c2120-d371-4696-b948-66471ce277a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:28.294913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c2120-d371-4696-b948-66471ce277a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:28.312179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c2120-d371-4696-b948-66471ce277a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:28.314036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c2120-d371-4696-b948-66471ce277a5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-900c2120-d371-4696-b948-66471ce277a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:28.334966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:28.336476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:28.337545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:28.337545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:28.337545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:28.337545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:28.337545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:28.337545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:28.337545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:28.337545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:28.337545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:28.337545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:28.347808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 316/629] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 22 21:57:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:28.353288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c2120-d371-4696-b948-66471ce277a5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:28.425819 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07b6d1-2364-4d84-a832-b083bec0b490 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:28.459342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:28.488212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:28.494900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79675988-8f90-49fe-9caa-22632654c5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:28.495876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79675988-8f90-49fe-9caa-22632654c5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:28.496368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79675988-8f90-49fe-9caa-22632654c5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:28.496831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79675988-8f90-49fe-9caa-22632654c5d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:28.511121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79675988-8f90-49fe-9caa-22632654c5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-79675988-8f90-49fe-9caa-22632654c5d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:28.517163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:28.518342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:28.519345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:28.522540 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 314/630] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:28.529622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79675988-8f90-49fe-9caa-22632654c5d4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:28.539256 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c2120-d371-4696-b948-66471ce277a5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:28.592873 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c0f19-dfc0-44ef-8229-570a7ba92f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:28.593533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c0f19-dfc0-44ef-8229-570a7ba92f33 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:28.593806 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c0f19-dfc0-44ef-8229-570a7ba92f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:28.594151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c0f19-dfc0-44ef-8229-570a7ba92f33 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:28.595128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c0f19-dfc0-44ef-8229-570a7ba92f33 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:28.595801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c0f19-dfc0-44ef-8229-570a7ba92f33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:28.597242 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c0f19-dfc0-44ef-8229-570a7ba92f33 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:28.621877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 317/631] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 22 21:57:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:28.623212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef021-9711-4036-820b-104ddc263270 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:28.623489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef021-9711-4036-820b-104ddc263270 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:28.624271 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef021-9711-4036-820b-104ddc263270 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:28.625720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 318/632] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:28.632051 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ef021-9711-4036-820b-104ddc263270 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:28.655393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79675988-8f90-49fe-9caa-22632654c5d4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:28.693254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f4ec7-b3e9-4911-904f-2ab678ce3930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:28.693908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4ec7-b3e9-4911-904f-2ab678ce3930 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:28.694239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4ec7-b3e9-4911-904f-2ab678ce3930 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:28.694533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4ec7-b3e9-4911-904f-2ab678ce3930 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:28.695176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f4ec7-b3e9-4911-904f-2ab678ce3930 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:28.695475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f4ec7-b3e9-4911-904f-2ab678ce3930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:28.697402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f4ec7-b3e9-4911-904f-2ab678ce3930 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:28.706986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 315/633] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:28.708360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988b0ba-a8aa-4a94-ac32-acded069c94a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:28.708647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988b0ba-a8aa-4a94-ac32-acded069c94a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:28.708920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988b0ba-a8aa-4a94-ac32-acded069c94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:28.729809 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d988b0ba-a8aa-4a94-ac32-acded069c94a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:28.732122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d988b0ba-a8aa-4a94-ac32-acded069c94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:28.778088 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ef021-9711-4036-820b-104ddc263270 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:28.792431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:28.813867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:28.852471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418e10f-74d5-47bb-8abf-f7b5239dc27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:28.852471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418e10f-74d5-47bb-8abf-f7b5239dc27e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:28.852471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418e10f-74d5-47bb-8abf-f7b5239dc27e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:28.852471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418e10f-74d5-47bb-8abf-f7b5239dc27e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:28.897860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 316/634] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:28.897860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988b0ba-a8aa-4a94-ac32-acded069c94a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:28.963735 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418e10f-74d5-47bb-8abf-f7b5239dc27e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:28.967644 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418e10f-74d5-47bb-8abf-f7b5239dc27e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:29.093418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988b0ba-a8aa-4a94-ac32-acded069c94a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:29.167941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26077920-a1c3-4a67-81af-50ee0f3cf61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:29.168591 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077920-a1c3-4a67-81af-50ee0f3cf61e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:29.168863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077920-a1c3-4a67-81af-50ee0f3cf61e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:29.169126 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077920-a1c3-4a67-81af-50ee0f3cf61e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:29.170753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 319/635] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:29.173352 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb9231-d778-485c-aa41-8dc129cdd04e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:29.173640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb9231-d778-485c-aa41-8dc129cdd04e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:29.173934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb9231-d778-485c-aa41-8dc129cdd04e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:29.178072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 320/636] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:29.178072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb9231-d778-485c-aa41-8dc129cdd04e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:29.181398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26077920-a1c3-4a67-81af-50ee0f3cf61e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:29.182985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26077920-a1c3-4a67-81af-50ee0f3cf61e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-26077920-a1c3-4a67-81af-50ee0f3cf61e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:29.198410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:29.199432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:29.200309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:29.200309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:29.200309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:29.200309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 317/637] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:29.200309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26077920-a1c3-4a67-81af-50ee0f3cf61e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:29.221696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:29.228746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:29.309175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26077920-a1c3-4a67-81af-50ee0f3cf61e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:29.310254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb9231-d778-485c-aa41-8dc129cdd04e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:29.344411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074e30e-cf60-4eb4-9dc8-c44f1674d91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:29.344594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c9b79-6c02-4da1-afb2-04f4e8c7606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:29.344959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e30e-cf60-4eb4-9dc8-c44f1674d91e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:29.345178 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c9b79-6c02-4da1-afb2-04f4e8c7606e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:29.345275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e30e-cf60-4eb4-9dc8-c44f1674d91e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:29.345448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c9b79-6c02-4da1-afb2-04f4e8c7606e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:29.345540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e30e-cf60-4eb4-9dc8-c44f1674d91e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:29.345711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c9b79-6c02-4da1-afb2-04f4e8c7606e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:29.355519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074e30e-cf60-4eb4-9dc8-c44f1674d91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:29.356618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c9b79-6c02-4da1-afb2-04f4e8c7606e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:29.358100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c9b79-6c02-4da1-afb2-04f4e8c7606e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d074e30e-cf60-4eb4-9dc8-c44f1674d91e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:29.360400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:29.361351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:29.362210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 321/638] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:29.362974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2c173-4d33-49b1-adcb-386ea43d7132 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:29.362974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2c173-4d33-49b1-adcb-386ea43d7132 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:29.363606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2c173-4d33-49b1-adcb-386ea43d7132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-043c9b79-6c02-4da1-afb2-04f4e8c7606e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:29.379200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:29.380196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:29.381056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:29.381056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:29.381056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:29.381056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 318/639] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:29.381056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c9b79-6c02-4da1-afb2-04f4e8c7606e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:29.382517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4ae2c173-4d33-49b1-adcb-386ea43d7132 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:29.383734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4ae2c173-4d33-49b1-adcb-386ea43d7132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:29.451069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 322/640] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:29.451898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2c173-4d33-49b1-adcb-386ea43d7132 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:29.473477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:29.480998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:29.513680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c9b79-6c02-4da1-afb2-04f4e8c7606e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:29.553341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0ad59-2c4f-4a75-bd8c-9dba9fb937fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:29.554135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0ad59-2c4f-4a75-bd8c-9dba9fb937fb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:29.554414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0ad59-2c4f-4a75-bd8c-9dba9fb937fb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:29.554679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0ad59-2c4f-4a75-bd8c-9dba9fb937fb None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:29.555658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0ad59-2c4f-4a75-bd8c-9dba9fb937fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:29.555766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0ad59-2c4f-4a75-bd8c-9dba9fb937fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:29.557270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0ad59-2c4f-4a75-bd8c-9dba9fb937fb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:29.572110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 319/641] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:29.573748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0ad59-2c4f-4a75-bd8c-9dba9fb937fb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:29.578185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2c173-4d33-49b1-adcb-386ea43d7132 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:29.617510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32dec6-44da-467e-a679-762f83671848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:29.618119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32dec6-44da-467e-a679-762f83671848 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:29.618389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32dec6-44da-467e-a679-762f83671848 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:29.618652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32dec6-44da-467e-a679-762f83671848 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:29.619308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32dec6-44da-467e-a679-762f83671848 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:29.619602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32dec6-44da-467e-a679-762f83671848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:29.621027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32dec6-44da-467e-a679-762f83671848 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:29.636459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 323/642] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:29.637465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32dec6-44da-467e-a679-762f83671848 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:29.699567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0ad59-2c4f-4a75-bd8c-9dba9fb937fb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:29.738698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:29.748138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821d31c-1320-46e4-9649-b15777250c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:29.750122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821d31c-1320-46e4-9649-b15777250c12 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:29.750402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821d31c-1320-46e4-9649-b15777250c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:29.750670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821d31c-1320-46e4-9649-b15777250c12 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:29.751317 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821d31c-1320-46e4-9649-b15777250c12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:29.754167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821d31c-1320-46e4-9649-b15777250c12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:29.755634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821d31c-1320-46e4-9649-b15777250c12 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:29.758407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:29.773910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 320/643] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:29.773910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821d31c-1320-46e4-9649-b15777250c12 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:29.791613 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32dec6-44da-467e-a679-762f83671848 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:29.828605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664da388-b073-493d-b38e-daa4a4812700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:29.829300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664da388-b073-493d-b38e-daa4a4812700 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:29.829548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664da388-b073-493d-b38e-daa4a4812700 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:29.829817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664da388-b073-493d-b38e-daa4a4812700 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:29.838278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664da388-b073-493d-b38e-daa4a4812700 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:29.839745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664da388-b073-493d-b38e-daa4a4812700 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-664da388-b073-493d-b38e-daa4a4812700 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:29.850767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:29.851765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 324/644] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:29.857934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664da388-b073-493d-b38e-daa4a4812700 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:29.886949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821d31c-1320-46e4-9649-b15777250c12 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:29.926787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7b66-0187-444b-9adc-8844480347b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:29.927425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7b66-0187-444b-9adc-8844480347b9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:29.927952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7b66-0187-444b-9adc-8844480347b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:29.928221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7b66-0187-444b-9adc-8844480347b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:29.942147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a7b66-0187-444b-9adc-8844480347b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:29.943898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a7b66-0187-444b-9adc-8844480347b9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a24a7b66-0187-444b-9adc-8844480347b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:29.962567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:29.963565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:29.964609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:29.964609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:29.964609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:29.964609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 321/645] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:29.965334 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7b66-0187-444b-9adc-8844480347b9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:29.969956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664da388-b073-493d-b38e-daa4a4812700 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:30.005468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955e022-b772-452e-9c22-0cb10d1c1832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:30.006204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955e022-b772-452e-9c22-0cb10d1c1832 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:30.006533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955e022-b772-452e-9c22-0cb10d1c1832 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:30.006838 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955e022-b772-452e-9c22-0cb10d1c1832 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:30.014231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:30.018686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955e022-b772-452e-9c22-0cb10d1c1832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:30.019190 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7955e022-b772-452e-9c22-0cb10d1c1832 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:30.023746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:30.024801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:30.025643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 325/646] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:30.026377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955e022-b772-452e-9c22-0cb10d1c1832 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:30.088909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7b66-0187-444b-9adc-8844480347b9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:30.130909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613a4c3-3951-44e8-a152-77c7223812f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:30.131548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613a4c3-3951-44e8-a152-77c7223812f4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:30.131809 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613a4c3-3951-44e8-a152-77c7223812f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:30.132077 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613a4c3-3951-44e8-a152-77c7223812f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:30.140881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613a4c3-3951-44e8-a152-77c7223812f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:30.142363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613a4c3-3951-44e8-a152-77c7223812f4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e613a4c3-3951-44e8-a152-77c7223812f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:30.157688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:30.158838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:30.159919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:30.159919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:30.159919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:30.159919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:30.159919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:30.159919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:30.159919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:30.159919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:30.163224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955e022-b772-452e-9c22-0cb10d1c1832 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:30.163702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 322/647] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:30.164541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613a4c3-3951-44e8-a152-77c7223812f4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:30.204068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f01de-6775-421f-ba55-f7db59043177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:30.204676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f01de-6775-421f-ba55-f7db59043177 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:30.204950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f01de-6775-421f-ba55-f7db59043177 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:30.205215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f01de-6775-421f-ba55-f7db59043177 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:30.205973 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f01de-6775-421f-ba55-f7db59043177 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:30.206277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f01de-6775-421f-ba55-f7db59043177 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:30.207802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f01de-6775-421f-ba55-f7db59043177 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:30.227786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 326/648] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 22 21:57:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:30.228616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f01de-6775-421f-ba55-f7db59043177 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:30.273807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:30.277813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613a4c3-3951-44e8-a152-77c7223812f4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:30.286211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:30.315518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e137c-702c-40a0-b050-53cd2ec0996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:30.316144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e137c-702c-40a0-b050-53cd2ec0996d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:30.316418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e137c-702c-40a0-b050-53cd2ec0996d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:30.316689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e137c-702c-40a0-b050-53cd2ec0996d None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:30.317335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e137c-702c-40a0-b050-53cd2ec0996d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:30.317637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e137c-702c-40a0-b050-53cd2ec0996d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:30.319034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e137c-702c-40a0-b050-53cd2ec0996d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:30.331850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 323/649] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:30.332089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f01de-6775-421f-ba55-f7db59043177 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:30.336060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e137c-702c-40a0-b050-53cd2ec0996d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:30.367119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108cba2-fabf-4844-a662-dbe0c3d0fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:30.367738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108cba2-fabf-4844-a662-dbe0c3d0fd00 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:30.368073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108cba2-fabf-4844-a662-dbe0c3d0fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:30.368341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108cba2-fabf-4844-a662-dbe0c3d0fd00 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:30.368997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108cba2-fabf-4844-a662-dbe0c3d0fd00 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:30.369289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108cba2-fabf-4844-a662-dbe0c3d0fd00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:30.370692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108cba2-fabf-4844-a662-dbe0c3d0fd00 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:30.378958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 327/650] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:30.379794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108cba2-fabf-4844-a662-dbe0c3d0fd00 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:30.456076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e137c-702c-40a0-b050-53cd2ec0996d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:30.486031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108cba2-fabf-4844-a662-dbe0c3d0fd00 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:30.495281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10d53b-333b-46f5-88b9-1849b3c463fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:30.496277 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d53b-333b-46f5-88b9-1849b3c463fe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:30.496920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d53b-333b-46f5-88b9-1849b3c463fe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:30.497302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d53b-333b-46f5-88b9-1849b3c463fe None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:30.498150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10d53b-333b-46f5-88b9-1849b3c463fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:30.498434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10d53b-333b-46f5-88b9-1849b3c463fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:30.500118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10d53b-333b-46f5-88b9-1849b3c463fe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:30.503128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:30.522009 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 324/651] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:30.523378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10d53b-333b-46f5-88b9-1849b3c463fe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:30.523746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c15e1-909e-4daf-9306-5501418bb7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:30.524947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c15e1-909e-4daf-9306-5501418bb7fa None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:30.524947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c15e1-909e-4daf-9306-5501418bb7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:30.525161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c15e1-909e-4daf-9306-5501418bb7fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:30.549698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:30.600550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c15e1-909e-4daf-9306-5501418bb7fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:30.602245 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c15e1-909e-4daf-9306-5501418bb7fa None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:30.629220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10d53b-333b-46f5-88b9-1849b3c463fe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:30.663310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333499b-f3e8-4cf8-ae9c-41a482296918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:30.663932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333499b-f3e8-4cf8-ae9c-41a482296918 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:30.664200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333499b-f3e8-4cf8-ae9c-41a482296918 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:30.664460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333499b-f3e8-4cf8-ae9c-41a482296918 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:30.672065 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333499b-f3e8-4cf8-ae9c-41a482296918 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:30.673503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333499b-f3e8-4cf8-ae9c-41a482296918 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f333499b-f3e8-4cf8-ae9c-41a482296918 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:30.685305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:30.686327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:30.687290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:30.687290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:30.687290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:30.687290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:30.687290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:30.687290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:30.687290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:30.687290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:30.687290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 21:57:30.687290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:30.688182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 325/652] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:30.688182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333499b-f3e8-4cf8-ae9c-41a482296918 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:30.706455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 328/653] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:30.707589 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c15e1-909e-4daf-9306-5501418bb7fa None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:30.727016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:30.780128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:30.801076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333499b-f3e8-4cf8-ae9c-41a482296918 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:30.807701 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c15e1-909e-4daf-9306-5501418bb7fa None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:30.837686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd779a-60d5-4596-b78c-c1b285b8665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:30.838349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd779a-60d5-4596-b78c-c1b285b8665f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:30.838623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd779a-60d5-4596-b78c-c1b285b8665f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:30.838887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd779a-60d5-4596-b78c-c1b285b8665f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:30.842908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aaa617-4b94-4863-ad5c-16db28eb6deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:30.843496 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaa617-4b94-4863-ad5c-16db28eb6deb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:30.843764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaa617-4b94-4863-ad5c-16db28eb6deb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:30.844023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaa617-4b94-4863-ad5c-16db28eb6deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:30.844728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aaa617-4b94-4863-ad5c-16db28eb6deb None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=a044973e9e84495dbf8d14e19fc84716) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:30.845026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aaa617-4b94-4863-ad5c-16db28eb6deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:30.846502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aaa617-4b94-4863-ad5c-16db28eb6deb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:30.849990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd779a-60d5-4596-b78c-c1b285b8665f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:30.851448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd779a-60d5-4596-b78c-c1b285b8665f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:30.866093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 329/654] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:30 2022] GET /identity/v3/role_assignments?user.id=a044973e9e84495dbf8d14e19fc84716&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:30.866093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4405d-82c0-48fb-9dce-82737a798c31 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:30.866093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4405d-82c0-48fb-9dce-82737a798c31 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:30.866093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4405d-82c0-48fb-9dce-82737a798c31 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:30.866093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 330/655] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:30.866093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4405d-82c0-48fb-9dce-82737a798c31 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-46cd779a-60d5-4596-b78c-c1b285b8665f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:30.869060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:30.870114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:30.871026 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:30.871026 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:30.871026 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:30.871026 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 326/656] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:30.871249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd779a-60d5-4596-b78c-c1b285b8665f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:30.967993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:30.989729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4405d-82c0-48fb-9dce-82737a798c31 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:31.006452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd779a-60d5-4596-b78c-c1b285b8665f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:31.030546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b1636-801a-460f-a589-3908b4e2ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:31.031219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1636-801a-460f-a589-3908b4e2ab42 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.031506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1636-801a-460f-a589-3908b4e2ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.031782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1636-801a-460f-a589-3908b4e2ab42 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.032555 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b1636-801a-460f-a589-3908b4e2ab42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:31.032857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b1636-801a-460f-a589-3908b4e2ab42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:31.034918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b1636-801a-460f-a589-3908b4e2ab42 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:31.046872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:31.056015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 331/657] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 22 21:57:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:31.060968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916aa31-2fef-4941-8593-1291db89ba41 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.060968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916aa31-2fef-4941-8593-1291db89ba41 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.060968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916aa31-2fef-4941-8593-1291db89ba41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.061811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4646581-ed92-42fb-b9e8-e3650a9c2974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:31.062566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4646581-ed92-42fb-b9e8-e3650a9c2974 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.062841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4646581-ed92-42fb-b9e8-e3650a9c2974 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.063111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4646581-ed92-42fb-b9e8-e3650a9c2974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.075566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4646581-ed92-42fb-b9e8-e3650a9c2974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:31.077029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4646581-ed92-42fb-b9e8-e3650a9c2974 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:31.079450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d916aa31-2fef-4941-8593-1291db89ba41 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:31.081052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d916aa31-2fef-4941-8593-1291db89ba41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f4646581-ed92-42fb-b9e8-e3650a9c2974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:31.095086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:31.096225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:31.097371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:31.097371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:31.097371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:31.101305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 327/658] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:31.101900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4646581-ed92-42fb-b9e8-e3650a9c2974 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:31.155264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 332/659] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:31.156105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916aa31-2fef-4941-8593-1291db89ba41 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:31.222145 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4646581-ed92-42fb-b9e8-e3650a9c2974 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:31.247628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:31.264516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca99b8-008a-4263-8504-3e2a571847c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:31.265451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca99b8-008a-4263-8504-3e2a571847c7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.266014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca99b8-008a-4263-8504-3e2a571847c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.266705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca99b8-008a-4263-8504-3e2a571847c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.267892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca99b8-008a-4263-8504-3e2a571847c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:31.268381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca99b8-008a-4263-8504-3e2a571847c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:31.269931 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca99b8-008a-4263-8504-3e2a571847c7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:31.285068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916aa31-2fef-4941-8593-1291db89ba41 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:31.288054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 328/660] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:31.289095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca99b8-008a-4263-8504-3e2a571847c7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:31.326783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe91d0-eeef-4400-8266-8af7e621c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:31.327396 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe91d0-eeef-4400-8266-8af7e621c65e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.327657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe91d0-eeef-4400-8266-8af7e621c65e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.327948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe91d0-eeef-4400-8266-8af7e621c65e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.341473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:31.398359 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe91d0-eeef-4400-8266-8af7e621c65e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:31.400172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe91d0-eeef-4400-8266-8af7e621c65e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:31.405759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca99b8-008a-4263-8504-3e2a571847c7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:31.449197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d3af4-a229-4551-b210-1d1c5976f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:31.450137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3af4-a229-4551-b210-1d1c5976f54d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.450756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3af4-a229-4551-b210-1d1c5976f54d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.451172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3af4-a229-4551-b210-1d1c5976f54d None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.452242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d3af4-a229-4551-b210-1d1c5976f54d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:31.452691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d3af4-a229-4551-b210-1d1c5976f54d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:31.454642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d3af4-a229-4551-b210-1d1c5976f54d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:31.468331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 329/661] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:31.469398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d3af4-a229-4551-b210-1d1c5976f54d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:31.475674 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:31.513388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 333/662] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:31.513388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe91d0-eeef-4400-8266-8af7e621c65e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:31.582252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d3af4-a229-4551-b210-1d1c5976f54d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:31.585201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:31.613603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe91d0-eeef-4400-8266-8af7e621c65e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:31.619830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106a16c-dea0-41e7-ad6f-3306408afbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:31.620472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a16c-dea0-41e7-ad6f-3306408afbdf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.620741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a16c-dea0-41e7-ad6f-3306408afbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.621004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a16c-dea0-41e7-ad6f-3306408afbdf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.628853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106a16c-dea0-41e7-ad6f-3306408afbdf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:31.630300 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106a16c-dea0-41e7-ad6f-3306408afbdf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b106a16c-dea0-41e7-ad6f-3306408afbdf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:31.642308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:31.643299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 330/663] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:31.644227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106a16c-dea0-41e7-ad6f-3306408afbdf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:31.653655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4dcd-1012-41ea-a787-fe2374729644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:31.654392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4dcd-1012-41ea-a787-fe2374729644 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.654663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4dcd-1012-41ea-a787-fe2374729644 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.654931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4dcd-1012-41ea-a787-fe2374729644 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.665857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d4dcd-1012-41ea-a787-fe2374729644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d37d4dcd-1012-41ea-a787-fe2374729644 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:31.670612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:31.671506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:31.672375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 334/664] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:31.673063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4dcd-1012-41ea-a787-fe2374729644 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:31.705748 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:31.771348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106a16c-dea0-41e7-ad6f-3306408afbdf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:31.785543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4dcd-1012-41ea-a787-fe2374729644 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:31.806880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acdb89-1bd9-4176-8420-f262e0ba303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:31.807538 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acdb89-1bd9-4176-8420-f262e0ba303b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.807810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acdb89-1bd9-4176-8420-f262e0ba303b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.808082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acdb89-1bd9-4176-8420-f262e0ba303b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.815930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acdb89-1bd9-4176-8420-f262e0ba303b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:31.817385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acdb89-1bd9-4176-8420-f262e0ba303b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:31.824065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e0230-38b7-4336-bf5f-83d6dc501188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:31.824711 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e0230-38b7-4336-bf5f-83d6dc501188 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.825057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e0230-38b7-4336-bf5f-83d6dc501188 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.825239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e0230-38b7-4336-bf5f-83d6dc501188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c7acdb89-1bd9-4176-8420-f262e0ba303b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:31.830498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:31.831355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:31.832270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:31.832270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:31.832270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:31.832270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:31.832270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:31.832270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:31.832270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:31.832270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:31.836675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 331/665] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:31.837141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e0230-38b7-4336-bf5f-83d6dc501188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:31.837693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acdb89-1bd9-4176-8420-f262e0ba303b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:31.838715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e0230-38b7-4336-bf5f-83d6dc501188 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-697e0230-38b7-4336-bf5f-83d6dc501188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:31.853637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:31.854661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:31.855536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:31.855536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:31.855536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:31.855536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 335/666] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:31.855536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e0230-38b7-4336-bf5f-83d6dc501188 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:31.869119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:31.936334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:31.954155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acdb89-1bd9-4176-8420-f262e0ba303b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:31.954950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e0230-38b7-4336-bf5f-83d6dc501188 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:31.987691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa58d8-3a36-45e5-91b0-621d8dd0ad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:31.988298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa58d8-3a36-45e5-91b0-621d8dd0ad41 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.988578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa58d8-3a36-45e5-91b0-621d8dd0ad41 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.988831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa58d8-3a36-45e5-91b0-621d8dd0ad41 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.989554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa58d8-3a36-45e5-91b0-621d8dd0ad41 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:31.989875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa58d8-3a36-45e5-91b0-621d8dd0ad41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:31.990883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a2567-0e5c-4a9f-bcc5-cafaf462bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:31.991294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa58d8-3a36-45e5-91b0-621d8dd0ad41 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:31.991481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2567-0e5c-4a9f-bcc5-cafaf462bec9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:31.991751 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2567-0e5c-4a9f-bcc5-cafaf462bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:31.992012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2567-0e5c-4a9f-bcc5-cafaf462bec9 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:31.992683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a2567-0e5c-4a9f-bcc5-cafaf462bec9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:31.993140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a2567-0e5c-4a9f-bcc5-cafaf462bec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:31.994515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a2567-0e5c-4a9f-bcc5-cafaf462bec9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:32.007128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 336/667] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:32.007128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a2567-0e5c-4a9f-bcc5-cafaf462bec9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:32.011862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 332/668] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Sep 22 21:57:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:32.016487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa58d8-3a36-45e5-91b0-621d8dd0ad41 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:32.102406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:32.123339 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa58d8-3a36-45e5-91b0-621d8dd0ad41 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:32.124000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a2567-0e5c-4a9f-bcc5-cafaf462bec9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:32.159575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b521b5-6760-4c02-8cb2-d07875321565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:32.160202 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b521b5-6760-4c02-8cb2-d07875321565 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:32.160479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b521b5-6760-4c02-8cb2-d07875321565 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:32.160749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b521b5-6760-4c02-8cb2-d07875321565 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:32.161404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b521b5-6760-4c02-8cb2-d07875321565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:32.161704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b521b5-6760-4c02-8cb2-d07875321565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:32.163116 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b521b5-6760-4c02-8cb2-d07875321565 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:32.163323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60337307-d69d-477c-a43e-268958dcf762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:32.163925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60337307-d69d-477c-a43e-268958dcf762 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:32.164195 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60337307-d69d-477c-a43e-268958dcf762 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:32.164463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60337307-d69d-477c-a43e-268958dcf762 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:32.165179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60337307-d69d-477c-a43e-268958dcf762 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:32.165478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60337307-d69d-477c-a43e-268958dcf762 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:32.166943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60337307-d69d-477c-a43e-268958dcf762 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:32.179378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 333/669] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:32.179378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b521b5-6760-4c02-8cb2-d07875321565 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:32.188628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 337/670] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:32.188628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60337307-d69d-477c-a43e-268958dcf762 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:32.193878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:32.289754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b521b5-6760-4c02-8cb2-d07875321565 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:32.290071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60337307-d69d-477c-a43e-268958dcf762 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:32.324536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72076b-8493-4963-8353-6118b5016248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:32.324969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21c67c-2616-4e56-bafd-d794f23c875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:32.325204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72076b-8493-4963-8353-6118b5016248 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:32.325509 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72076b-8493-4963-8353-6118b5016248 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:32.325620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21c67c-2616-4e56-bafd-d794f23c875c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:32.325785 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72076b-8493-4963-8353-6118b5016248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:32.325899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21c67c-2616-4e56-bafd-d794f23c875c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:32.326087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21c67c-2616-4e56-bafd-d794f23c875c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:32.338211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72076b-8493-4963-8353-6118b5016248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:32.339698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72076b-8493-4963-8353-6118b5016248 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:32.341821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-9d72076b-8493-4963-8353-6118b5016248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:32.356372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:32.357309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:32.358218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:32.358218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:32.358218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:32.362291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 334/671] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:32.363131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72076b-8493-4963-8353-6118b5016248 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:32.397550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21c67c-2616-4e56-bafd-d794f23c875c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:32.399141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21c67c-2616-4e56-bafd-d794f23c875c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:32.402563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:32.482912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72076b-8493-4963-8353-6118b5016248 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:32.517180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 338/672] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:32.517180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21c67c-2616-4e56-bafd-d794f23c875c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:32.524129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cc361-6f5a-4a6c-9bd0-a89c6ce99005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:32.524870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cc361-6f5a-4a6c-9bd0-a89c6ce99005 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:32.525143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cc361-6f5a-4a6c-9bd0-a89c6ce99005 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:32.525407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cc361-6f5a-4a6c-9bd0-a89c6ce99005 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:32.532272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cc361-6f5a-4a6c-9bd0-a89c6ce99005 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:32.533708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cc361-6f5a-4a6c-9bd0-a89c6ce99005 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-417cc361-6f5a-4a6c-9bd0-a89c6ce99005 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:32.544843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:32.545733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:32.546643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:32.546643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:32.546643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:32.546643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:32.546643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:32.546643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:32.546643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:32.546643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:32.546643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 335/673] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:32.547515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cc361-6f5a-4a6c-9bd0-a89c6ce99005 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:32.603320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:32.622364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21c67c-2616-4e56-bafd-d794f23c875c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:32.625637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:32.651400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cc361-6f5a-4a6c-9bd0-a89c6ce99005 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:32.661913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6f339-db5b-4e02-888f-507176a94996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:32.662541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6f339-db5b-4e02-888f-507176a94996 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:32.662803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6f339-db5b-4e02-888f-507176a94996 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:32.663068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6f339-db5b-4e02-888f-507176a94996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:32.663787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6f339-db5b-4e02-888f-507176a94996 None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=2c639dece626449b9153943b388e52c3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:32.664095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6f339-db5b-4e02-888f-507176a94996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:32.665788 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6f339-db5b-4e02-888f-507176a94996 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:32.672166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 339/674] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:32 2022] GET /identity/v3/role_assignments?user.id=2c639dece626449b9153943b388e52c3&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:32.672957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6f339-db5b-4e02-888f-507176a94996 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:32.706385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed2d1-744a-48e7-be73-3b4467505e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:32.708208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed2d1-744a-48e7-be73-3b4467505e06 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:32.708768 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed2d1-744a-48e7-be73-3b4467505e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:32.709428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed2d1-744a-48e7-be73-3b4467505e06 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:32.710301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ed2d1-744a-48e7-be73-3b4467505e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:32.711399 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ed2d1-744a-48e7-be73-3b4467505e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:32.714029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ed2d1-744a-48e7-be73-3b4467505e06 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:32.736298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 336/675] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:32.736298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed2d1-744a-48e7-be73-3b4467505e06 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:32.811046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6f339-db5b-4e02-888f-507176a94996 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:32.849301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65677dc-3c11-4013-8753-6a4446f309a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:32.850101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65677dc-3c11-4013-8753-6a4446f309a8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:32.850496 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65677dc-3c11-4013-8753-6a4446f309a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:32.850854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65677dc-3c11-4013-8753-6a4446f309a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:32.864864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65677dc-3c11-4013-8753-6a4446f309a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:32.866513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65677dc-3c11-4013-8753-6a4446f309a8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:32.868252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed2d1-744a-48e7-be73-3b4467505e06 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a65677dc-3c11-4013-8753-6a4446f309a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:32.884222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:32.885402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:32.886404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:32.886404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:32.886404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:32.886404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 340/676] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:32.886640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65677dc-3c11-4013-8753-6a4446f309a8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:32.890786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:32.918143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708041f-5182-4d18-be74-6eff1aa7b2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:32.918362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:32.919142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708041f-5182-4d18-be74-6eff1aa7b2ed None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:32.919563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708041f-5182-4d18-be74-6eff1aa7b2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:32.920070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708041f-5182-4d18-be74-6eff1aa7b2ed None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:32.920779 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708041f-5182-4d18-be74-6eff1aa7b2ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:32.922147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708041f-5182-4d18-be74-6eff1aa7b2ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:32.923601 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708041f-5182-4d18-be74-6eff1aa7b2ed None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:32.936713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 337/677] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:32.937564 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708041f-5182-4d18-be74-6eff1aa7b2ed None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:33.015646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65677dc-3c11-4013-8753-6a4446f309a8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:33.050554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c2512-57a1-48d3-bfb6-f426271e9afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:33.051183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c2512-57a1-48d3-bfb6-f426271e9afa None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:33.051460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c2512-57a1-48d3-bfb6-f426271e9afa None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:33.051727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c2512-57a1-48d3-bfb6-f426271e9afa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:33.055893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708041f-5182-4d18-be74-6eff1aa7b2ed None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:33.060507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c2512-57a1-48d3-bfb6-f426271e9afa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:33.062018 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c2512-57a1-48d3-bfb6-f426271e9afa None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-955c2512-57a1-48d3-bfb6-f426271e9afa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:33.073743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:33.074753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:33.076110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:33.076110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:33.076110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:33.076110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:33.076110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:33.076110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:33.076110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:33.076110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:33.076110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:33.076110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:33.076110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 341/678] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:33.080586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c2512-57a1-48d3-bfb6-f426271e9afa None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:33.099512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bc829-87cc-475f-9928-be579b371ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:33.100267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bc829-87cc-475f-9928-be579b371ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:33.100633 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bc829-87cc-475f-9928-be579b371ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:33.100995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bc829-87cc-475f-9928-be579b371ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:33.101765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bc829-87cc-475f-9928-be579b371ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:33.102400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bc829-87cc-475f-9928-be579b371ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:33.104147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bc829-87cc-475f-9928-be579b371ba6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:33.116583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 338/679] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:33.121196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bc829-87cc-475f-9928-be579b371ba6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:33.157891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:33.167474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:33.189891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c2512-57a1-48d3-bfb6-f426271e9afa None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:33.227507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bc829-87cc-475f-9928-be579b371ba6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:33.227923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ff779-813d-4088-94fe-58f31cea1262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:33.228460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ff779-813d-4088-94fe-58f31cea1262 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:33.228734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ff779-813d-4088-94fe-58f31cea1262 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:33.229158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ff779-813d-4088-94fe-58f31cea1262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:33.230745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ff779-813d-4088-94fe-58f31cea1262 None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=d22e60fc95af4a0a94b15f9ed9e3e73f) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:33.231057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ff779-813d-4088-94fe-58f31cea1262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:33.232498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ff779-813d-4088-94fe-58f31cea1262 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:33.247981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 342/680] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:33 2022] GET /identity/v3/role_assignments?user.id=d22e60fc95af4a0a94b15f9ed9e3e73f&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:33.247981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a081cd-99a0-4e05-852e-120f78b7bad3 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:33.247981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a081cd-99a0-4e05-852e-120f78b7bad3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:33.247981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a081cd-99a0-4e05-852e-120f78b7bad3 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:33.247981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 343/681] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:33.247981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a081cd-99a0-4e05-852e-120f78b7bad3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:33.281249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e5db4-c9ef-4728-b3f4-758ab986df12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:33.282183 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5db4-c9ef-4728-b3f4-758ab986df12 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:33.282467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5db4-c9ef-4728-b3f4-758ab986df12 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:33.282739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5db4-c9ef-4728-b3f4-758ab986df12 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:33.283684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e5db4-c9ef-4728-b3f4-758ab986df12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:33.284335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e5db4-c9ef-4728-b3f4-758ab986df12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:33.286143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e5db4-c9ef-4728-b3f4-758ab986df12 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:33.313201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 339/682] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 22 21:57:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:33.319612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dceb9-3d68-4364-a5ea-6857b9db880c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:33.319892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dceb9-3d68-4364-a5ea-6857b9db880c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:33.320146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dceb9-3d68-4364-a5ea-6857b9db880c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:33.342229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c56dceb9-3d68-4364-a5ea-6857b9db880c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:33.343519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c56dceb9-3d68-4364-a5ea-6857b9db880c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:33.376942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a081cd-99a0-4e05-852e-120f78b7bad3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:33.415105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12a6ab-7de6-4bf7-b26c-700448c2438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:33.416067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12a6ab-7de6-4bf7-b26c-700448c2438e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:33.417082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12a6ab-7de6-4bf7-b26c-700448c2438e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:33.417623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12a6ab-7de6-4bf7-b26c-700448c2438e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:33.427987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12a6ab-7de6-4bf7-b26c-700448c2438e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:33.430076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12a6ab-7de6-4bf7-b26c-700448c2438e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:33.437867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 340/683] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:33.437867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dceb9-3d68-4364-a5ea-6857b9db880c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2c12a6ab-7de6-4bf7-b26c-700448c2438e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:33.456719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:33.457662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:33.458588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:33.458588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:33.458588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:33.458588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:33.458588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:33.458588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:33.458588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:33.458588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:33.459779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 344/684] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:33.466812 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12a6ab-7de6-4bf7-b26c-700448c2438e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:33.473862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:33.481972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:33.581809 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dceb9-3d68-4364-a5ea-6857b9db880c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:33.600625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12a6ab-7de6-4bf7-b26c-700448c2438e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:33.624300 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbd996-caf1-4e1b-9247-630853cc9aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:33.624930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd996-caf1-4e1b-9247-630853cc9aca None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:33.625259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd996-caf1-4e1b-9247-630853cc9aca None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:33.625531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd996-caf1-4e1b-9247-630853cc9aca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:33.656796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd703e2-9db9-423c-9226-3d0ff135088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:33.657425 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd703e2-9db9-423c-9226-3d0ff135088c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:33.657697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd703e2-9db9-423c-9226-3d0ff135088c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:33.657995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd703e2-9db9-423c-9226-3d0ff135088c None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:33.658693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd703e2-9db9-423c-9226-3d0ff135088c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:33.660313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd703e2-9db9-423c-9226-3d0ff135088c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:33.660522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd703e2-9db9-423c-9226-3d0ff135088c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:33.678667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 345/685] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:33.684795 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd703e2-9db9-423c-9226-3d0ff135088c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:33.730883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbd996-caf1-4e1b-9247-630853cc9aca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:33.732368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbd996-caf1-4e1b-9247-630853cc9aca None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:33.759486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:33.765673 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:33.816071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd703e2-9db9-423c-9226-3d0ff135088c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:33.850488 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dbd0b-8cdb-4fce-a73f-6ab8e987c4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:33.851130 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dbd0b-8cdb-4fce-a73f-6ab8e987c4bd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:33.851346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dbd0b-8cdb-4fce-a73f-6ab8e987c4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:33.851619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dbd0b-8cdb-4fce-a73f-6ab8e987c4bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:33.852394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dbd0b-8cdb-4fce-a73f-6ab8e987c4bd None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=d512b60a42ed456a82dff11d17b77c06) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:33.852701 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dbd0b-8cdb-4fce-a73f-6ab8e987c4bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:33.853200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 341/686] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:33.854087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbd996-caf1-4e1b-9247-630853cc9aca None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:33.858354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dbd0b-8cdb-4fce-a73f-6ab8e987c4bd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:33.865360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 346/687] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:33 2022] GET /identity/v3/role_assignments?user.id=d512b60a42ed456a82dff11d17b77c06&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:33.866196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dbd0b-8cdb-4fce-a73f-6ab8e987c4bd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:33.974501 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbd996-caf1-4e1b-9247-630853cc9aca None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:34.015920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710a94-4abe-4876-9eca-a83223a425cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:34.016565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710a94-4abe-4876-9eca-a83223a425cc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:34.016835 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710a94-4abe-4876-9eca-a83223a425cc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:34.017098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710a94-4abe-4876-9eca-a83223a425cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:34.026244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:34.035310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54710a94-4abe-4876-9eca-a83223a425cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-54710a94-4abe-4876-9eca-a83223a425cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:34.044041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:34.045275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:34.046336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 342/688] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:34.052193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710a94-4abe-4876-9eca-a83223a425cc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:34.132462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dbd0b-8cdb-4fce-a73f-6ab8e987c4bd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:34.171257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:34.184831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641060e3-f041-4f66-aa54-965d1ffec412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:34.185471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641060e3-f041-4f66-aa54-965d1ffec412 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:34.185741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641060e3-f041-4f66-aa54-965d1ffec412 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:34.186036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641060e3-f041-4f66-aa54-965d1ffec412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:34.200064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641060e3-f041-4f66-aa54-965d1ffec412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:34.201683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641060e3-f041-4f66-aa54-965d1ffec412 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:34.202471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710a94-4abe-4876-9eca-a83223a425cc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-641060e3-f041-4f66-aa54-965d1ffec412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:34.220911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:34.222163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:34.223226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:34.223226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:34.223226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:34.225116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 347/689] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:34.232234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641060e3-f041-4f66-aa54-965d1ffec412 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:34.240401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4bbda-ceac-4432-b103-a9015ea2ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:34.241071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4bbda-ceac-4432-b103-a9015ea2ba2f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:34.241350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4bbda-ceac-4432-b103-a9015ea2ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:34.241624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4bbda-ceac-4432-b103-a9015ea2ba2f None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:34.242310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4bbda-ceac-4432-b103-a9015ea2ba2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:34.242634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4bbda-ceac-4432-b103-a9015ea2ba2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:34.244192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4bbda-ceac-4432-b103-a9015ea2ba2f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:34.252944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 343/690] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:34.259070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4bbda-ceac-4432-b103-a9015ea2ba2f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:34.305238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:34.393224 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4bbda-ceac-4432-b103-a9015ea2ba2f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:34.397444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641060e3-f041-4f66-aa54-965d1ffec412 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:34.430678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ab247-38f3-4025-a947-1550dd992d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:34.431603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ab247-38f3-4025-a947-1550dd992d32 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:34.431881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ab247-38f3-4025-a947-1550dd992d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:34.432152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ab247-38f3-4025-a947-1550dd992d32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:34.444659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ab247-38f3-4025-a947-1550dd992d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:34.446932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ab247-38f3-4025-a947-1550dd992d32 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:34.461185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec8ca9-4791-42d0-ba38-607c592aa360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:34.462327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8ca9-4791-42d0-ba38-607c592aa360 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:34.462738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8ca9-4791-42d0-ba38-607c592aa360 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:34.463138 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8ca9-4791-42d0-ba38-607c592aa360 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-807ab247-38f3-4025-a947-1550dd992d32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:34.464098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:34.465276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:34.466401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:34.466401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:34.466401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:34.466611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec8ca9-4791-42d0-ba38-607c592aa360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:34.466611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec8ca9-4791-42d0-ba38-607c592aa360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:34.466760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 344/691] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:34.466841 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec8ca9-4791-42d0-ba38-607c592aa360 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:34.474909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ab247-38f3-4025-a947-1550dd992d32 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:34.501332 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 348/692] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:34.506856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec8ca9-4791-42d0-ba38-607c592aa360 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:34.551212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:34.627442 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec8ca9-4791-42d0-ba38-607c592aa360 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:34.666573 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:34.671549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926146ae-e9f3-43f5-82b1-ed83ab6dd73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:34.672645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926146ae-e9f3-43f5-82b1-ed83ab6dd73a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:34.672939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926146ae-e9f3-43f5-82b1-ed83ab6dd73a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:34.673362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926146ae-e9f3-43f5-82b1-ed83ab6dd73a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:34.677403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ab247-38f3-4025-a947-1550dd992d32 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:34.681717 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926146ae-e9f3-43f5-82b1-ed83ab6dd73a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:34.684203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926146ae-e9f3-43f5-82b1-ed83ab6dd73a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-926146ae-e9f3-43f5-82b1-ed83ab6dd73a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:34.697432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:34.698402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:34.699272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:34.699272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:34.699272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:34.699272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:34.699272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:34.699272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:34.699272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:34.699272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:34.699272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 349/693] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:34.704771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926146ae-e9f3-43f5-82b1-ed83ab6dd73a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:34.757772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755ee3b-0eb7-4501-a728-34953bd325e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:34.758674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755ee3b-0eb7-4501-a728-34953bd325e8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:34.758953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755ee3b-0eb7-4501-a728-34953bd325e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:34.759222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755ee3b-0eb7-4501-a728-34953bd325e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:34.759878 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755ee3b-0eb7-4501-a728-34953bd325e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:34.760174 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755ee3b-0eb7-4501-a728-34953bd325e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:34.761541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755ee3b-0eb7-4501-a728-34953bd325e8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:34.787983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 345/694] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:34.798843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755ee3b-0eb7-4501-a728-34953bd325e8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:34.827239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:34.831297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926146ae-e9f3-43f5-82b1-ed83ab6dd73a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:34.871971 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f724239-0ff7-49cd-9826-f071044f58c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:34.872615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f724239-0ff7-49cd-9826-f071044f58c1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:34.872857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f724239-0ff7-49cd-9826-f071044f58c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:34.873127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f724239-0ff7-49cd-9826-f071044f58c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:34.874090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f724239-0ff7-49cd-9826-f071044f58c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:34.874195 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f724239-0ff7-49cd-9826-f071044f58c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:34.875578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f724239-0ff7-49cd-9826-f071044f58c1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:34.889881 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 350/695] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:34.896255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f724239-0ff7-49cd-9826-f071044f58c1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:35.011159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f724239-0ff7-49cd-9826-f071044f58c1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:35.052743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b15e8-559a-4906-acfe-51ab0037b723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:35.053727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b15e8-559a-4906-acfe-51ab0037b723 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:35.054043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b15e8-559a-4906-acfe-51ab0037b723 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:35.054310 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b15e8-559a-4906-acfe-51ab0037b723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:35.055032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b15e8-559a-4906-acfe-51ab0037b723 None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=f9967ef46a464ff2b5f7e4c459f8abd9) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:35.055406 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b15e8-559a-4906-acfe-51ab0037b723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:35.056934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b15e8-559a-4906-acfe-51ab0037b723 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:35.063694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 351/696] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:34 2022] GET /identity/v3/role_assignments?user.id=f9967ef46a464ff2b5f7e4c459f8abd9&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:35.102599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755ee3b-0eb7-4501-a728-34953bd325e8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:35.141002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa56bd-9db6-4f64-8a2a-faf3a0c0b24e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:35.141371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa56bd-9db6-4f64-8a2a-faf3a0c0b24e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:35.141560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa56bd-9db6-4f64-8a2a-faf3a0c0b24e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:35.143902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 352/697] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:35.150829 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171c24-4256-4f07-85e8-2ca9cee082fe None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:35.151173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171c24-4256-4f07-85e8-2ca9cee082fe None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:35.151369 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171c24-4256-4f07-85e8-2ca9cee082fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:35.178870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d7c1d-da4c-4cc5-9e6b-1b172a9071ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:35.179537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7c1d-da4c-4cc5-9e6b-1b172a9071ab None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:35.179815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7c1d-da4c-4cc5-9e6b-1b172a9071ab None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:35.180113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7c1d-da4c-4cc5-9e6b-1b172a9071ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:35.181610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d3171c24-4256-4f07-85e8-2ca9cee082fe None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:35.182864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d3171c24-4256-4f07-85e8-2ca9cee082fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:35.192951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d7c1d-da4c-4cc5-9e6b-1b172a9071ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:35.194485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d7c1d-da4c-4cc5-9e6b-1b172a9071ab None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fc0d7c1d-da4c-4cc5-9e6b-1b172a9071ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:35.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:35.220748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:35.221698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:35.221698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:35.221698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:35.221698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:35.221698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:35.221698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:35.221698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:35.221698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:35.221698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:35.221698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:35.222923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:35.226434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 346/698] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 22 21:57:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:35.228499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d7c1d-da4c-4cc5-9e6b-1b172a9071ab None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:35.277661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:35.302777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 353/699] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:57:35.382321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d7c1d-da4c-4cc5-9e6b-1b172a9071ab None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:35.420530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce131d-b166-46be-baf0-efe4ffb08e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:35.421505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce131d-b166-46be-baf0-efe4ffb08e45 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:35.422089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce131d-b166-46be-baf0-efe4ffb08e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:35.422572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce131d-b166-46be-baf0-efe4ffb08e45 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:35.423494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce131d-b166-46be-baf0-efe4ffb08e45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:35.423983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce131d-b166-46be-baf0-efe4ffb08e45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:35.425603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce131d-b166-46be-baf0-efe4ffb08e45 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:35.445061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 347/700] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 22 21:57:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:35.450493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171c24-4256-4f07-85e8-2ca9cee082fe None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:35.568808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171c24-4256-4f07-85e8-2ca9cee082fe None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:35.611734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9591-cd22-4b2c-8fec-7336dceaf430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:35.612354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9591-cd22-4b2c-8fec-7336dceaf430 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:35.612641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9591-cd22-4b2c-8fec-7336dceaf430 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:35.612895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9591-cd22-4b2c-8fec-7336dceaf430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:35.618189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce131d-b166-46be-baf0-efe4ffb08e45 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:35.648551 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:35.735285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd9591-cd22-4b2c-8fec-7336dceaf430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:35.737056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd9591-cd22-4b2c-8fec-7336dceaf430 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:35.782207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:35.793636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce131d-b166-46be-baf0-efe4ffb08e45 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:35.849715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dc0ee-8f8e-49f0-9685-7c8ebe174aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:35.851358 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dc0ee-8f8e-49f0-9685-7c8ebe174aec None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:35.853487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dc0ee-8f8e-49f0-9685-7c8ebe174aec None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:35.854171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dc0ee-8f8e-49f0-9685-7c8ebe174aec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:35.856644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dc0ee-8f8e-49f0-9685-7c8ebe174aec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:35.859090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dc0ee-8f8e-49f0-9685-7c8ebe174aec None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7b6dc0ee-8f8e-49f0-9685-7c8ebe174aec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:35.880401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:35.881467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 21:57:35.882425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:35.891082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 348/701] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Sep 22 21:57:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:35.892238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dc0ee-8f8e-49f0-9685-7c8ebe174aec None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:35.954017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 354/702] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 21:57:35.963175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9591-cd22-4b2c-8fec-7336dceaf430 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:36.023637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:36.084419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9591-cd22-4b2c-8fec-7336dceaf430 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:36.098324 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dc0ee-8f8e-49f0-9685-7c8ebe174aec None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:36.131153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce367760-39b8-44f2-9cc7-c2bad65fdd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:36.131912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce367760-39b8-44f2-9cc7-c2bad65fdd60 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:36.132191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce367760-39b8-44f2-9cc7-c2bad65fdd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:36.132554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce367760-39b8-44f2-9cc7-c2bad65fdd60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:36.134854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864a72c-7df4-4ac2-8c66-2f887379741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:36.135544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864a72c-7df4-4ac2-8c66-2f887379741a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:36.135945 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864a72c-7df4-4ac2-8c66-2f887379741a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:36.136269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864a72c-7df4-4ac2-8c66-2f887379741a None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:36.136966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864a72c-7df4-4ac2-8c66-2f887379741a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:36.137325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864a72c-7df4-4ac2-8c66-2f887379741a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:36.138790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864a72c-7df4-4ac2-8c66-2f887379741a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:36.144562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce367760-39b8-44f2-9cc7-c2bad65fdd60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:36.146116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce367760-39b8-44f2-9cc7-c2bad65fdd60 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:36.148967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 349/703] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 22 21:57:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:36.150340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405417eb-521b-4dd6-832b-aced98a71504 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:36.150622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405417eb-521b-4dd6-832b-aced98a71504 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:36.150894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405417eb-521b-4dd6-832b-aced98a71504 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:36.152660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 350/704] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:36.153567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405417eb-521b-4dd6-832b-aced98a71504 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:36.156830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ce367760-39b8-44f2-9cc7-c2bad65fdd60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:36.166522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:36.167503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:36.168397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:36.168397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:36.168397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:36.171443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 355/705] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:36.176224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546b0c7-2162-4785-857a-46d11bed645e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:36.176224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546b0c7-2162-4785-857a-46d11bed645e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:36.176224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546b0c7-2162-4785-857a-46d11bed645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:36.194254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3546b0c7-2162-4785-857a-46d11bed645e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:36.195428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3546b0c7-2162-4785-857a-46d11bed645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:36.266349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 356/706] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:36.267304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546b0c7-2162-4785-857a-46d11bed645e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:36.280664 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405417eb-521b-4dd6-832b-aced98a71504 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:36.318750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd0b16-2916-4ce9-af93-fc7c0a8ddde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:36.319746 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd0b16-2916-4ce9-af93-fc7c0a8ddde0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:36.320222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd0b16-2916-4ce9-af93-fc7c0a8ddde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:36.320784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd0b16-2916-4ce9-af93-fc7c0a8ddde0 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:36.321627 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd0b16-2916-4ce9-af93-fc7c0a8ddde0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:36.322172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd0b16-2916-4ce9-af93-fc7c0a8ddde0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:36.323029 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:36.324381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd0b16-2916-4ce9-af93-fc7c0a8ddde0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:36.331134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 351/707] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 22 21:57:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:36.434459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546b0c7-2162-4785-857a-46d11bed645e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:36.504335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602abe4d-f968-4ed6-8572-3ed4c6beb343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:36.504994 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abe4d-f968-4ed6-8572-3ed4c6beb343 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:36.505272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abe4d-f968-4ed6-8572-3ed4c6beb343 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:36.505547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abe4d-f968-4ed6-8572-3ed4c6beb343 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:36.506262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602abe4d-f968-4ed6-8572-3ed4c6beb343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:36.506560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602abe4d-f968-4ed6-8572-3ed4c6beb343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:36.507991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602abe4d-f968-4ed6-8572-3ed4c6beb343 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:36.526239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 357/708] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:36.531808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd0b16-2916-4ce9-af93-fc7c0a8ddde0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:36.551445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179945-4b8b-485a-8f53-3c85ab3928dc None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:36.551780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179945-4b8b-485a-8f53-3c85ab3928dc None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:36.551991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179945-4b8b-485a-8f53-3c85ab3928dc None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:36.553361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 358/709] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:36.562664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d03cd-0ab7-4acc-90f2-53f1788bbac1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:36.562981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d03cd-0ab7-4acc-90f2-53f1788bbac1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:36.563219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d03cd-0ab7-4acc-90f2-53f1788bbac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:36.593630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-819d03cd-0ab7-4acc-90f2-53f1788bbac1 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:36.595453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-819d03cd-0ab7-4acc-90f2-53f1788bbac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:36.612815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:36.654725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd0b16-2916-4ce9-af93-fc7c0a8ddde0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:36.673207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 359/710] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:57:36.674092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d03cd-0ab7-4acc-90f2-53f1788bbac1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:36.689107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1ab9f-b104-4aec-adfe-497aa8067dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:36.689672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1ab9f-b104-4aec-adfe-497aa8067dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:36.689974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1ab9f-b104-4aec-adfe-497aa8067dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:36.690291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1ab9f-b104-4aec-adfe-497aa8067dc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:36.697492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1ab9f-b104-4aec-adfe-497aa8067dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:36.699526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1ab9f-b104-4aec-adfe-497aa8067dc9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-bbd1ab9f-b104-4aec-adfe-497aa8067dc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:36.727285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:36.728213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:36.729168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:36.729168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:36.729168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:36.729168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:36.729168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:36.729168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:36.729168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:36.729168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:36.729168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 352/711] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:36.730459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:36.734372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1ab9f-b104-4aec-adfe-497aa8067dc9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:36.852147 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d03cd-0ab7-4acc-90f2-53f1788bbac1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:36.911943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1ab9f-b104-4aec-adfe-497aa8067dc9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:36.927249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0d346-e82b-4690-b2b3-8d4856ab2da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:36.927895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0d346-e82b-4690-b2b3-8d4856ab2da9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:36.928166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0d346-e82b-4690-b2b3-8d4856ab2da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:36.928429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0d346-e82b-4690-b2b3-8d4856ab2da9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:36.949606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0d346-e82b-4690-b2b3-8d4856ab2da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:36.951018 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0d346-e82b-4690-b2b3-8d4856ab2da9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:36.964848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:36.976017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca6b8e-12e9-4e6f-866a-9dc19b04a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:36.976637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca6b8e-12e9-4e6f-866a-9dc19b04a5af None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:36.976907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca6b8e-12e9-4e6f-866a-9dc19b04a5af None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:36.976907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca6b8e-12e9-4e6f-866a-9dc19b04a5af None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:36.978018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca6b8e-12e9-4e6f-866a-9dc19b04a5af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:36.978322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca6b8e-12e9-4e6f-866a-9dc19b04a5af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a8f0d346-e82b-4690-b2b3-8d4856ab2da9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:36.978910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:36.980128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:36.981093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:36.981093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:36.981093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:36.981270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca6b8e-12e9-4e6f-866a-9dc19b04a5af None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:36.983371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 360/712] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:36.988854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0d346-e82b-4690-b2b3-8d4856ab2da9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:36.994129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 353/713] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:37.004653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca6b8e-12e9-4e6f-866a-9dc19b04a5af None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:37.081511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:37.110460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0d346-e82b-4690-b2b3-8d4856ab2da9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:37.126894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca6b8e-12e9-4e6f-866a-9dc19b04a5af None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:37.149636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7d7cc-4e2f-4a4d-b4b4-601355be87a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:37.150617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7d7cc-4e2f-4a4d-b4b4-601355be87a2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:37.151119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7d7cc-4e2f-4a4d-b4b4-601355be87a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:37.151582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7d7cc-4e2f-4a4d-b4b4-601355be87a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:37.152424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7d7cc-4e2f-4a4d-b4b4-601355be87a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:37.152921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7d7cc-4e2f-4a4d-b4b4-601355be87a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:37.154509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7d7cc-4e2f-4a4d-b4b4-601355be87a2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:37.172013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f0d73-c5e0-4cd7-95c5-ea5026c6ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:37.172013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f0d73-c5e0-4cd7-95c5-ea5026c6ec17 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:37.172013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f0d73-c5e0-4cd7-95c5-ea5026c6ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:37.172013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f0d73-c5e0-4cd7-95c5-ea5026c6ec17 None admin] PATH_INFO: `/v3/services/network` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:37.172732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f0d73-c5e0-4cd7-95c5-ea5026c6ec17 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:37.172732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f0d73-c5e0-4cd7-95c5-ea5026c6ec17 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:37.173333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 361/714] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:37.174513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7d7cc-4e2f-4a4d-b4b4-601355be87a2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e77f0d73-c5e0-4cd7-95c5-ea5026c6ec17 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:37.181928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:37.182917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:37.183756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 354/715] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:37 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:37.184542 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f0d73-c5e0-4cd7-95c5-ea5026c6ec17 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:37.246347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:37.306866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f0d73-c5e0-4cd7-95c5-ea5026c6ec17 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:37.307746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7d7cc-4e2f-4a4d-b4b4-601355be87a2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:37.347713 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1c58-3c93-4539-815f-86bb125d6a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:37.348718 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1c58-3c93-4539-815f-86bb125d6a1f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:37.349196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1c58-3c93-4539-815f-86bb125d6a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:37.349365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ede19-608a-46e0-84c0-f46578ab2e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:37.349815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1c58-3c93-4539-815f-86bb125d6a1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:37.350176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ede19-608a-46e0-84c0-f46578ab2e4d None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:37.350519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ede19-608a-46e0-84c0-f46578ab2e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:37.350859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ede19-608a-46e0-84c0-f46578ab2e4d None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:37.351381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1c58-3c93-4539-815f-86bb125d6a1f None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=a044973e9e84495dbf8d14e19fc84716) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:37.351625 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ede19-608a-46e0-84c0-f46578ab2e4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:37.352317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1c58-3c93-4539-815f-86bb125d6a1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:37.353269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ede19-608a-46e0-84c0-f46578ab2e4d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:37.354321 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1c58-3c93-4539-815f-86bb125d6a1f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:37.360594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 362/716] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:37 2022] GET /identity/v3/role_assignments?user.id=a044973e9e84495dbf8d14e19fc84716&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:37.361723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1c58-3c93-4539-815f-86bb125d6a1f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:37.365134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:37.386167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 355/717] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:57:37 2022] POST /identity/v3/users => generated 254 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:57:37.495767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1c58-3c93-4539-815f-86bb125d6a1f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:37.536641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0901e-f7ca-41bb-8488-8307b0d1d06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:37.537182 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0901e-f7ca-41bb-8488-8307b0d1d06d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:37.537451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0901e-f7ca-41bb-8488-8307b0d1d06d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:37.537714 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0901e-f7ca-41bb-8488-8307b0d1d06d None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:37.538482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0901e-f7ca-41bb-8488-8307b0d1d06d None admin] RBAC: Adding query filter params (name=network) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:37.538779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0901e-f7ca-41bb-8488-8307b0d1d06d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:37.540366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0901e-f7ca-41bb-8488-8307b0d1d06d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:37.546268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 363/718] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:57:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:37.554388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ede19-608a-46e0-84c0-f46578ab2e4d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:37.682989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ede19-608a-46e0-84c0-f46578ab2e4d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:37.691136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:37.730295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81b61f-44eb-4aaf-99e3-3a4522974c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:37.730917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b61f-44eb-4aaf-99e3-3a4522974c62 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:37.731187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b61f-44eb-4aaf-99e3-3a4522974c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:37.731452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b61f-44eb-4aaf-99e3-3a4522974c62 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:37.732086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81b61f-44eb-4aaf-99e3-3a4522974c62 None admin] RBAC: Adding query filter params (type=network) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:37.732384 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81b61f-44eb-4aaf-99e3-3a4522974c62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:37.733750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81b61f-44eb-4aaf-99e3-3a4522974c62 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:37.739089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 356/719] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:57:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:38.037126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4051-2bc7-472c-ad6e-65dd103bcc40 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:38.038193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4051-2bc7-472c-ad6e-65dd103bcc40 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:38.038681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4051-2bc7-472c-ad6e-65dd103bcc40 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:38.040570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 364/720] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:38.045993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452f83c-6022-471f-abf1-b1bc0825db5d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:38.046529 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452f83c-6022-471f-abf1-b1bc0825db5d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:38.047019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452f83c-6022-471f-abf1-b1bc0825db5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:38.067014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d452f83c-6022-471f-abf1-b1bc0825db5d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:38.068518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d452f83c-6022-471f-abf1-b1bc0825db5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:38.150760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 357/721] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:38.575236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f4051-2bc7-472c-ad6e-65dd103bcc40 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:38.662214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:38.712766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f4051-2bc7-472c-ad6e-65dd103bcc40 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:38.774904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf9921-7e16-416b-b27e-43cd884bc92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:38.775547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf9921-7e16-416b-b27e-43cd884bc92e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:38.775822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf9921-7e16-416b-b27e-43cd884bc92e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:38.776096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf9921-7e16-416b-b27e-43cd884bc92e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:38.794742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf9921-7e16-416b-b27e-43cd884bc92e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-1cdf9921-7e16-416b-b27e-43cd884bc92e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:38.799625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:38.800526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:38.801338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 365/722] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:38.808787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452f83c-6022-471f-abf1-b1bc0825db5d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:38.928132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:38.934783 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452f83c-6022-471f-abf1-b1bc0825db5d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:38.984987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c13f4-c7fc-42cf-a61b-aeda866fa4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:38.985612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c13f4-c7fc-42cf-a61b-aeda866fa4fa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:38.985919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c13f4-c7fc-42cf-a61b-aeda866fa4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:38.986190 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c13f4-c7fc-42cf-a61b-aeda866fa4fa None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:38.986866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c13f4-c7fc-42cf-a61b-aeda866fa4fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:38.987165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c13f4-c7fc-42cf-a61b-aeda866fa4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:38.988547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c13f4-c7fc-42cf-a61b-aeda866fa4fa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:38.997600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 358/723] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:39.003295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf9921-7e16-416b-b27e-43cd884bc92e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:39.062839 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f14b8-75d1-4ef7-a402-84416ca8eb0b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:39.063155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f14b8-75d1-4ef7-a402-84416ca8eb0b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:39.063389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f14b8-75d1-4ef7-a402-84416ca8eb0b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:39.064983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 359/724] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:39.075710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1bbb0-d21b-4c16-87cf-96dc626b1097 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:39.075984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1bbb0-d21b-4c16-87cf-96dc626b1097 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:39.076256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1bbb0-d21b-4c16-87cf-96dc626b1097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:39.099318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c5d1bbb0-d21b-4c16-87cf-96dc626b1097 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:39.100519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c5d1bbb0-d21b-4c16-87cf-96dc626b1097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:39.175227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 360/725] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 21:57:39.191497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf9921-7e16-416b-b27e-43cd884bc92e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:39.237031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:39.248787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f547e5-0178-472b-baf8-3d6407d188e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:39.249424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f547e5-0178-472b-baf8-3d6407d188e4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:39.249700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f547e5-0178-472b-baf8-3d6407d188e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:39.249993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f547e5-0178-472b-baf8-3d6407d188e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:39.269390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f547e5-0178-472b-baf8-3d6407d188e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:39.270872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f547e5-0178-472b-baf8-3d6407d188e4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-11f547e5-0178-472b-baf8-3d6407d188e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:39.295986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:39.296948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:39.297827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:39.297827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:39.297827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:39.297827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 366/726] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:39.304050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1bbb0-d21b-4c16-87cf-96dc626b1097 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:39.422194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1bbb0-d21b-4c16-87cf-96dc626b1097 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:39.426181 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:39.457214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664361c-ab1e-46eb-9ca2-f4c8196a2d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:39.457757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664361c-ab1e-46eb-9ca2-f4c8196a2d22 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:39.458064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664361c-ab1e-46eb-9ca2-f4c8196a2d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:39.458341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664361c-ab1e-46eb-9ca2-f4c8196a2d22 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:39.458995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664361c-ab1e-46eb-9ca2-f4c8196a2d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:39.459298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664361c-ab1e-46eb-9ca2-f4c8196a2d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:39.460673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664361c-ab1e-46eb-9ca2-f4c8196a2d22 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:39.473090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 361/727] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:39.478744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f547e5-0178-472b-baf8-3d6407d188e4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:39.557883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664361c-ab1e-46eb-9ca2-f4c8196a2d22 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:39.612722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f547e5-0178-472b-baf8-3d6407d188e4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:39.654248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06173f-78ec-44ee-95a4-7245b5d766ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:39.657668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06173f-78ec-44ee-95a4-7245b5d766ab None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:39.658174 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06173f-78ec-44ee-95a4-7245b5d766ab None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:39.658653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06173f-78ec-44ee-95a4-7245b5d766ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:39.672137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06173f-78ec-44ee-95a4-7245b5d766ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:39.678407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06173f-78ec-44ee-95a4-7245b5d766ab None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ba06173f-78ec-44ee-95a4-7245b5d766ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:39.698072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:39.699053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:39.699963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:39.699963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:39.699963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:39.699963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:39.699963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:39.699963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:39.699963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:39.699963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:39.699963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:39.699963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:39.704496 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 367/728] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:39.711753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06173f-78ec-44ee-95a4-7245b5d766ab None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:39.733354 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664361c-ab1e-46eb-9ca2-f4c8196a2d22 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:39.764473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:39.774369 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5848823-03b1-47f9-946b-b257621bf08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:39.774989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5848823-03b1-47f9-946b-b257621bf08c None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:39.775262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5848823-03b1-47f9-946b-b257621bf08c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:39.775533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5848823-03b1-47f9-946b-b257621bf08c None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:39.776248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5848823-03b1-47f9-946b-b257621bf08c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:39.777545 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5848823-03b1-47f9-946b-b257621bf08c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:39.800534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 362/729] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:57:39 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 21:57:39.805884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792a4f1-6724-4238-90a9-49956c6d759b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:39.805884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792a4f1-6724-4238-90a9-49956c6d759b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:39.805884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792a4f1-6724-4238-90a9-49956c6d759b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:39.805884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 363/730] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:39.810016 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683d6d3-ad7e-41ae-a921-7d6e899a31c6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:39.811077 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683d6d3-ad7e-41ae-a921-7d6e899a31c6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:39.811352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683d6d3-ad7e-41ae-a921-7d6e899a31c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:39.856282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06173f-78ec-44ee-95a4-7245b5d766ab None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:39.863089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7683d6d3-ad7e-41ae-a921-7d6e899a31c6 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:39.864311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7683d6d3-ad7e-41ae-a921-7d6e899a31c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:39.880671 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:39.908974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992ea93-44b1-4ce6-9ffb-f2790def4afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:39.910943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992ea93-44b1-4ce6-9ffb-f2790def4afb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:39.911227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992ea93-44b1-4ce6-9ffb-f2790def4afb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:39.911496 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992ea93-44b1-4ce6-9ffb-f2790def4afb None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:39.912233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992ea93-44b1-4ce6-9ffb-f2790def4afb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:39.912529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992ea93-44b1-4ce6-9ffb-f2790def4afb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:39.914005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992ea93-44b1-4ce6-9ffb-f2790def4afb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:39.956476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 368/731] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 22 21:57:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:39.958326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992ea93-44b1-4ce6-9ffb-f2790def4afb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:39.991804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 364/732] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:40.104426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:40.115084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992ea93-44b1-4ce6-9ffb-f2790def4afb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:40.152329 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96403d-9ab6-407f-9283-4b55175e4b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:40.152967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96403d-9ab6-407f-9283-4b55175e4b40 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:40.153240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96403d-9ab6-407f-9283-4b55175e4b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:40.153505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96403d-9ab6-407f-9283-4b55175e4b40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:40.232932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96403d-9ab6-407f-9283-4b55175e4b40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:40.234450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96403d-9ab6-407f-9283-4b55175e4b40 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:40.275164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b78a7f-bf03-4c10-a4d8-63cd11835323 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:40.275361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b78a7f-bf03-4c10-a4d8-63cd11835323 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:40.275589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b78a7f-bf03-4c10-a4d8-63cd11835323 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:40.277100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 365/733] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:40.283116 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2defd-8657-47ab-bb25-16843f92d763 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:40.283392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2defd-8657-47ab-bb25-16843f92d763 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:40.283662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2defd-8657-47ab-bb25-16843f92d763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:40.306993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e1d2defd-8657-47ab-bb25-16843f92d763 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:40.308557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e1d2defd-8657-47ab-bb25-16843f92d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:40.343408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:40.354362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 369/734] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:39 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 21:57:40.355601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96403d-9ab6-407f-9283-4b55175e4b40 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:40.401216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 366/735] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:40.402451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2defd-8657-47ab-bb25-16843f92d763 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:40.503926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96403d-9ab6-407f-9283-4b55175e4b40 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:40.531195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:40.576854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2fdec-961d-4ff8-a686-584163730941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:40.577483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2fdec-961d-4ff8-a686-584163730941 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:40.577753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2fdec-961d-4ff8-a686-584163730941 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:40.578040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2fdec-961d-4ff8-a686-584163730941 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:40.583577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2defd-8657-47ab-bb25-16843f92d763 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:40.602904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2fdec-961d-4ff8-a686-584163730941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7be2fdec-961d-4ff8-a686-584163730941 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:40.607933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:40.608821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:40.609639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:40.612629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 370/736] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:40.618863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2fdec-961d-4ff8-a686-584163730941 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:40.644351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063948-1220-4cda-af0d-aaef1457fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:40.645397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063948-1220-4cda-af0d-aaef1457fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:40.645725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063948-1220-4cda-af0d-aaef1457fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:40.646194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063948-1220-4cda-af0d-aaef1457fcd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:40.658554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7063948-1220-4cda-af0d-aaef1457fcd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:40.660473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7063948-1220-4cda-af0d-aaef1457fcd5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c7063948-1220-4cda-af0d-aaef1457fcd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:40.679718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:40.681072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:40.682224 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:40.682224 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:40.682224 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:40.685382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:40.689670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 367/737] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:40.691313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14282d3b-9641-478e-9e7e-0916b8791889 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:40.692122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14282d3b-9641-478e-9e7e-0916b8791889 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:40.692543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14282d3b-9641-478e-9e7e-0916b8791889 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:40.694662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 368/738] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:40.695543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14282d3b-9641-478e-9e7e-0916b8791889 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:40.743874 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2fdec-961d-4ff8-a686-584163730941 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:40.779250 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0cd04-369b-4496-a542-6bfd579abaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:40.779888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0cd04-369b-4496-a542-6bfd579abaa8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:40.780162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0cd04-369b-4496-a542-6bfd579abaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:40.780428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0cd04-369b-4496-a542-6bfd579abaa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:40.781089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0cd04-369b-4496-a542-6bfd579abaa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:40.781443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0cd04-369b-4496-a542-6bfd579abaa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:40.782847 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0cd04-369b-4496-a542-6bfd579abaa8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:40.791224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 371/739] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:40.792443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71f4e-54a0-4c5a-ba94-6f59c22c4966 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:40.792842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71f4e-54a0-4c5a-ba94-6f59c22c4966 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:40.792969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71f4e-54a0-4c5a-ba94-6f59c22c4966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:40.811677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-82b71f4e-54a0-4c5a-ba94-6f59c22c4966 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:40.813028 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-82b71f4e-54a0-4c5a-ba94-6f59c22c4966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:40.829207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14282d3b-9641-478e-9e7e-0916b8791889 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:40.855519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:40.869322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4e0de-abf5-4c09-9849-01b96985173c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:40.870039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4e0de-abf5-4c09-9849-01b96985173c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:40.870249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4e0de-abf5-4c09-9849-01b96985173c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:40.870518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4e0de-abf5-4c09-9849-01b96985173c None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:40.871171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4e0de-abf5-4c09-9849-01b96985173c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:40.871471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4e0de-abf5-4c09-9849-01b96985173c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:40.872840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4e0de-abf5-4c09-9849-01b96985173c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:40.885395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 369/740] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:40.886250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4e0de-abf5-4c09-9849-01b96985173c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:40.887313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 372/741] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 21:57:40.888392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b71f4e-54a0-4c5a-ba94-6f59c22c4966 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:40.935166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:40.994323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b71f4e-54a0-4c5a-ba94-6f59c22c4966 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:41.004125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4e0de-abf5-4c09-9849-01b96985173c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:41.036357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904367d-3326-47b2-9076-b7b2f71f5931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:41.037513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904367d-3326-47b2-9076-b7b2f71f5931 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:41.038369 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904367d-3326-47b2-9076-b7b2f71f5931 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:41.038816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904367d-3326-47b2-9076-b7b2f71f5931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:41.043696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8baab5-1079-482f-ba51-3e73ececf462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:41.044446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8baab5-1079-482f-ba51-3e73ececf462 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:41.044841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8baab5-1079-482f-ba51-3e73ececf462 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:41.045210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8baab5-1079-482f-ba51-3e73ececf462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:41.052086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904367d-3326-47b2-9076-b7b2f71f5931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:41.054139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904367d-3326-47b2-9076-b7b2f71f5931 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:41.058026 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8baab5-1079-482f-ba51-3e73ececf462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8e8baab5-1079-482f-ba51-3e73ececf462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:41.063160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:41.064198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:41.065023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:41.069956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 370/742] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:41.071046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8baab5-1079-482f-ba51-3e73ececf462 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9904367d-3326-47b2-9076-b7b2f71f5931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:41.073823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:41.074749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:41.075614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:41.075614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:41.075614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:41.078466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 373/743] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:41.079438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904367d-3326-47b2-9076-b7b2f71f5931 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:41.132964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:41.192047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:41.194485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8baab5-1079-482f-ba51-3e73ececf462 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:41.198319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904367d-3326-47b2-9076-b7b2f71f5931 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:41.231461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99999883-c611-49fa-8b4e-969400d07eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:41.232102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999883-c611-49fa-8b4e-969400d07eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:41.232382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999883-c611-49fa-8b4e-969400d07eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:41.232654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999883-c611-49fa-8b4e-969400d07eb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:41.233245 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049ca63-93c0-4996-99a1-75227e570f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:41.233926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ca63-93c0-4996-99a1-75227e570f67 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:41.234198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ca63-93c0-4996-99a1-75227e570f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:41.234460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ca63-93c0-4996-99a1-75227e570f67 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:41.235121 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049ca63-93c0-4996-99a1-75227e570f67 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:41.235414 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049ca63-93c0-4996-99a1-75227e570f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:41.236772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049ca63-93c0-4996-99a1-75227e570f67 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:41.240017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99999883-c611-49fa-8b4e-969400d07eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:41.241449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99999883-c611-49fa-8b4e-969400d07eb9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:41.250175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 374/744] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:41.250175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049ca63-93c0-4996-99a1-75227e570f67 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-99999883-c611-49fa-8b4e-969400d07eb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:41.253724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:41.254635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:41.255527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:41.255527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:41.255527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:41.255527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:41.255527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:41.255527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:41.255527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:41.255527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:41.255527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 371/745] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:41.255527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99999883-c611-49fa-8b4e-969400d07eb9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:41.360848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049ca63-93c0-4996-99a1-75227e570f67 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:41.361056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99999883-c611-49fa-8b4e-969400d07eb9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:41.364754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:41.396501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f55eb1-9e8c-4aaf-8b82-88df7ccea658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:41.397114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f55eb1-9e8c-4aaf-8b82-88df7ccea658 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:41.397387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f55eb1-9e8c-4aaf-8b82-88df7ccea658 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:41.397651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f55eb1-9e8c-4aaf-8b82-88df7ccea658 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:41.397980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10b1d2-bab1-4a12-9f08-7356c2b5afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:41.398319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f55eb1-9e8c-4aaf-8b82-88df7ccea658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:41.398593 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10b1d2-bab1-4a12-9f08-7356c2b5afb6 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:41.398689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f55eb1-9e8c-4aaf-8b82-88df7ccea658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:41.398978 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10b1d2-bab1-4a12-9f08-7356c2b5afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:41.399247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10b1d2-bab1-4a12-9f08-7356c2b5afb6 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:41.399896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10b1d2-bab1-4a12-9f08-7356c2b5afb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:41.400048 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f55eb1-9e8c-4aaf-8b82-88df7ccea658 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:41.401428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10b1d2-bab1-4a12-9f08-7356c2b5afb6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:41.412346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 375/746] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:41.413304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f55eb1-9e8c-4aaf-8b82-88df7ccea658 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:41.421505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 372/747] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:57:41 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:57:41.422442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10b1d2-bab1-4a12-9f08-7356c2b5afb6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:41.443900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:41.566846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f55eb1-9e8c-4aaf-8b82-88df7ccea658 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:41.576683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10b1d2-bab1-4a12-9f08-7356c2b5afb6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:41.617117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bd461-5c17-4547-b996-f97b5ee3da33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:41.618337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd461-5c17-4547-b996-f97b5ee3da33 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:41.618533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd461-5c17-4547-b996-f97b5ee3da33 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:41.619234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd461-5c17-4547-b996-f97b5ee3da33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:41.624999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75005e-6083-4122-8652-0103d7729ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:41.624999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75005e-6083-4122-8652-0103d7729ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:41.624999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75005e-6083-4122-8652-0103d7729ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:41.625275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75005e-6083-4122-8652-0103d7729ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:41.625905 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75005e-6083-4122-8652-0103d7729ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:41.626210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75005e-6083-4122-8652-0103d7729ad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:41.627792 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75005e-6083-4122-8652-0103d7729ad0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:41.629981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bd461-5c17-4547-b996-f97b5ee3da33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:41.632335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bd461-5c17-4547-b996-f97b5ee3da33 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:41.642366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 373/748] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:41.642537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75005e-6083-4122-8652-0103d7729ad0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-070bd461-5c17-4547-b996-f97b5ee3da33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:41.655595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:41.656604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:41.657506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:41.657506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:41.657506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:41.663105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 376/749] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:41.663105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bd461-5c17-4547-b996-f97b5ee3da33 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:41.665954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:41.741087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:41.756251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75005e-6083-4122-8652-0103d7729ad0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:41.775179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bd461-5c17-4547-b996-f97b5ee3da33 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:41.795440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d008e-4090-47fa-9da1-747669b9bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:41.796322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d008e-4090-47fa-9da1-747669b9bba4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:41.796840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d008e-4090-47fa-9da1-747669b9bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:41.797254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d008e-4090-47fa-9da1-747669b9bba4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:41.806757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d008e-4090-47fa-9da1-747669b9bba4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:41.808567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d008e-4090-47fa-9da1-747669b9bba4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:41.811910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081173b-5062-4806-a345-7e098be4f4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:41.812435 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081173b-5062-4806-a345-7e098be4f4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:41.812710 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081173b-5062-4806-a345-7e098be4f4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:41.812973 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081173b-5062-4806-a345-7e098be4f4c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:41.813707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081173b-5062-4806-a345-7e098be4f4c3 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=f9967ef46a464ff2b5f7e4c459f8abd9) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:41.814040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081173b-5062-4806-a345-7e098be4f4c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:41.815459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081173b-5062-4806-a345-7e098be4f4c3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:41.826726 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 377/750] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:41 2022] GET /identity/v3/role_assignments?user.id=f9967ef46a464ff2b5f7e4c459f8abd9&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:41.826726 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081173b-5062-4806-a345-7e098be4f4c3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a33d008e-4090-47fa-9da1-747669b9bba4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:41.827270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:41.828162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:41.829128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:41.829128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:41.829128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:41.829128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:41.829128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:41.829128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:41.829128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:41.829128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:41.829128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:41.829128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:41.837863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 374/751] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 22 21:57:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:41.837863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d008e-4090-47fa-9da1-747669b9bba4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:41.949876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:41.982878 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d008e-4090-47fa-9da1-747669b9bba4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:42.044295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081173b-5062-4806-a345-7e098be4f4c3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:42.057352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b63239-72ca-49dd-937f-2ba1a705c3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:42.058391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b63239-72ca-49dd-937f-2ba1a705c3cc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:42.058890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b63239-72ca-49dd-937f-2ba1a705c3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:42.059398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b63239-72ca-49dd-937f-2ba1a705c3cc None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:42.060341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b63239-72ca-49dd-937f-2ba1a705c3cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:42.060844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b63239-72ca-49dd-937f-2ba1a705c3cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:42.062514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b63239-72ca-49dd-937f-2ba1a705c3cc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:42.080756 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a36c-309e-4b96-8ed3-652145a5e93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:42.081373 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a36c-309e-4b96-8ed3-652145a5e93e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:42.081645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a36c-309e-4b96-8ed3-652145a5e93e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:42.081958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a36c-309e-4b96-8ed3-652145a5e93e None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:42.082602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9a36c-309e-4b96-8ed3-652145a5e93e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:42.082903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9a36c-309e-4b96-8ed3-652145a5e93e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:42.084355 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9a36c-309e-4b96-8ed3-652145a5e93e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:42.084588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 375/752] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 22 21:57:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:42.085808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:42.090213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b63239-72ca-49dd-937f-2ba1a705c3cc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:42.099596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 378/753] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:42.105545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a36c-309e-4b96-8ed3-652145a5e93e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:42.208353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b63239-72ca-49dd-937f-2ba1a705c3cc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:42.216705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a36c-309e-4b96-8ed3-652145a5e93e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:42.253230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11d37b-b123-421e-91b6-57ccd72b7d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:42.254039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11d37b-b123-421e-91b6-57ccd72b7d2d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:42.254368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11d37b-b123-421e-91b6-57ccd72b7d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:42.254643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11d37b-b123-421e-91b6-57ccd72b7d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:42.262537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba085c2-f5a5-4bdc-80ea-5f31cb853b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:42.263799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:42.263912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba085c2-f5a5-4bdc-80ea-5f31cb853b06 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:42.264388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba085c2-f5a5-4bdc-80ea-5f31cb853b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:42.265245 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba085c2-f5a5-4bdc-80ea-5f31cb853b06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:42.269987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11d37b-b123-421e-91b6-57ccd72b7d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:42.271521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11d37b-b123-421e-91b6-57ccd72b7d2d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:42.275697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba085c2-f5a5-4bdc-80ea-5f31cb853b06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:42.277396 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba085c2-f5a5-4bdc-80ea-5f31cb853b06 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-0b11d37b-b123-421e-91b6-57ccd72b7d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:42.289307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:42.291335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:42.292440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:42.292440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:42.292440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:42.292440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 376/754] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4ba085c2-f5a5-4bdc-80ea-5f31cb853b06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:42.294950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:42.295909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:42.296828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:42.296828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:42.296828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:42.296828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:42.296828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:42.296828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:42.296828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:42.296828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:42.296828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:57:42.296828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:42.302962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11d37b-b123-421e-91b6-57ccd72b7d2d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:42.303197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 379/755] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 22 21:57:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:42.304824 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba085c2-f5a5-4bdc-80ea-5f31cb853b06 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:42.380827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:42.432144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11d37b-b123-421e-91b6-57ccd72b7d2d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:42.438781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba085c2-f5a5-4bdc-80ea-5f31cb853b06 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:42.469626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b20ef8-c958-451a-81a1-abb48f9efdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:42.470365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20ef8-c958-451a-81a1-abb48f9efdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:42.470741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20ef8-c958-451a-81a1-abb48f9efdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:42.471263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20ef8-c958-451a-81a1-abb48f9efdc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:42.472330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b20ef8-c958-451a-81a1-abb48f9efdc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:42.472744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b20ef8-c958-451a-81a1-abb48f9efdc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:42.474507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b20ef8-c958-451a-81a1-abb48f9efdc5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:42.478340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97154547-1f46-4799-8739-ccba1f4fe548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:42.479145 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97154547-1f46-4799-8739-ccba1f4fe548 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:42.479562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97154547-1f46-4799-8739-ccba1f4fe548 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:42.479967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97154547-1f46-4799-8739-ccba1f4fe548 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:42.480842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97154547-1f46-4799-8739-ccba1f4fe548 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:42.481298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97154547-1f46-4799-8739-ccba1f4fe548 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:42.482999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97154547-1f46-4799-8739-ccba1f4fe548 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:42.487943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 377/756] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:42.489341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e07724-4c80-49aa-9aa3-479cd272e178 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:42.489725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e07724-4c80-49aa-9aa3-479cd272e178 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:42.490132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e07724-4c80-49aa-9aa3-479cd272e178 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:42.496082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 378/757] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:42.497924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e07724-4c80-49aa-9aa3-479cd272e178 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:42.511618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 380/758] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 22 21:57:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:42.513248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445922-250f-4470-a5c1-08941ba087ab None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:42.513698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445922-250f-4470-a5c1-08941ba087ab None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:42.514214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445922-250f-4470-a5c1-08941ba087ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:42.535341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-64445922-250f-4470-a5c1-08941ba087ab None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:42.537005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-64445922-250f-4470-a5c1-08941ba087ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:42.557655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:42.617406 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 381/759] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:57:42.619340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64445922-250f-4470-a5c1-08941ba087ab None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:42.631679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e07724-4c80-49aa-9aa3-479cd272e178 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:42.684433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef76ff9-f744-4742-8d60-19d1fae018bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:42.685376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef76ff9-f744-4742-8d60-19d1fae018bc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:42.685853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef76ff9-f744-4742-8d60-19d1fae018bc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:42.686383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef76ff9-f744-4742-8d60-19d1fae018bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:42.694461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef76ff9-f744-4742-8d60-19d1fae018bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:42.696866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef76ff9-f744-4742-8d60-19d1fae018bc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:42.708721 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4ef76ff9-f744-4742-8d60-19d1fae018bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:42.712845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:42.713748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:42.714660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:42.714660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:42.714660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:42.714660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:42.714660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:42.714660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:42.714660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:42.714660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:42.717630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 379/760] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:42.723077 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef76ff9-f744-4742-8d60-19d1fae018bc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:42.855823 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef76ff9-f744-4742-8d60-19d1fae018bc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:42.862452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64445922-250f-4470-a5c1-08941ba087ab None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:42.877414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:42.920607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416534a-d407-4594-a6f8-5ae0863566b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:42.921230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416534a-d407-4594-a6f8-5ae0863566b6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:42.921508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416534a-d407-4594-a6f8-5ae0863566b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:42.921780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416534a-d407-4594-a6f8-5ae0863566b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:42.922508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416534a-d407-4594-a6f8-5ae0863566b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:42.922811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416534a-d407-4594-a6f8-5ae0863566b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:42.924595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416534a-d407-4594-a6f8-5ae0863566b6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:42.929988 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65af778-1b79-4cbd-98a5-308e48e95d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:42.930889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af778-1b79-4cbd-98a5-308e48e95d9d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:42.931377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af778-1b79-4cbd-98a5-308e48e95d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:42.931789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af778-1b79-4cbd-98a5-308e48e95d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:42.938067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 380/761] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:42.938916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416534a-d407-4594-a6f8-5ae0863566b6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:43.013565 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65af778-1b79-4cbd-98a5-308e48e95d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:43.015936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65af778-1b79-4cbd-98a5-308e48e95d9d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:43.061212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416534a-d407-4594-a6f8-5ae0863566b6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:43.074251 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:43.107223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41591c0b-bdc4-4e19-ad97-56ec70e80121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:43.107860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591c0b-bdc4-4e19-ad97-56ec70e80121 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:43.108140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591c0b-bdc4-4e19-ad97-56ec70e80121 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:43.108409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591c0b-bdc4-4e19-ad97-56ec70e80121 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:43.109000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41591c0b-bdc4-4e19-ad97-56ec70e80121 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:43.110412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41591c0b-bdc4-4e19-ad97-56ec70e80121 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-41591c0b-bdc4-4e19-ad97-56ec70e80121 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:43.120912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:43.121984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:43.122803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 381/762] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Sep 22 21:57:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:43.123643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41591c0b-bdc4-4e19-ad97-56ec70e80121 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:43.143413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 382/763] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:57:43.144238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65af778-1b79-4cbd-98a5-308e48e95d9d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:43.163258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:43.233580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41591c0b-bdc4-4e19-ad97-56ec70e80121 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:43.252734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65af778-1b79-4cbd-98a5-308e48e95d9d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:43.272695 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf967a20-5997-4122-9d76-db20aa1bdf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:43.273673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf967a20-5997-4122-9d76-db20aa1bdf95 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:43.274246 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf967a20-5997-4122-9d76-db20aa1bdf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:43.274868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf967a20-5997-4122-9d76-db20aa1bdf95 None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/a044973e9e84495dbf8d14e19fc84716/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:43.276852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf967a20-5997-4122-9d76-db20aa1bdf95 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=a044973e9e84495dbf8d14e19fc84716, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:43.278875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf967a20-5997-4122-9d76-db20aa1bdf95 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:43.290487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f250e1d-21cb-4e00-8707-516d6d4abfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:43.291841 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f250e1d-21cb-4e00-8707-516d6d4abfaf None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:43.292347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f250e1d-21cb-4e00-8707-516d6d4abfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:43.292808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f250e1d-21cb-4e00-8707-516d6d4abfaf None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:43.293758 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f250e1d-21cb-4e00-8707-516d6d4abfaf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:43.294280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f250e1d-21cb-4e00-8707-516d6d4abfaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:43.295775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 382/764] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:57:43 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/a044973e9e84495dbf8d14e19fc84716/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:57:43.296140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f250e1d-21cb-4e00-8707-516d6d4abfaf None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:43.296727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf967a20-5997-4122-9d76-db20aa1bdf95 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:43.302263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 383/765] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 22 21:57:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:43.314862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f250e1d-21cb-4e00-8707-516d6d4abfaf None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:43.335534 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:43.416395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:43.423893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf967a20-5997-4122-9d76-db20aa1bdf95 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:43.463946 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7c326-80e8-4138-ac23-d64823eeda32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:43.464596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7c326-80e8-4138-ac23-d64823eeda32 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:43.464874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7c326-80e8-4138-ac23-d64823eeda32 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:43.465153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7c326-80e8-4138-ac23-d64823eeda32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:43.476719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7c326-80e8-4138-ac23-d64823eeda32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:43.478914 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7c326-80e8-4138-ac23-d64823eeda32 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-2dd7c326-80e8-4138-ac23-d64823eeda32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:43.495613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:43.496617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:43.497799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:43.497799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:43.497799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:43.497799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 383/766] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:43.507310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7c326-80e8-4138-ac23-d64823eeda32 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:43.541203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f250e1d-21cb-4e00-8707-516d6d4abfaf None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:43.599621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a1ce6-711f-448e-b34d-638f02bfe9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:43.600269 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1ce6-711f-448e-b34d-638f02bfe9ee None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:43.600544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1ce6-711f-448e-b34d-638f02bfe9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:43.600815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1ce6-711f-448e-b34d-638f02bfe9ee None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:43.601451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a1ce6-711f-448e-b34d-638f02bfe9ee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:43.601753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a1ce6-711f-448e-b34d-638f02bfe9ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:43.603340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a1ce6-711f-448e-b34d-638f02bfe9ee None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:43.612163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 384/767] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 22 21:57:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:43.619663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a1ce6-711f-448e-b34d-638f02bfe9ee None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:43.667350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7c326-80e8-4138-ac23-d64823eeda32 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:43.711965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b41de-6c01-4bac-a6db-f3d20b507dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:43.713088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b41de-6c01-4bac-a6db-f3d20b507dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:43.713672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b41de-6c01-4bac-a6db-f3d20b507dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:43.714162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b41de-6c01-4bac-a6db-f3d20b507dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:43.715010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b41de-6c01-4bac-a6db-f3d20b507dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:43.715701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b41de-6c01-4bac-a6db-f3d20b507dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:43.717285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b41de-6c01-4bac-a6db-f3d20b507dc3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:43.723609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:43.741864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 384/768] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:43.743991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b41de-6c01-4bac-a6db-f3d20b507dc3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:43.766586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a1ce6-711f-448e-b34d-638f02bfe9ee None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:43.767096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:43.802633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364bc78-0d9a-4c79-8c80-373ea8d20eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:43.803410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364bc78-0d9a-4c79-8c80-373ea8d20eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:43.803782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364bc78-0d9a-4c79-8c80-373ea8d20eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:43.804143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364bc78-0d9a-4c79-8c80-373ea8d20eb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:43.804954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364bc78-0d9a-4c79-8c80-373ea8d20eb9 None admin] RBAC: Adding query filter params (interface=public, service_id=5a0ba3d184c2482d9d893ac5a67b3656, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:43.805389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364bc78-0d9a-4c79-8c80-373ea8d20eb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:43.806934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364bc78-0d9a-4c79-8c80-373ea8d20eb9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:43.815524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 385/769] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 22 21:57:43 2022] GET /identity/v3/endpoints?service_id=5a0ba3d184c2482d9d893ac5a67b3656&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:43.821036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364bc78-0d9a-4c79-8c80-373ea8d20eb9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:43.962961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b41de-6c01-4bac-a6db-f3d20b507dc3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:44.011230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ec0ac-da8b-4673-9dac-66593bac5ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:44.011876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ec0ac-da8b-4673-9dac-66593bac5ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:44.012155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ec0ac-da8b-4673-9dac-66593bac5ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:44.012425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ec0ac-da8b-4673-9dac-66593bac5ed8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:44.014306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364bc78-0d9a-4c79-8c80-373ea8d20eb9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:44.020065 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ec0ac-da8b-4673-9dac-66593bac5ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:44.021559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ec0ac-da8b-4673-9dac-66593bac5ed8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f62ec0ac-da8b-4673-9dac-66593bac5ed8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:44.035532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:44.036502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:44.037400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:44.037400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:44.037400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:44.037400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:44.037400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:44.037400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:44.037400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:44.037400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:44.037400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 385/770] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:44.038204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372631-fae8-41fa-a944-9226431bac44 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:44.041857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372631-fae8-41fa-a944-9226431bac44 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:44.041857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372631-fae8-41fa-a944-9226431bac44 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:44.041857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 386/771] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:44.045941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9229fa-be93-47b7-90d6-a97ea1867754 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:44.046344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9229fa-be93-47b7-90d6-a97ea1867754 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:44.046623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9229fa-be93-47b7-90d6-a97ea1867754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:44.058526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b50b2-0f28-4475-92ed-5f66f1de9b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:44.059070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b50b2-0f28-4475-92ed-5f66f1de9b29 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:44.059339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b50b2-0f28-4475-92ed-5f66f1de9b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:44.059700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b50b2-0f28-4475-92ed-5f66f1de9b29 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:44.060304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b50b2-0f28-4475-92ed-5f66f1de9b29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:44.061665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b50b2-0f28-4475-92ed-5f66f1de9b29 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:44.062814 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:44.066631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ec9229fa-be93-47b7-90d6-a97ea1867754 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:44.067875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 386/772] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 22 21:57:43 2022] GET /identity/v3/services => generated 772 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:44.068186 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ec9229fa-be93-47b7-90d6-a97ea1867754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:44.068775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b50b2-0f28-4475-92ed-5f66f1de9b29 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:44.174230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:44.186519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 387/773] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:57:44.254530 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b50b2-0f28-4475-92ed-5f66f1de9b29 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:44.305173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae3954-830b-41bd-8cfa-30fc2bb3a521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:44.306120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3954-830b-41bd-8cfa-30fc2bb3a521 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:44.306120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3954-830b-41bd-8cfa-30fc2bb3a521 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:44.306585 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3954-830b-41bd-8cfa-30fc2bb3a521 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:44.307401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae3954-830b-41bd-8cfa-30fc2bb3a521 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:44.307711 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae3954-830b-41bd-8cfa-30fc2bb3a521 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:44.309281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae3954-830b-41bd-8cfa-30fc2bb3a521 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:44.330277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 387/774] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:44.337529 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9229fa-be93-47b7-90d6-a97ea1867754 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:44.442416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9a897-d5e5-47b4-9243-dba6005cc544 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:44.442693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9a897-d5e5-47b4-9243-dba6005cc544 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:44.442968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9a897-d5e5-47b4-9243-dba6005cc544 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:44.443711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9229fa-be93-47b7-90d6-a97ea1867754 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:44.444461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 388/775] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:44.450048 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00449f1-7971-4cb7-9155-8b341f1441f2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:44.450624 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00449f1-7971-4cb7-9155-8b341f1441f2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:44.451084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00449f1-7971-4cb7-9155-8b341f1441f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:44.473023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b00449f1-7971-4cb7-9155-8b341f1441f2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:44.474689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b00449f1-7971-4cb7-9155-8b341f1441f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:44.481475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae13a5e-17eb-4dd8-9a44-c234205f395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:44.482120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae13a5e-17eb-4dd8-9a44-c234205f395b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:44.482393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae13a5e-17eb-4dd8-9a44-c234205f395b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:44.482661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae13a5e-17eb-4dd8-9a44-c234205f395b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:44.483400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae13a5e-17eb-4dd8-9a44-c234205f395b None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=d51d2b73c22747f2b40bccc45352135f) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:44.483702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae13a5e-17eb-4dd8-9a44-c234205f395b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:44.485597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae13a5e-17eb-4dd8-9a44-c234205f395b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:44.495967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 388/776] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:44 2022] GET /identity/v3/role_assignments?user.id=d51d2b73c22747f2b40bccc45352135f&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:44.542456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae13a5e-17eb-4dd8-9a44-c234205f395b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:44.543281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:44.563415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 389/777] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:57:44.619080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:44.660895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae13a5e-17eb-4dd8-9a44-c234205f395b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:44.704380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c24794-adc4-4eca-b748-204575c940c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:44.705049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c24794-adc4-4eca-b748-204575c940c4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:44.705316 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c24794-adc4-4eca-b748-204575c940c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:44.705581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c24794-adc4-4eca-b748-204575c940c4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:44.706208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c24794-adc4-4eca-b748-204575c940c4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:44.707608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c24794-adc4-4eca-b748-204575c940c4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-12c24794-adc4-4eca-b748-204575c940c4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:44.723409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:44.724459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:44.725297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 389/778] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:44 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:44.733204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00449f1-7971-4cb7-9155-8b341f1441f2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:44.890213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00449f1-7971-4cb7-9155-8b341f1441f2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:44.936422 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fe0f7-d9f9-4754-93a1-15b9cc2fad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:44.937041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe0f7-d9f9-4754-93a1-15b9cc2fad93 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:44.937320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe0f7-d9f9-4754-93a1-15b9cc2fad93 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:44.937593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe0f7-d9f9-4754-93a1-15b9cc2fad93 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:44.938278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fe0f7-d9f9-4754-93a1-15b9cc2fad93 None admin] RBAC: Adding query filter params (name=network) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:44.938580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fe0f7-d9f9-4754-93a1-15b9cc2fad93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:44.939958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fe0f7-d9f9-4754-93a1-15b9cc2fad93 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:44.950276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 390/779] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:57:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:44.956038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c24794-adc4-4eca-b748-204575c940c4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:44.974254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fe0f7-d9f9-4754-93a1-15b9cc2fad93 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:45.083086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:45.142922 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c24794-adc4-4eca-b748-204575c940c4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:45.170902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fe0f7-d9f9-4754-93a1-15b9cc2fad93 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:45.191305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:45.213992 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2db61d-d283-49d6-bb89-80a0d0ae2a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:45.214978 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2db61d-d283-49d6-bb89-80a0d0ae2a4a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:45.215452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2db61d-d283-49d6-bb89-80a0d0ae2a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:45.215917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2db61d-d283-49d6-bb89-80a0d0ae2a4a None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:45.216794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2db61d-d283-49d6-bb89-80a0d0ae2a4a None admin] RBAC: Adding query filter params (type=network) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:45.217455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2db61d-d283-49d6-bb89-80a0d0ae2a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:45.220099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2db61d-d283-49d6-bb89-80a0d0ae2a4a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:45.230421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 390/780] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:57:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:45.237263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2db61d-d283-49d6-bb89-80a0d0ae2a4a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:45.248018 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d9469-4d2b-455c-b8d3-1abbc7e29f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:45.248962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9469-4d2b-455c-b8d3-1abbc7e29f7b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:45.249439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9469-4d2b-455c-b8d3-1abbc7e29f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:45.249935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9469-4d2b-455c-b8d3-1abbc7e29f7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:45.267578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d9469-4d2b-455c-b8d3-1abbc7e29f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-785d9469-4d2b-455c-b8d3-1abbc7e29f7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:45.277630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:45.278619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:45.279464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:45.284568 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 391/781] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:45.288535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d9469-4d2b-455c-b8d3-1abbc7e29f7b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:45.419924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2db61d-d283-49d6-bb89-80a0d0ae2a4a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:45.487489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279babe-1ee4-4b4b-b651-76f5ccac9a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:45.489966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d9469-4d2b-455c-b8d3-1abbc7e29f7b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:45.491143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279babe-1ee4-4b4b-b651-76f5ccac9a57 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:45.491620 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279babe-1ee4-4b4b-b651-76f5ccac9a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:45.492121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279babe-1ee4-4b4b-b651-76f5ccac9a57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:45.493067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279babe-1ee4-4b4b-b651-76f5ccac9a57 None admin] RBAC: Adding query filter params (interface=public, service_id=f1d74296d29e4d36b76b501ba774ba03, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:45.494972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279babe-1ee4-4b4b-b651-76f5ccac9a57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:45.496623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279babe-1ee4-4b4b-b651-76f5ccac9a57 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:45.512408 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 391/782] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 22 21:57:45 2022] GET /identity/v3/endpoints?service_id=f1d74296d29e4d36b76b501ba774ba03&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:45.516986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:45.518734 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279babe-1ee4-4b4b-b651-76f5ccac9a57 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:45.556404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79b1de-2308-4580-8759-7544ab4fd2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:45.557471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b1de-2308-4580-8759-7544ab4fd2da None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:45.558106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b1de-2308-4580-8759-7544ab4fd2da None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:45.558576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b1de-2308-4580-8759-7544ab4fd2da None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:45.559517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79b1de-2308-4580-8759-7544ab4fd2da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:45.560059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79b1de-2308-4580-8759-7544ab4fd2da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:45.561682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79b1de-2308-4580-8759-7544ab4fd2da None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:45.571947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 392/783] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:45.579837 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79b1de-2308-4580-8759-7544ab4fd2da None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:45.629030 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:45.719071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279babe-1ee4-4b4b-b651-76f5ccac9a57 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:45.748168 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79b1de-2308-4580-8759-7544ab4fd2da None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:45.760804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b21c6-7f0e-4d60-a116-eb2a01ccb97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:45.761527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b21c6-7f0e-4d60-a116-eb2a01ccb97b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:45.761801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b21c6-7f0e-4d60-a116-eb2a01ccb97b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:45.762094 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b21c6-7f0e-4d60-a116-eb2a01ccb97b None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:45.762704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b21c6-7f0e-4d60-a116-eb2a01ccb97b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:45.764172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b21c6-7f0e-4d60-a116-eb2a01ccb97b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:45.769751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 392/784] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 22 21:57:45 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:45.820510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea3dc8-f91b-4524-a91e-0e4c8198f757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:45.821261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea3dc8-f91b-4524-a91e-0e4c8198f757 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:45.821540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea3dc8-f91b-4524-a91e-0e4c8198f757 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:45.821801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea3dc8-f91b-4524-a91e-0e4c8198f757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:45.838739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea3dc8-f91b-4524-a91e-0e4c8198f757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:45.840208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea3dc8-f91b-4524-a91e-0e4c8198f757 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-67ea3dc8-f91b-4524-a91e-0e4c8198f757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:45.860663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:45.861672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:45.862672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:45.862672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:45.862672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:45.862672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 393/785] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:45.867999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b21c6-7f0e-4d60-a116-eb2a01ccb97b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:45.953698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c869cb-620c-49ce-a5b7-155639cf4568 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:45.954059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c869cb-620c-49ce-a5b7-155639cf4568 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:45.954244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c869cb-620c-49ce-a5b7-155639cf4568 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:45.956779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 394/786] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:45.962986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c703fc5-1c2f-4ae7-9128-c21a664a1315 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:45.963569 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c703fc5-1c2f-4ae7-9128-c21a664a1315 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:45.963841 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c703fc5-1c2f-4ae7-9128-c21a664a1315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:46.000509 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b21c6-7f0e-4d60-a116-eb2a01ccb97b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:46.002857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4c703fc5-1c2f-4ae7-9128-c21a664a1315 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:46.004052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4c703fc5-1c2f-4ae7-9128-c21a664a1315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:46.023611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:46.033799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:46.054380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b456777-ce99-4b3b-8cce-8baea9521d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:46.055503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b456777-ce99-4b3b-8cce-8baea9521d39 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:46.056097 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b456777-ce99-4b3b-8cce-8baea9521d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:46.056566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b456777-ce99-4b3b-8cce-8baea9521d39 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:46.057681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b456777-ce99-4b3b-8cce-8baea9521d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:46.058144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b456777-ce99-4b3b-8cce-8baea9521d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:46.059541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b456777-ce99-4b3b-8cce-8baea9521d39 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:46.079429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 393/787] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:46.086637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b456777-ce99-4b3b-8cce-8baea9521d39 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:46.100428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 395/788] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:57:46.211718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b456777-ce99-4b3b-8cce-8baea9521d39 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:46.247388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21dccd-d6f2-4dd3-a371-0cc86f435cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:46.248474 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21dccd-d6f2-4dd3-a371-0cc86f435cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:46.248950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21dccd-d6f2-4dd3-a371-0cc86f435cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:46.249471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21dccd-d6f2-4dd3-a371-0cc86f435cd3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:46.257015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21dccd-d6f2-4dd3-a371-0cc86f435cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:46.258817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21dccd-d6f2-4dd3-a371-0cc86f435cd3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ad21dccd-d6f2-4dd3-a371-0cc86f435cd3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:46.276749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:46.277754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:46.279056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:46.279056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:46.279056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:46.279056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:46.279056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:46.279056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:46.279056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:46.279056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:46.279056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:46.279056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:46.281145 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 394/789] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:46.287081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c703fc5-1c2f-4ae7-9128-c21a664a1315 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:46.444350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c703fc5-1c2f-4ae7-9128-c21a664a1315 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:46.459184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21dccd-d6f2-4dd3-a371-0cc86f435cd3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:46.498306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f34f6a-3be2-462e-a4b1-6e8e46cbbca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:46.500389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f34f6a-3be2-462e-a4b1-6e8e46cbbca6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:46.500870 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f34f6a-3be2-462e-a4b1-6e8e46cbbca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:46.501336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f34f6a-3be2-462e-a4b1-6e8e46cbbca6 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:46.502575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f34f6a-3be2-462e-a4b1-6e8e46cbbca6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:46.503202 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f34f6a-3be2-462e-a4b1-6e8e46cbbca6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:46.504878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f34f6a-3be2-462e-a4b1-6e8e46cbbca6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:46.519616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:46.558744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 396/790] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 22 21:57:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:46.564254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f34f6a-3be2-462e-a4b1-6e8e46cbbca6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:46.582309 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:46.670987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21dccd-d6f2-4dd3-a371-0cc86f435cd3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:46.713296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a27598-302f-4050-983e-2875d679e71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:46.713969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a27598-302f-4050-983e-2875d679e71c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:46.714245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a27598-302f-4050-983e-2875d679e71c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:46.717295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a27598-302f-4050-983e-2875d679e71c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:46.740107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a27598-302f-4050-983e-2875d679e71c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-34a27598-302f-4050-983e-2875d679e71c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:46.745816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:46.746772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:46.747595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 395/791] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:46.748528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133026e-91ba-489f-bf1a-88868d4c81d9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:46.748755 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133026e-91ba-489f-bf1a-88868d4c81d9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:46.749088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133026e-91ba-489f-bf1a-88868d4c81d9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:46.750634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f34f6a-3be2-462e-a4b1-6e8e46cbbca6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:46.750765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 396/792] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:46.757964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133026e-91ba-489f-bf1a-88868d4c81d9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:46.795304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d203cb-bb08-41d9-8fd1-c135f633d987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:46.795952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d203cb-bb08-41d9-8fd1-c135f633d987 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:46.796226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d203cb-bb08-41d9-8fd1-c135f633d987 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:46.796578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d203cb-bb08-41d9-8fd1-c135f633d987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:46.807527 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d203cb-bb08-41d9-8fd1-c135f633d987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:46.809187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d203cb-bb08-41d9-8fd1-c135f633d987 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-42d203cb-bb08-41d9-8fd1-c135f633d987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:46.825298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:46.826331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:46.827630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:46.827630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:46.827630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:46.827630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 397/793] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:46.828061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676f17-60eb-4122-a9e4-4b3668f4d22c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:46.829165 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676f17-60eb-4122-a9e4-4b3668f4d22c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:46.829165 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676f17-60eb-4122-a9e4-4b3668f4d22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:46.847771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ed676f17-60eb-4122-a9e4-4b3668f4d22c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:46.849061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ed676f17-60eb-4122-a9e4-4b3668f4d22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:46.859806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:46.867505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133026e-91ba-489f-bf1a-88868d4c81d9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:46.904370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6796f7-65f7-459f-8207-c3b34488e0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:46.904991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6796f7-65f7-459f-8207-c3b34488e0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:46.905272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6796f7-65f7-459f-8207-c3b34488e0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:46.905545 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6796f7-65f7-459f-8207-c3b34488e0b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:46.906265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6796f7-65f7-459f-8207-c3b34488e0b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:46.906630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6796f7-65f7-459f-8207-c3b34488e0b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:46.908133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6796f7-65f7-459f-8207-c3b34488e0b9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:46.914655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:46.926053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 397/795] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:46.926053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6796f7-65f7-459f-8207-c3b34488e0b9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:46.926364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 398/795] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:57:46.927411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed676f17-60eb-4122-a9e4-4b3668f4d22c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:47.037977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6796f7-65f7-459f-8207-c3b34488e0b9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:47.074917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95b31a-805e-44da-b059-6eab1d5b95cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:47.075453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95b31a-805e-44da-b059-6eab1d5b95cd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.075873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95b31a-805e-44da-b059-6eab1d5b95cd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.076086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95b31a-805e-44da-b059-6eab1d5b95cd None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.076773 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95b31a-805e-44da-b059-6eab1d5b95cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:47.077211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95b31a-805e-44da-b059-6eab1d5b95cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:47.078628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95b31a-805e-44da-b059-6eab1d5b95cd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:47.080323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed676f17-60eb-4122-a9e4-4b3668f4d22c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:47.091713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 398/796] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:47.097287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95b31a-805e-44da-b059-6eab1d5b95cd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:47.121615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:47.122940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e8b28-2f98-4bda-87bd-04fef6f001e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:47.123590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e8b28-2f98-4bda-87bd-04fef6f001e4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.123864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e8b28-2f98-4bda-87bd-04fef6f001e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.124139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e8b28-2f98-4bda-87bd-04fef6f001e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.134936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e8b28-2f98-4bda-87bd-04fef6f001e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:47.136512 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e8b28-2f98-4bda-87bd-04fef6f001e4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-327e8b28-2f98-4bda-87bd-04fef6f001e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:47.152661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:47.153614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:47.154561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:47.154561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:47.154561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:47.154728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 399/797] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:47.155991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b858146-0c88-4cc5-8d56-b74e087e16de None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.156265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b858146-0c88-4cc5-8d56-b74e087e16de None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.156529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b858146-0c88-4cc5-8d56-b74e087e16de None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.162153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 400/798] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:47.162819 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b858146-0c88-4cc5-8d56-b74e087e16de None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:47.220139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:47.283391 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b858146-0c88-4cc5-8d56-b74e087e16de None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:47.318793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5c9f0-917c-4d82-bc28-08c598e38984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:47.319398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5c9f0-917c-4d82-bc28-08c598e38984 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.319667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5c9f0-917c-4d82-bc28-08c598e38984 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.319949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5c9f0-917c-4d82-bc28-08c598e38984 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.320608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5c9f0-917c-4d82-bc28-08c598e38984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:47.320905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5c9f0-917c-4d82-bc28-08c598e38984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:47.322413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5c9f0-917c-4d82-bc28-08c598e38984 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:47.334442 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 401/799] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:47.335547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c22c9-808a-4efd-b75d-313602cfcba4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.335824 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c22c9-808a-4efd-b75d-313602cfcba4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.336513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c22c9-808a-4efd-b75d-313602cfcba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.344108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95b31a-805e-44da-b059-6eab1d5b95cd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:47.354942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-dc4c22c9-808a-4efd-b75d-313602cfcba4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:47.356103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-dc4c22c9-808a-4efd-b75d-313602cfcba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:47.386693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536afe9-511a-44bc-8dc8-55f90264b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:47.387347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536afe9-511a-44bc-8dc8-55f90264b85b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.387616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536afe9-511a-44bc-8dc8-55f90264b85b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.387965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536afe9-511a-44bc-8dc8-55f90264b85b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.395938 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536afe9-511a-44bc-8dc8-55f90264b85b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:47.397934 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536afe9-511a-44bc-8dc8-55f90264b85b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f536afe9-511a-44bc-8dc8-55f90264b85b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:47.411766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:47.412673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:47.413670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:47.413670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:47.413670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:47.413670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:47.413670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:47.413670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:47.413670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:47.413670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:47.413670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 399/800] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:47.414804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536afe9-511a-44bc-8dc8-55f90264b85b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:47.437891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 402/801] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:57:47.437891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c22c9-808a-4efd-b75d-313602cfcba4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:47.471696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:47.515119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:47.538191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536afe9-511a-44bc-8dc8-55f90264b85b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:47.553721 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c22c9-808a-4efd-b75d-313602cfcba4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:47.579956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720c74c-593f-445f-904a-cdc346d94b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:47.580715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720c74c-593f-445f-904a-cdc346d94b10 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.581116 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720c74c-593f-445f-904a-cdc346d94b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.581479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720c74c-593f-445f-904a-cdc346d94b10 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.582230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720c74c-593f-445f-904a-cdc346d94b10 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:47.583714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720c74c-593f-445f-904a-cdc346d94b10 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5720c74c-593f-445f-904a-cdc346d94b10 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:47.593423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:47.594617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 21:57:47.595667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:47.601966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 400/802] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Sep 22 21:57:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:47.601966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720c74c-593f-445f-904a-cdc346d94b10 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:47.632723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb648ec-514b-4449-8be8-e40aa31901b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:47.634167 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb648ec-514b-4449-8be8-e40aa31901b1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.634650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb648ec-514b-4449-8be8-e40aa31901b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.635122 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb648ec-514b-4449-8be8-e40aa31901b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.647377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb648ec-514b-4449-8be8-e40aa31901b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:47.649537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb648ec-514b-4449-8be8-e40aa31901b1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-cdb648ec-514b-4449-8be8-e40aa31901b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:47.665450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:47.666614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 403/803] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 22 21:57:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:47.667855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb648ec-514b-4449-8be8-e40aa31901b1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:47.716032 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720c74c-593f-445f-904a-cdc346d94b10 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:47.756521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe229d-09a9-446d-a257-2466ec68d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:47.757130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe229d-09a9-446d-a257-2466ec68d80c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.757402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe229d-09a9-446d-a257-2466ec68d80c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.757668 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe229d-09a9-446d-a257-2466ec68d80c None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.759245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe229d-09a9-446d-a257-2466ec68d80c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:47.759550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe229d-09a9-446d-a257-2466ec68d80c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:47.761453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe229d-09a9-446d-a257-2466ec68d80c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:47.774657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 401/804] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:47.780312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe229d-09a9-446d-a257-2466ec68d80c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:47.781304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:47.783231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:47.785550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb648ec-514b-4449-8be8-e40aa31901b1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:47.820128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82ef8d-2522-408e-afce-51e4dba377c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:47.820888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ef8d-2522-408e-afce-51e4dba377c1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.821177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ef8d-2522-408e-afce-51e4dba377c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.821448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ef8d-2522-408e-afce-51e4dba377c1 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.822108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82ef8d-2522-408e-afce-51e4dba377c1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:47.822415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82ef8d-2522-408e-afce-51e4dba377c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:47.823780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82ef8d-2522-408e-afce-51e4dba377c1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:47.828433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 404/805] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 22 21:57:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:47.831343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82ef8d-2522-408e-afce-51e4dba377c1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:47.889542 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe229d-09a9-446d-a257-2466ec68d80c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:47.925296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce400fb-05d9-462e-ab42-1ebfe8239a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:47.925985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce400fb-05d9-462e-ab42-1ebfe8239a69 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.926249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce400fb-05d9-462e-ab42-1ebfe8239a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.926534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce400fb-05d9-462e-ab42-1ebfe8239a69 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.927276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce400fb-05d9-462e-ab42-1ebfe8239a69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:47.927909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce400fb-05d9-462e-ab42-1ebfe8239a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:47.929069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce400fb-05d9-462e-ab42-1ebfe8239a69 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:47.947808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 402/806] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 22 21:57:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:47.948700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82ef8d-2522-408e-afce-51e4dba377c1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:47.952859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce400fb-05d9-462e-ab42-1ebfe8239a69 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:47.985341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d372a-1e7f-40c0-b164-60f277e1f4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:47.986004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d372a-1e7f-40c0-b164-60f277e1f4ed None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:47.986281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d372a-1e7f-40c0-b164-60f277e1f4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:47.986547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d372a-1e7f-40c0-b164-60f277e1f4ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:47.997224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d372a-1e7f-40c0-b164-60f277e1f4ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8e9d372a-1e7f-40c0-b164-60f277e1f4ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:48.002563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:48.003499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:48.004325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:48.008724 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 405/807] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:48.009429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d372a-1e7f-40c0-b164-60f277e1f4ed None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:48.023259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:48.037056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:48.067049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce400fb-05d9-462e-ab42-1ebfe8239a69 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:48.101530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf1293-43be-4820-9d81-caf9692b9a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:48.102319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf1293-43be-4820-9d81-caf9692b9a26 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:48.102600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf1293-43be-4820-9d81-caf9692b9a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:48.102863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf1293-43be-4820-9d81-caf9692b9a26 None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/f9967ef46a464ff2b5f7e4c459f8abd9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:48.104753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf1293-43be-4820-9d81-caf9692b9a26 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=f9967ef46a464ff2b5f7e4c459f8abd9, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:48.106216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf1293-43be-4820-9d81-caf9692b9a26 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:48.115621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d372a-1e7f-40c0-b164-60f277e1f4ed None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:48.122191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 403/808] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:57:47 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/f9967ef46a464ff2b5f7e4c459f8abd9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:57:48.123649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf1293-43be-4820-9d81-caf9692b9a26 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:48.156902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0235cde-b371-46e4-9fd8-64fa2d99bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:48.157586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0235cde-b371-46e4-9fd8-64fa2d99bd85 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:48.158029 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0235cde-b371-46e4-9fd8-64fa2d99bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:48.158386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0235cde-b371-46e4-9fd8-64fa2d99bd85 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:48.159116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0235cde-b371-46e4-9fd8-64fa2d99bd85 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:48.159499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0235cde-b371-46e4-9fd8-64fa2d99bd85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:48.160987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0235cde-b371-46e4-9fd8-64fa2d99bd85 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:48.167163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 406/809] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 22 21:57:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:48.172594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0235cde-b371-46e4-9fd8-64fa2d99bd85 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:48.275438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:48.295102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0235cde-b371-46e4-9fd8-64fa2d99bd85 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:48.317452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf1293-43be-4820-9d81-caf9692b9a26 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:48.346428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:48.347770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261135d-cdc7-4b18-bb98-e7467b86d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:48.349436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261135d-cdc7-4b18-bb98-e7467b86d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:48.350412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261135d-cdc7-4b18-bb98-e7467b86d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:48.351063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261135d-cdc7-4b18-bb98-e7467b86d7f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:48.352462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261135d-cdc7-4b18-bb98-e7467b86d7f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:48.353108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261135d-cdc7-4b18-bb98-e7467b86d7f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:48.358120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261135d-cdc7-4b18-bb98-e7467b86d7f9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:48.359791 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275427e-dbb4-48e9-9ee4-c03e2a3c381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:48.360398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275427e-dbb4-48e9-9ee4-c03e2a3c381a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:48.360680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275427e-dbb4-48e9-9ee4-c03e2a3c381a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:48.360954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275427e-dbb4-48e9-9ee4-c03e2a3c381a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:48.367170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 407/810] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:48.368995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261135d-cdc7-4b18-bb98-e7467b86d7f9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:48.437403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275427e-dbb4-48e9-9ee4-c03e2a3c381a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:48.439029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275427e-dbb4-48e9-9ee4-c03e2a3c381a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:48.476863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261135d-cdc7-4b18-bb98-e7467b86d7f9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:48.510472 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3364507-ca19-480b-926f-98aa2acdb923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:48.511078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364507-ca19-480b-926f-98aa2acdb923 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:48.511346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364507-ca19-480b-926f-98aa2acdb923 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:48.511612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364507-ca19-480b-926f-98aa2acdb923 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:48.512274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3364507-ca19-480b-926f-98aa2acdb923 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:48.513651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3364507-ca19-480b-926f-98aa2acdb923 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:48.540402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 408/811] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 21:57:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:57:48.541110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3364507-ca19-480b-926f-98aa2acdb923 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:48.546287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:48.566606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 404/812] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:57:48.568457 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299970dd-b311-471c-be7d-40d45cff9262 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:48.568950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299970dd-b311-471c-be7d-40d45cff9262 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:48.569362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299970dd-b311-471c-be7d-40d45cff9262 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:48.572171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 405/813] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:48.573563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299970dd-b311-471c-be7d-40d45cff9262 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:48.603807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:48.696796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3364507-ca19-480b-926f-98aa2acdb923 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:48.726862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299970dd-b311-471c-be7d-40d45cff9262 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:48.742959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33178deb-8d14-4184-a26c-1e2dab2af167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:48.744209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33178deb-8d14-4184-a26c-1e2dab2af167 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:48.744632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33178deb-8d14-4184-a26c-1e2dab2af167 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:48.745049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33178deb-8d14-4184-a26c-1e2dab2af167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:48.756612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33178deb-8d14-4184-a26c-1e2dab2af167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:48.758175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33178deb-8d14-4184-a26c-1e2dab2af167 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:48.769025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6e2a8-234d-476c-9227-9e75ac80f4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:48.769671 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6e2a8-234d-476c-9227-9e75ac80f4ed None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:48.769977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6e2a8-234d-476c-9227-9e75ac80f4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:48.770244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6e2a8-234d-476c-9227-9e75ac80f4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-33178deb-8d14-4184-a26c-1e2dab2af167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:48.773323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:48.774519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:48.775668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:48.775668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:48.775668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:48.775668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 409/814] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:48.776080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1690f-c601-4016-801c-6280853f7613 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:48.777210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1690f-c601-4016-801c-6280853f7613 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:48.777210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1690f-c601-4016-801c-6280853f7613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:48.785590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6e2a8-234d-476c-9227-9e75ac80f4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:48.787235 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6e2a8-234d-476c-9227-9e75ac80f4ed None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:48.798832 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ddf1690f-c601-4016-801c-6280853f7613 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:48.800061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ddf1690f-c601-4016-801c-6280853f7613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a7b6e2a8-234d-476c-9227-9e75ac80f4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:48.804549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:48.805617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:48.806557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:48.806557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:48.806557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:48.808608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 406/815] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:48.809607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6e2a8-234d-476c-9227-9e75ac80f4ed None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:48.850108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:48.882807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 410/816] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:57:48.884186 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1690f-c601-4016-801c-6280853f7613 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:48.898964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:48.931156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6e2a8-234d-476c-9227-9e75ac80f4ed None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:48.967255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f8c84-a784-4970-9872-7db355c5c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:48.967806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f8c84-a784-4970-9872-7db355c5c14e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:48.968091 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f8c84-a784-4970-9872-7db355c5c14e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:48.968362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f8c84-a784-4970-9872-7db355c5c14e None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:48.969017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f8c84-a784-4970-9872-7db355c5c14e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:48.969324 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f8c84-a784-4970-9872-7db355c5c14e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:48.970998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f8c84-a784-4970-9872-7db355c5c14e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:48.989115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 407/817] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:48.990531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f8c84-a784-4970-9872-7db355c5c14e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:49.097141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f8c84-a784-4970-9872-7db355c5c14e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:49.130233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:49.135577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d447d-fe39-4a68-9c9d-f89d218cbd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:49.136231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d447d-fe39-4a68-9c9d-f89d218cbd0f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:49.136505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d447d-fe39-4a68-9c9d-f89d218cbd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:49.136824 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d447d-fe39-4a68-9c9d-f89d218cbd0f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:49.145388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d447d-fe39-4a68-9c9d-f89d218cbd0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:49.146994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d447d-fe39-4a68-9c9d-f89d218cbd0f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:49.154842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1690f-c601-4016-801c-6280853f7613 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-857d447d-fe39-4a68-9c9d-f89d218cbd0f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:49.159758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:49.160659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:49.161572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:49.161572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:49.161572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:49.161572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:49.161572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:49.161572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:49.161572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:49.161572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:49.161572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:57:49.161572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:49.166470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 408/818] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 22 21:57:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:49.168188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d447d-fe39-4a68-9c9d-f89d218cbd0f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:49.218229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beb09a-8e45-4167-80bb-037c4fb78a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:49.219280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beb09a-8e45-4167-80bb-037c4fb78a2d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:49.219843 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beb09a-8e45-4167-80bb-037c4fb78a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:49.220313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beb09a-8e45-4167-80bb-037c4fb78a2d None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:49.221266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2beb09a-8e45-4167-80bb-037c4fb78a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:49.221754 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2beb09a-8e45-4167-80bb-037c4fb78a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:49.223558 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2beb09a-8e45-4167-80bb-037c4fb78a2d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:49.240587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 411/819] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:49.242027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beb09a-8e45-4167-80bb-037c4fb78a2d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:49.278600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d447d-fe39-4a68-9c9d-f89d218cbd0f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:49.294995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:49.318121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e0303-726b-4a6d-8a89-d26c59646302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:49.318787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0303-726b-4a6d-8a89-d26c59646302 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:49.319011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0303-726b-4a6d-8a89-d26c59646302 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:49.319281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0303-726b-4a6d-8a89-d26c59646302 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:49.320042 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e0303-726b-4a6d-8a89-d26c59646302 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:49.320311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e0303-726b-4a6d-8a89-d26c59646302 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:49.321772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e0303-726b-4a6d-8a89-d26c59646302 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:49.345924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 409/820] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 22 21:57:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:49.347136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e0303-726b-4a6d-8a89-d26c59646302 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:49.379260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beb09a-8e45-4167-80bb-037c4fb78a2d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:49.412249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:49.423796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532a23e-b28b-4c3a-a6c6-4e0c4ec069da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:49.424758 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532a23e-b28b-4c3a-a6c6-4e0c4ec069da None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:49.425311 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532a23e-b28b-4c3a-a6c6-4e0c4ec069da None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:49.425869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532a23e-b28b-4c3a-a6c6-4e0c4ec069da None admin] PATH_INFO: `/v3/services/network` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:49.426655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532a23e-b28b-4c3a-a6c6-4e0c4ec069da None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:49.428240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532a23e-b28b-4c3a-a6c6-4e0c4ec069da None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7532a23e-b28b-4c3a-a6c6-4e0c4ec069da None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:49.438871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:49.439919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 21:57:49.440773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:49.443836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 412/821] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:49 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:49.444887 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532a23e-b28b-4c3a-a6c6-4e0c4ec069da None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:49.471633 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e0303-726b-4a6d-8a89-d26c59646302 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:49.507704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc1957-2853-4b21-80c2-896d06ed59e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:49.508888 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1957-2853-4b21-80c2-896d06ed59e9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:49.509469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1957-2853-4b21-80c2-896d06ed59e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:49.510008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1957-2853-4b21-80c2-896d06ed59e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:49.517444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc1957-2853-4b21-80c2-896d06ed59e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:49.519283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc1957-2853-4b21-80c2-896d06ed59e9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7cdc1957-2853-4b21-80c2-896d06ed59e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:49.531320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:49.532230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:49.533102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:49.533102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:49.533102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:49.533102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:49.533102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:49.533102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:49.533102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:49.533102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:49.535492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 410/822] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:49.536528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc1957-2853-4b21-80c2-896d06ed59e9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:49.585140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532a23e-b28b-4c3a-a6c6-4e0c4ec069da None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:49.595590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:49.636679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034209c-819f-4ff5-a04d-ed39aa9f76ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:49.637353 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034209c-819f-4ff5-a04d-ed39aa9f76ae None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:49.637624 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034209c-819f-4ff5-a04d-ed39aa9f76ae None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:49.637909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034209c-819f-4ff5-a04d-ed39aa9f76ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:49.650459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034209c-819f-4ff5-a04d-ed39aa9f76ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:49.652291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034209c-819f-4ff5-a04d-ed39aa9f76ae None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:49.657487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc1957-2853-4b21-80c2-896d06ed59e9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f034209c-819f-4ff5-a04d-ed39aa9f76ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:49.668646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:49.669594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:49.670529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:49.670529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:49.670529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:49.670703 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:49.672430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 413/823] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:49.673474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034209c-819f-4ff5-a04d-ed39aa9f76ae None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:49.698395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca9232-f6ce-442a-a4af-61acfc15e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:49.699373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9232-f6ce-442a-a4af-61acfc15e348 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:49.699852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9232-f6ce-442a-a4af-61acfc15e348 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:49.700323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9232-f6ce-442a-a4af-61acfc15e348 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:49.701157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9232-f6ce-442a-a4af-61acfc15e348 None admin] RBAC: Adding query filter params (name=network) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:49.701658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9232-f6ce-442a-a4af-61acfc15e348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:49.703305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9232-f6ce-442a-a4af-61acfc15e348 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:49.708930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 411/824] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:57:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:49.710016 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca9232-f6ce-442a-a4af-61acfc15e348 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:49.811925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034209c-819f-4ff5-a04d-ed39aa9f76ae None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:49.831017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca9232-f6ce-442a-a4af-61acfc15e348 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:49.851520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff39ac-18c8-49df-b16d-d43093099adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:49.852825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff39ac-18c8-49df-b16d-d43093099adb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:49.852825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff39ac-18c8-49df-b16d-d43093099adb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:49.853090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff39ac-18c8-49df-b16d-d43093099adb None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:49.853892 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff39ac-18c8-49df-b16d-d43093099adb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:49.854289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff39ac-18c8-49df-b16d-d43093099adb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:49.855923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff39ac-18c8-49df-b16d-d43093099adb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:49.868994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76134b7-3079-438a-ab28-9518ad4c1c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:49.869988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76134b7-3079-438a-ab28-9518ad4c1c68 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:49.870493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76134b7-3079-438a-ab28-9518ad4c1c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:49.870963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76134b7-3079-438a-ab28-9518ad4c1c68 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:49.871815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76134b7-3079-438a-ab28-9518ad4c1c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:49.872315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76134b7-3079-438a-ab28-9518ad4c1c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:49.874035 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76134b7-3079-438a-ab28-9518ad4c1c68 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:49.877442 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 414/825] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:49.878366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff39ac-18c8-49df-b16d-d43093099adb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:49.888443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 412/826] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:49.889621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76134b7-3079-438a-ab28-9518ad4c1c68 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:49.901448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:49.926405 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:49.991497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff39ac-18c8-49df-b16d-d43093099adb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:49.998722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76134b7-3079-438a-ab28-9518ad4c1c68 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:50.028097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97936043-f7e0-46ba-b4bd-29111b750da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:50.028711 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936043-f7e0-46ba-b4bd-29111b750da3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:50.029099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936043-f7e0-46ba-b4bd-29111b750da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:50.029385 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936043-f7e0-46ba-b4bd-29111b750da3 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:50.030009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97936043-f7e0-46ba-b4bd-29111b750da3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:50.030307 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97936043-f7e0-46ba-b4bd-29111b750da3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:50.031782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97936043-f7e0-46ba-b4bd-29111b750da3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:50.037398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313043dd-3914-4a65-859b-5599bf3f2da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:50.038308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313043dd-3914-4a65-859b-5599bf3f2da3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:50.038787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313043dd-3914-4a65-859b-5599bf3f2da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:50.039571 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313043dd-3914-4a65-859b-5599bf3f2da3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:50.040615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313043dd-3914-4a65-859b-5599bf3f2da3 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=a044973e9e84495dbf8d14e19fc84716) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:50.041124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313043dd-3914-4a65-859b-5599bf3f2da3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:50.042351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 415/827] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:57:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:50.043108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97936043-f7e0-46ba-b4bd-29111b750da3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:50.043464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313043dd-3914-4a65-859b-5599bf3f2da3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:50.050710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 413/828] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:49 2022] GET /identity/v3/role_assignments?user.id=a044973e9e84495dbf8d14e19fc84716&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:50.051844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313043dd-3914-4a65-859b-5599bf3f2da3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:50.168012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313043dd-3914-4a65-859b-5599bf3f2da3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:50.169993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:50.189667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:50.217677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23988ad0-e42b-4f48-a993-a36db5c301ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:50.218775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988ad0-e42b-4f48-a993-a36db5c301ef None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:50.219256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988ad0-e42b-4f48-a993-a36db5c301ef None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:50.219753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988ad0-e42b-4f48-a993-a36db5c301ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:50.220635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23988ad0-e42b-4f48-a993-a36db5c301ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:50.220808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97936043-f7e0-46ba-b4bd-29111b750da3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:50.222629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23988ad0-e42b-4f48-a993-a36db5c301ef None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:50.262507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82c8be-e00d-43be-a8a8-4b16c6101ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:50.263294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82c8be-e00d-43be-a8a8-4b16c6101ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:50.263577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82c8be-e00d-43be-a8a8-4b16c6101ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:50.263859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82c8be-e00d-43be-a8a8-4b16c6101ba7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:50.273116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82c8be-e00d-43be-a8a8-4b16c6101ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:50.275822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82c8be-e00d-43be-a8a8-4b16c6101ba7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ab82c8be-e00d-43be-a8a8-4b16c6101ba7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:50.290929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:50.292021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:50.292954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:50.292954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:50.292954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:50.292954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:50.292954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:50.292954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:50.292954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:50.292954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:50.292954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 416/829] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:50.299040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82c8be-e00d-43be-a8a8-4b16c6101ba7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:50.307837 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 414/830] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 21:57:50 2022] POST /identity/v3/endpoints => generated 337 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:57:50.399669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991d32-1cea-4860-92fa-1c2b7934c23b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:50.400313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991d32-1cea-4860-92fa-1c2b7934c23b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:50.400313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991d32-1cea-4860-92fa-1c2b7934c23b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:50.401879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 415/831] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:50.411425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153ae0f-a119-4740-977e-aa153c915c69 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:50.411761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153ae0f-a119-4740-977e-aa153c915c69 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:50.411965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153ae0f-a119-4740-977e-aa153c915c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:50.456685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f153ae0f-a119-4740-977e-aa153c915c69 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:50.457929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f153ae0f-a119-4740-977e-aa153c915c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:50.553885 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 416/832] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:57:50.594939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82c8be-e00d-43be-a8a8-4b16c6101ba7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:50.636211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c400b9-86bc-499d-9ba1-625890af96a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:50.636825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c400b9-86bc-499d-9ba1-625890af96a5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:50.637100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c400b9-86bc-499d-9ba1-625890af96a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:50.637365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c400b9-86bc-499d-9ba1-625890af96a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:50.638059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c400b9-86bc-499d-9ba1-625890af96a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:50.638362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c400b9-86bc-499d-9ba1-625890af96a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:50.639798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c400b9-86bc-499d-9ba1-625890af96a5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:50.654618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 417/833] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:50.660489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153ae0f-a119-4740-977e-aa153c915c69 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:50.748074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:50.774636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153ae0f-a119-4740-977e-aa153c915c69 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:50.809319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e4630-338e-45ee-be19-879ec612eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:50.810028 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e4630-338e-45ee-be19-879ec612eda0 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:50.810311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e4630-338e-45ee-be19-879ec612eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:50.810590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e4630-338e-45ee-be19-879ec612eda0 None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/d51d2b73c22747f2b40bccc45352135f/roles/82675c8ebc84464cbf87641d4ced0f72` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:50.826489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e4630-338e-45ee-be19-879ec612eda0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=d51d2b73c22747f2b40bccc45352135f, role_id=82675c8ebc84464cbf87641d4ced0f72)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:50.827972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e4630-338e-45ee-be19-879ec612eda0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:50.846595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 417/834] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:57:50 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/d51d2b73c22747f2b40bccc45352135f/roles/82675c8ebc84464cbf87641d4ced0f72 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:57:50.872376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c400b9-86bc-499d-9ba1-625890af96a5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:50.875783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:50.967744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aacbed-926c-43e3-87b5-e6f58c761c65 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:50.967958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aacbed-926c-43e3-87b5-e6f58c761c65 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:50.968069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aacbed-926c-43e3-87b5-e6f58c761c65 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:50.969807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 418/835] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:50.975550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898868b-a769-464b-bdae-60c297e6424a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:50.976043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898868b-a769-464b-bdae-60c297e6424a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:50.976316 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898868b-a769-464b-bdae-60c297e6424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:50.998965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b898868b-a769-464b-bdae-60c297e6424a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:50.999676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c400b9-86bc-499d-9ba1-625890af96a5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:51.000237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b898868b-a769-464b-bdae-60c297e6424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:51.043925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc33ae-17c0-44c0-a1d4-a8a805df888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:51.045960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc33ae-17c0-44c0-a1d4-a8a805df888f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:51.046266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc33ae-17c0-44c0-a1d4-a8a805df888f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:51.046539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc33ae-17c0-44c0-a1d4-a8a805df888f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:51.061162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc33ae-17c0-44c0-a1d4-a8a805df888f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-17bc33ae-17c0-44c0-a1d4-a8a805df888f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:51.067774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:51.068720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:57:51.069553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:51.071564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 418/836] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:51.076584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc33ae-17c0-44c0-a1d4-a8a805df888f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:51.090363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 419/837] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:57:51.143358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:51.187101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc33ae-17c0-44c0-a1d4-a8a805df888f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:51.222990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5329d4e-f58d-48fe-a2ff-af85d8138dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:51.223982 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5329d4e-f58d-48fe-a2ff-af85d8138dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:51.224456 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5329d4e-f58d-48fe-a2ff-af85d8138dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:51.224920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5329d4e-f58d-48fe-a2ff-af85d8138dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:51.225799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5329d4e-f58d-48fe-a2ff-af85d8138dd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:51.226330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5329d4e-f58d-48fe-a2ff-af85d8138dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:51.227995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5329d4e-f58d-48fe-a2ff-af85d8138dd7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:51.237636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 419/838] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:57:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:51.245867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898868b-a769-464b-bdae-60c297e6424a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:51.320924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:51.364636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898868b-a769-464b-bdae-60c297e6424a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:51.386036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5329d4e-f58d-48fe-a2ff-af85d8138dd7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:51.399830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adc533-25d5-4fba-adc4-4ab2561ac7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:51.400465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adc533-25d5-4fba-adc4-4ab2561ac7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:51.400741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adc533-25d5-4fba-adc4-4ab2561ac7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:51.401111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adc533-25d5-4fba-adc4-4ab2561ac7e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:51.411954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adc533-25d5-4fba-adc4-4ab2561ac7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:51.413432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adc533-25d5-4fba-adc4-4ab2561ac7e0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-77adc533-25d5-4fba-adc4-4ab2561ac7e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:51.429367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:51.430585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:51.431675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:51.431675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:51.431675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:51.431675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 420/839] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:51.438973 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adc533-25d5-4fba-adc4-4ab2561ac7e0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:51.509635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5329d4e-f58d-48fe-a2ff-af85d8138dd7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:51.534444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:51.547674 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb162e-66d5-426b-920c-dd43ac5bfe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:51.548554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb162e-66d5-426b-920c-dd43ac5bfe47 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:51.548827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb162e-66d5-426b-920c-dd43ac5bfe47 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:51.549091 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb162e-66d5-426b-920c-dd43ac5bfe47 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:51.549674 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb162e-66d5-426b-920c-dd43ac5bfe47 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:51.551043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adc533-25d5-4fba-adc4-4ab2561ac7e0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:51.551161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb162e-66d5-426b-920c-dd43ac5bfe47 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3beb162e-66d5-426b-920c-dd43ac5bfe47 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:51.561136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:51.562200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:51.563034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 420/840] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:57:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:51.568943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb162e-66d5-426b-920c-dd43ac5bfe47 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:51.569745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:51.594895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1075830-de81-4dba-8cf5-8a83d9c15c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:51.595602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1075830-de81-4dba-8cf5-8a83d9c15c8e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:51.595880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1075830-de81-4dba-8cf5-8a83d9c15c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:51.596152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1075830-de81-4dba-8cf5-8a83d9c15c8e None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:51.596855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1075830-de81-4dba-8cf5-8a83d9c15c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:51.597157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1075830-de81-4dba-8cf5-8a83d9c15c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:51.598611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1075830-de81-4dba-8cf5-8a83d9c15c8e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:51.616698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 421/841] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:51.618619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1075830-de81-4dba-8cf5-8a83d9c15c8e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:51.708970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb162e-66d5-426b-920c-dd43ac5bfe47 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:51.744651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1075830-de81-4dba-8cf5-8a83d9c15c8e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:51.760535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a430da-e494-4d6b-be57-58e5332ca074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:51.761825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a430da-e494-4d6b-be57-58e5332ca074 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:51.762523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a430da-e494-4d6b-be57-58e5332ca074 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:51.762946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a430da-e494-4d6b-be57-58e5332ca074 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:51.763945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a430da-e494-4d6b-be57-58e5332ca074 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:51.764764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a430da-e494-4d6b-be57-58e5332ca074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:51.766303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a430da-e494-4d6b-be57-58e5332ca074 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:51.772731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 421/842] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:57:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:51.778419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a430da-e494-4d6b-be57-58e5332ca074 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:51.790340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc460-742f-4349-a5dd-830eff9c9583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:51.791543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc460-742f-4349-a5dd-830eff9c9583 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:51.791960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc460-742f-4349-a5dd-830eff9c9583 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:51.792373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc460-742f-4349-a5dd-830eff9c9583 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:51.801382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdc460-742f-4349-a5dd-830eff9c9583 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:51.803268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdc460-742f-4349-a5dd-830eff9c9583 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-36cdc460-742f-4349-a5dd-830eff9c9583 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:51.819276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:51.820476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:51.821960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:51.821960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:51.821960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:51.821960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:51.821960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:51.821960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:51.821960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:51.821960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:51.821960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 21:57:51.821960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:51.825119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 422/843] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:57:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:51.830672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc460-742f-4349-a5dd-830eff9c9583 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:51.840933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:51.867294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:51.895633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a430da-e494-4d6b-be57-58e5332ca074 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:51.933951 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dbe67-69d2-4ebf-b1d2-91c66bee6147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:51.934785 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dbe67-69d2-4ebf-b1d2-91c66bee6147 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:51.935195 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dbe67-69d2-4ebf-b1d2-91c66bee6147 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:51.935595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dbe67-69d2-4ebf-b1d2-91c66bee6147 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:51.936474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dbe67-69d2-4ebf-b1d2-91c66bee6147 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:51.936916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dbe67-69d2-4ebf-b1d2-91c66bee6147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:51.938570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dbe67-69d2-4ebf-b1d2-91c66bee6147 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:51.943945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 422/844] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:57:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:51.953505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc460-742f-4349-a5dd-830eff9c9583 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:51.991570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840b59-c570-45d5-adb9-51fa335435c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:51.992715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840b59-c570-45d5-adb9-51fa335435c6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:51.993211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840b59-c570-45d5-adb9-51fa335435c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:51.993668 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840b59-c570-45d5-adb9-51fa335435c6 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:51.994654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5840b59-c570-45d5-adb9-51fa335435c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:51.995151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5840b59-c570-45d5-adb9-51fa335435c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:51.996788 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5840b59-c570-45d5-adb9-51fa335435c6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:52.017485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 423/845] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 22 21:57:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:52.029887 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dbe67-69d2-4ebf-b1d2-91c66bee6147 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:52.142625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dbe67-69d2-4ebf-b1d2-91c66bee6147 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:52.162076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:52.181251 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2137b-d1ea-44ea-b943-25dcca6a8fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:52.181893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2137b-d1ea-44ea-b943-25dcca6a8fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:52.182173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2137b-d1ea-44ea-b943-25dcca6a8fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:52.182443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2137b-d1ea-44ea-b943-25dcca6a8fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:52.254916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2137b-d1ea-44ea-b943-25dcca6a8fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:52.256367 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2137b-d1ea-44ea-b943-25dcca6a8fe8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:52.358149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 423/846] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:52 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:57:52.363990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840b59-c570-45d5-adb9-51fa335435c6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:52.458129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:52.468433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840b59-c570-45d5-adb9-51fa335435c6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:52.507413 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf0d4-fd8d-4be6-b31b-5ff1eecd3ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:52.508244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf0d4-fd8d-4be6-b31b-5ff1eecd3ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:52.508523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf0d4-fd8d-4be6-b31b-5ff1eecd3ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:52.508871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf0d4-fd8d-4be6-b31b-5ff1eecd3ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:52.519605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cf0d4-fd8d-4be6-b31b-5ff1eecd3ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:52.521122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cf0d4-fd8d-4be6-b31b-5ff1eecd3ce3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-dc5cf0d4-fd8d-4be6-b31b-5ff1eecd3ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:52.536585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:52.537561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:52.538465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:52.538465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:52.538465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:52.538465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 424/847] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:52.543892 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2137b-d1ea-44ea-b943-25dcca6a8fe8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:52.566361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:52.655507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2137b-d1ea-44ea-b943-25dcca6a8fe8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:52.702174 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed8963-1b26-4466-b524-74af9ba5ad7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:52.703379 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed8963-1b26-4466-b524-74af9ba5ad7d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:52.704004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed8963-1b26-4466-b524-74af9ba5ad7d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:52.704573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed8963-1b26-4466-b524-74af9ba5ad7d None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:52.705797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed8963-1b26-4466-b524-74af9ba5ad7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:52.706514 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed8963-1b26-4466-b524-74af9ba5ad7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:52.708227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed8963-1b26-4466-b524-74af9ba5ad7d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:52.726461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 424/848] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:52.733871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf0d4-fd8d-4be6-b31b-5ff1eecd3ce3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:52.825528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34771d-04e0-4d54-b545-c66cb7f05459 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:52.825896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34771d-04e0-4d54-b545-c66cb7f05459 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:52.826087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34771d-04e0-4d54-b545-c66cb7f05459 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:52.827976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 425/849] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:52.833098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217a07-c7ef-45a4-9cbc-472204ff9fe2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:52.833380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217a07-c7ef-45a4-9cbc-472204ff9fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:52.833646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217a07-c7ef-45a4-9cbc-472204ff9fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:52.852849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf0d4-fd8d-4be6-b31b-5ff1eecd3ce3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:52.854103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fb217a07-c7ef-45a4-9cbc-472204ff9fe2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:52.855301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fb217a07-c7ef-45a4-9cbc-472204ff9fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:52.891389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d275cba-4c26-4ff0-b60a-63c77b70f8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:52.892087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275cba-4c26-4ff0-b60a-63c77b70f8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:52.892365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275cba-4c26-4ff0-b60a-63c77b70f8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:52.892637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275cba-4c26-4ff0-b60a-63c77b70f8d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:52.901677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d275cba-4c26-4ff0-b60a-63c77b70f8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:52.903253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d275cba-4c26-4ff0-b60a-63c77b70f8d9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8d275cba-4c26-4ff0-b60a-63c77b70f8d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:52.917790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:52.918720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:52.919592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:52.919592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:52.919592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:52.919592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:52.919592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:52.919592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:52.919592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:52.919592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:52.919592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 425/850] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:52.924916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d275cba-4c26-4ff0-b60a-63c77b70f8d9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:52.929302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:52.937241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 426/851] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:57:53.050930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d275cba-4c26-4ff0-b60a-63c77b70f8d9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:53.091548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b9999-bc99-479e-9ced-f033996f8555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:53.092235 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9999-bc99-479e-9ced-f033996f8555 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:53.092511 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9999-bc99-479e-9ced-f033996f8555 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:53.092821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9999-bc99-479e-9ced-f033996f8555 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:53.093528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b9999-bc99-479e-9ced-f033996f8555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:53.093829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b9999-bc99-479e-9ced-f033996f8555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:53.095287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b9999-bc99-479e-9ced-f033996f8555 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:53.108918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 426/852] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:53.114725 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb217a07-c7ef-45a4-9cbc-472204ff9fe2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:53.121125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc7ee-99c6-4601-95f1-6c1ac57a5375 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:53.121410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc7ee-99c6-4601-95f1-6c1ac57a5375 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:53.121686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc7ee-99c6-4601-95f1-6c1ac57a5375 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:53.123309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 427/853] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:53.124661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:53.128303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486302fb-d8fe-40cf-a32f-673de4973302 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:53.128611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486302fb-d8fe-40cf-a32f-673de4973302 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:53.128955 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486302fb-d8fe-40cf-a32f-673de4973302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:53.149685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-486302fb-d8fe-40cf-a32f-673de4973302 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:53.150930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-486302fb-d8fe-40cf-a32f-673de4973302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:53.222995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:53.234027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 428/854] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:57:53.234781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486302fb-d8fe-40cf-a32f-673de4973302 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:53.242510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb217a07-c7ef-45a4-9cbc-472204ff9fe2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:53.284105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da2a10-e7fa-43ff-9c1a-e314afd931e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:53.284956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da2a10-e7fa-43ff-9c1a-e314afd931e7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:53.285135 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da2a10-e7fa-43ff-9c1a-e314afd931e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:53.285374 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da2a10-e7fa-43ff-9c1a-e314afd931e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:53.286131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da2a10-e7fa-43ff-9c1a-e314afd931e7 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=f9967ef46a464ff2b5f7e4c459f8abd9) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:53.286435 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da2a10-e7fa-43ff-9c1a-e314afd931e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:53.287952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da2a10-e7fa-43ff-9c1a-e314afd931e7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:53.302046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 427/855] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:53 2022] GET /identity/v3/role_assignments?user.id=f9967ef46a464ff2b5f7e4c459f8abd9&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:53.354426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486302fb-d8fe-40cf-a32f-673de4973302 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:53.396239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5149d-99fc-411a-92d3-af6891fc99c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:53.397340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5149d-99fc-411a-92d3-af6891fc99c1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:53.397821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5149d-99fc-411a-92d3-af6891fc99c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:53.398320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5149d-99fc-411a-92d3-af6891fc99c1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:53.399375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5149d-99fc-411a-92d3-af6891fc99c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:53.400991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5149d-99fc-411a-92d3-af6891fc99c1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3fe5149d-99fc-411a-92d3-af6891fc99c1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:53.411033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:53.412050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 21:57:53.412940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:53.416072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 429/856] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Sep 22 21:57:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:53.422317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da2a10-e7fa-43ff-9c1a-e314afd931e7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:53.498577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:53.506397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5149d-99fc-411a-92d3-af6891fc99c1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:53.535432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da2a10-e7fa-43ff-9c1a-e314afd931e7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:53.571369 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684fa38-9fe0-430b-9087-15ac41a58eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:53.571984 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684fa38-9fe0-430b-9087-15ac41a58eeb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:53.572257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684fa38-9fe0-430b-9087-15ac41a58eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:53.572525 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684fa38-9fe0-430b-9087-15ac41a58eeb None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:53.573157 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684fa38-9fe0-430b-9087-15ac41a58eeb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:53.573458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684fa38-9fe0-430b-9087-15ac41a58eeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:53.574989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684fa38-9fe0-430b-9087-15ac41a58eeb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:53.577014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:53.580199 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 428/857] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 22 21:57:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:53.590879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684fa38-9fe0-430b-9087-15ac41a58eeb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:53.629946 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5149d-99fc-411a-92d3-af6891fc99c1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:53.671895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76589c64-8075-4fea-945d-6b9f7b284520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:53.672924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589c64-8075-4fea-945d-6b9f7b284520 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:53.673346 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589c64-8075-4fea-945d-6b9f7b284520 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:53.673760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589c64-8075-4fea-945d-6b9f7b284520 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:53.686105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76589c64-8075-4fea-945d-6b9f7b284520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-76589c64-8075-4fea-945d-6b9f7b284520 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:53.691940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:53.693106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 21:57:53.694216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:53.702020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 430/858] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 21:57:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:53.703860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76589c64-8075-4fea-945d-6b9f7b284520 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:53.729275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684fa38-9fe0-430b-9087-15ac41a58eeb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:53.766912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d6447-633a-4f3e-ae16-ce1c98dabbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:53.767854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d6447-633a-4f3e-ae16-ce1c98dabbad None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:53.768319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d6447-633a-4f3e-ae16-ce1c98dabbad None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:53.768775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d6447-633a-4f3e-ae16-ce1c98dabbad None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:53.769607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d6447-633a-4f3e-ae16-ce1c98dabbad None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:53.770146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d6447-633a-4f3e-ae16-ce1c98dabbad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:53.771720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d6447-633a-4f3e-ae16-ce1c98dabbad None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:53.773293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:53.782279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 429/859] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 22 21:57:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:53.823211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76589c64-8075-4fea-945d-6b9f7b284520 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:53.842720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:53.864426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f513a4-5190-43f9-b168-b89f60401c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:53.865067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f513a4-5190-43f9-b168-b89f60401c96 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:53.865346 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f513a4-5190-43f9-b168-b89f60401c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:53.865618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f513a4-5190-43f9-b168-b89f60401c96 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:53.866337 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f513a4-5190-43f9-b168-b89f60401c96 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:53.866645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f513a4-5190-43f9-b168-b89f60401c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:53.868109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f513a4-5190-43f9-b168-b89f60401c96 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:53.882360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 431/860] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 21:57:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:53.884408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d6447-633a-4f3e-ae16-ce1c98dabbad None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:53.993760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d6447-633a-4f3e-ae16-ce1c98dabbad None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:54.028432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3e44c-b4d0-4037-be63-dd1ed40ce00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:54.028990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3e44c-b4d0-4037-be63-dd1ed40ce00e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:54.029267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3e44c-b4d0-4037-be63-dd1ed40ce00e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:54.029533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3e44c-b4d0-4037-be63-dd1ed40ce00e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:54.040902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3e44c-b4d0-4037-be63-dd1ed40ce00e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:54.042387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3e44c-b4d0-4037-be63-dd1ed40ce00e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-45d3e44c-b4d0-4037-be63-dd1ed40ce00e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:54.057247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:54.058244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:54.059114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:54.059114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:54.059114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:54.059114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 430/861] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:54.064487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f513a4-5190-43f9-b168-b89f60401c96 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:54.178129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f513a4-5190-43f9-b168-b89f60401c96 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:54.216307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9084bf-5bb5-4603-9415-00148a0b1a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:54.216927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9084bf-5bb5-4603-9415-00148a0b1a15 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:54.217200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9084bf-5bb5-4603-9415-00148a0b1a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:54.217530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9084bf-5bb5-4603-9415-00148a0b1a15 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:54.218220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9084bf-5bb5-4603-9415-00148a0b1a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:54.218573 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9084bf-5bb5-4603-9415-00148a0b1a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:54.219951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9084bf-5bb5-4603-9415-00148a0b1a15 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:54.232824 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 432/862] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:54.238495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3e44c-b4d0-4037-be63-dd1ed40ce00e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:54.282965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529836e-fc09-45ca-8ab6-fcf9013fcc5a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:54.283164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529836e-fc09-45ca-8ab6-fcf9013fcc5a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:54.283428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529836e-fc09-45ca-8ab6-fcf9013fcc5a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:54.285045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 433/863] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:57:54.291842 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11799b-9f9d-4b3a-a985-021b06157774 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:54.292179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11799b-9f9d-4b3a-a985-021b06157774 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:54.292376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11799b-9f9d-4b3a-a985-021b06157774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:54.311801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:54.312035 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9a11799b-9f9d-4b3a-a985-021b06157774 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:54.312996 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9a11799b-9f9d-4b3a-a985-021b06157774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:54.356053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:54.370836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3e44c-b4d0-4037-be63-dd1ed40ce00e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:54.401162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 434/864] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:57:54.416136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fec3a-7849-4609-9682-838fd2f78b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:54.416771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fec3a-7849-4609-9682-838fd2f78b14 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:54.417086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fec3a-7849-4609-9682-838fd2f78b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:54.417356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fec3a-7849-4609-9682-838fd2f78b14 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:54.426240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fec3a-7849-4609-9682-838fd2f78b14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:54.427674 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fec3a-7849-4609-9682-838fd2f78b14 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3f7fec3a-7849-4609-9682-838fd2f78b14 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:54.439096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:54.440106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:54.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:54.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:54.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:54.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:54.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:54.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:54.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:54.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:54.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:57:54.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:54.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 431/865] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 22 21:57:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:54.448167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11799b-9f9d-4b3a-a985-021b06157774 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:54.555679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11799b-9f9d-4b3a-a985-021b06157774 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:54.591375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333170d-6271-499a-ada3-1fe60186a7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:54.591992 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333170d-6271-499a-ada3-1fe60186a7ef None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:54.592268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333170d-6271-499a-ada3-1fe60186a7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:54.592539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333170d-6271-499a-ada3-1fe60186a7ef None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:54.593283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333170d-6271-499a-ada3-1fe60186a7ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:54.593584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333170d-6271-499a-ada3-1fe60186a7ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:54.595048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333170d-6271-499a-ada3-1fe60186a7ef None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:54.613326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 435/866] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 22 21:57:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:54.619236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fec3a-7849-4609-9682-838fd2f78b14 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:54.701687 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333170d-6271-499a-ada3-1fe60186a7ef None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:54.732652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fec3a-7849-4609-9682-838fd2f78b14 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:54.738608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:54.747883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:54.783265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f09c4-d996-4924-ab90-b016cc51e516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:54.783925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f09c4-d996-4924-ab90-b016cc51e516 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:54.784183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f09c4-d996-4924-ab90-b016cc51e516 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:54.784444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f09c4-d996-4924-ab90-b016cc51e516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:54.821348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333170d-6271-499a-ada3-1fe60186a7ef None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:54.855957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd162979-36a7-40ca-872e-0986339e3199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:54.857362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd162979-36a7-40ca-872e-0986339e3199 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:54.858125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd162979-36a7-40ca-872e-0986339e3199 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:54.858637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f09c4-d996-4924-ab90-b016cc51e516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:54.858758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd162979-36a7-40ca-872e-0986339e3199 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:54.859612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd162979-36a7-40ca-872e-0986339e3199 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:54.860082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f09c4-d996-4924-ab90-b016cc51e516 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:54.861387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd162979-36a7-40ca-872e-0986339e3199 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:54.884892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 436/867] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:57:54 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 21:57:54.976770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 432/868] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:54 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:57:54.982391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd162979-36a7-40ca-872e-0986339e3199 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:55.074702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:55.099765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd162979-36a7-40ca-872e-0986339e3199 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:55.135970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23623e-61ca-4eb0-badb-c1562ecdcc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:55.136618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23623e-61ca-4eb0-badb-c1562ecdcc9a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:55.136939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23623e-61ca-4eb0-badb-c1562ecdcc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:55.137274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23623e-61ca-4eb0-badb-c1562ecdcc9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:55.148873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23623e-61ca-4eb0-badb-c1562ecdcc9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:55.150396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23623e-61ca-4eb0-badb-c1562ecdcc9a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-bb23623e-61ca-4eb0-badb-c1562ecdcc9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:55.165258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:55.166297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:55.167207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:55.167207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:55.167207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:55.167207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 437/869] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:55.172563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f09c4-d996-4924-ab90-b016cc51e516 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:55.184697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:55.279926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f09c4-d996-4924-ab90-b016cc51e516 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:55.316039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410cd25-c811-43cd-9748-df0900517fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:55.317044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410cd25-c811-43cd-9748-df0900517fae None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:55.317541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410cd25-c811-43cd-9748-df0900517fae None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:55.318056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410cd25-c811-43cd-9748-df0900517fae None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:55.318908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410cd25-c811-43cd-9748-df0900517fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:55.319416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410cd25-c811-43cd-9748-df0900517fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:55.321064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410cd25-c811-43cd-9748-df0900517fae None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:55.333572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 433/870] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:55.345894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23623e-61ca-4eb0-badb-c1562ecdcc9a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:55.441653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23623e-61ca-4eb0-badb-c1562ecdcc9a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:55.476873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee427b08-5c2c-4a0e-bf48-a8d10b5ce290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:55.477526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee427b08-5c2c-4a0e-bf48-a8d10b5ce290 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:55.477807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee427b08-5c2c-4a0e-bf48-a8d10b5ce290 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:55.478109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee427b08-5c2c-4a0e-bf48-a8d10b5ce290 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:55.480049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:55.486291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee427b08-5c2c-4a0e-bf48-a8d10b5ce290 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:55.487793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee427b08-5c2c-4a0e-bf48-a8d10b5ce290 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ee427b08-5c2c-4a0e-bf48-a8d10b5ce290 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:57:55.500218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:55.501149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:55.502066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:57:55.502066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:57:55.502066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:57:55.502066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:57:55.502066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:57:55.502066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:57:55.502066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:57:55.502066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:55.502066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 438/871] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:57:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:55.507545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410cd25-c811-43cd-9748-df0900517fae None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:55.587043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:55.629074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410cd25-c811-43cd-9748-df0900517fae None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:55.665274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee962d12-18c9-44a8-a9c1-c782f1c9b714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:55.665924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962d12-18c9-44a8-a9c1-c782f1c9b714 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:55.666200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962d12-18c9-44a8-a9c1-c782f1c9b714 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:55.666464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962d12-18c9-44a8-a9c1-c782f1c9b714 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:55.667157 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee962d12-18c9-44a8-a9c1-c782f1c9b714 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:55.667454 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee962d12-18c9-44a8-a9c1-c782f1c9b714 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:55.668889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee962d12-18c9-44a8-a9c1-c782f1c9b714 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:55.682554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 434/872] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:57:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:55.688327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee427b08-5c2c-4a0e-bf48-a8d10b5ce290 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:55.696121 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214230e6-2556-4020-88f8-1e9f63dca5e5 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:55.696767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214230e6-2556-4020-88f8-1e9f63dca5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:55.697038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214230e6-2556-4020-88f8-1e9f63dca5e5 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:55.699685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 435/873] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:55.705013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d64e-b137-4087-991b-88f85cc12bb4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:55.705290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d64e-b137-4087-991b-88f85cc12bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:55.705551 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d64e-b137-4087-991b-88f85cc12bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:55.727218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5712d64e-b137-4087-991b-88f85cc12bb4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:55.728808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5712d64e-b137-4087-991b-88f85cc12bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:55.814325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 436/874] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:55 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:57:55.832185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee427b08-5c2c-4a0e-bf48-a8d10b5ce290 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:55.869418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42758efc-d53e-424e-987f-d0668b9934a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:55.870487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42758efc-d53e-424e-987f-d0668b9934a1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:55.871044 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42758efc-d53e-424e-987f-d0668b9934a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:55.871515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42758efc-d53e-424e-987f-d0668b9934a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:55.872456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42758efc-d53e-424e-987f-d0668b9934a1 None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=d51d2b73c22747f2b40bccc45352135f) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:55.873033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42758efc-d53e-424e-987f-d0668b9934a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:55.874765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42758efc-d53e-424e-987f-d0668b9934a1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:55.881390 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 439/875] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:57:55 2022] GET /identity/v3/role_assignments?user.id=d51d2b73c22747f2b40bccc45352135f&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:56.049082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8a44b-8a8e-4c8b-b61e-0933460a9e91 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:56.049470 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8a44b-8a8e-4c8b-b61e-0933460a9e91 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:56.049653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8a44b-8a8e-4c8b-b61e-0933460a9e91 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:56.051286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 437/876] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:56.057084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72badcf-195f-403a-950c-d0d98fb52e62 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:56.057676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72badcf-195f-403a-950c-d0d98fb52e62 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:56.058186 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72badcf-195f-403a-950c-d0d98fb52e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:56.077637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c72badcf-195f-403a-950c-d0d98fb52e62 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:56.079249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8a44b-8a8e-4c8b-b61e-0933460a9e91 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:56.079676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c72badcf-195f-403a-950c-d0d98fb52e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:56.148409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:56.151492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:56.170471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 440/877] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:57:56.202813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8a44b-8a8e-4c8b-b61e-0933460a9e91 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:56.237980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f614a1f-62ac-497f-a67f-2da9ca85462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:56.238617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f614a1f-62ac-497f-a67f-2da9ca85462b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:56.238891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f614a1f-62ac-497f-a67f-2da9ca85462b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:56.239154 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f614a1f-62ac-497f-a67f-2da9ca85462b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:56.239737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f614a1f-62ac-497f-a67f-2da9ca85462b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:56.241172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f614a1f-62ac-497f-a67f-2da9ca85462b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0f614a1f-62ac-497f-a67f-2da9ca85462b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:56.250409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:56.251418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:56.252284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 438/878] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 22 21:57:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:56.257426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72badcf-195f-403a-950c-d0d98fb52e62 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:56.360118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72badcf-195f-403a-950c-d0d98fb52e62 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:56.394676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a8b5e-f47d-44eb-b521-13ea9351f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:56.395295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a8b5e-f47d-44eb-b521-13ea9351f285 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:56.395572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a8b5e-f47d-44eb-b521-13ea9351f285 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:56.395839 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a8b5e-f47d-44eb-b521-13ea9351f285 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:56.396478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a8b5e-f47d-44eb-b521-13ea9351f285 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:56.396777 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a8b5e-f47d-44eb-b521-13ea9351f285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:56.398184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a8b5e-f47d-44eb-b521-13ea9351f285 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:56.403518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 441/879] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 22 21:57:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:56.409226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f614a1f-62ac-497f-a67f-2da9ca85462b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:56.454005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a8b5e-f47d-44eb-b521-13ea9351f285 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:56.510261 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:56.517987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f614a1f-62ac-497f-a67f-2da9ca85462b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:56.543663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:56.555949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dca626-10a1-410e-9d7c-9f429260125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:56.556604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dca626-10a1-410e-9d7c-9f429260125a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:56.556879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dca626-10a1-410e-9d7c-9f429260125a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:56.557199 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dca626-10a1-410e-9d7c-9f429260125a None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:56.557990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dca626-10a1-410e-9d7c-9f429260125a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:56.558293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dca626-10a1-410e-9d7c-9f429260125a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:56.559665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dca626-10a1-410e-9d7c-9f429260125a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:56.565420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 439/880] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 22 21:57:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:56.571333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a8b5e-f47d-44eb-b521-13ea9351f285 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:56.613994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4a0e0-a357-46a2-bce4-7b0d0947a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:56.615078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a0e0-a357-46a2-bce4-7b0d0947a92d None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:56.615585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a0e0-a357-46a2-bce4-7b0d0947a92d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:56.616051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a0e0-a357-46a2-bce4-7b0d0947a92d None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:56.616939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4a0e0-a357-46a2-bce4-7b0d0947a92d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:56.618622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4a0e0-a357-46a2-bce4-7b0d0947a92d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:56.641822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 442/881] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:57:56 2022] POST /identity/v3/services => generated 269 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 21:57:57.206255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b9e0-f1b2-4465-bb2f-682c67da0454 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:57.207265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b9e0-f1b2-4465-bb2f-682c67da0454 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:57.207743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b9e0-f1b2-4465-bb2f-682c67da0454 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:57.209576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 440/882] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:57.215309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ed08-d88e-4e7b-8043-621a5509973a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:57.215776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ed08-d88e-4e7b-8043-621a5509973a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:57.215855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ed08-d88e-4e7b-8043-621a5509973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:57.235268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1cf6ed08-d88e-4e7b-8043-621a5509973a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:57.236472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1cf6ed08-d88e-4e7b-8043-621a5509973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:57.315706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 443/883] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:57:57.581218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065b9e0-f1b2-4465-bb2f-682c67da0454 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:57.688821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065b9e0-f1b2-4465-bb2f-682c67da0454 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:57.727537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e0d5f-77f6-4fcf-bf16-6eecb0b4cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:57.728177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0d5f-77f6-4fcf-bf16-6eecb0b4cb83 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:57.728454 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0d5f-77f6-4fcf-bf16-6eecb0b4cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:57.728724 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0d5f-77f6-4fcf-bf16-6eecb0b4cb83 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:57.729310 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e0d5f-77f6-4fcf-bf16-6eecb0b4cb83 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:57.730712 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e0d5f-77f6-4fcf-bf16-6eecb0b4cb83 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ea9e0d5f-77f6-4fcf-bf16-6eecb0b4cb83 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:57.739852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:57.740855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:57.741978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 441/884] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:57:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:57.749188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6ed08-d88e-4e7b-8043-621a5509973a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:57.794526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:57.855397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6ed08-d88e-4e7b-8043-621a5509973a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:57.890977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19315570-050d-4def-86bc-1a5fbf7045bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:57.891971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19315570-050d-4def-86bc-1a5fbf7045bb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:57.892448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19315570-050d-4def-86bc-1a5fbf7045bb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:57.892954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19315570-050d-4def-86bc-1a5fbf7045bb None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:57.893996 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19315570-050d-4def-86bc-1a5fbf7045bb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:57.894520 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19315570-050d-4def-86bc-1a5fbf7045bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:57.896156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19315570-050d-4def-86bc-1a5fbf7045bb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:57.905524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 444/885] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:57:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:57.908392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e0d5f-77f6-4fcf-bf16-6eecb0b4cb83 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:57.966957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:58.020009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e0d5f-77f6-4fcf-bf16-6eecb0b4cb83 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:58.055138 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd111a-9561-44d3-bfb2-3c0f0300a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:58.056148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd111a-9561-44d3-bfb2-3c0f0300a47a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:58.056647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd111a-9561-44d3-bfb2-3c0f0300a47a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:58.057132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd111a-9561-44d3-bfb2-3c0f0300a47a None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:58.057989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd111a-9561-44d3-bfb2-3c0f0300a47a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:58.058489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd111a-9561-44d3-bfb2-3c0f0300a47a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:58.060045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd111a-9561-44d3-bfb2-3c0f0300a47a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:58.069952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 442/886] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:57:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:58.071848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19315570-050d-4def-86bc-1a5fbf7045bb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:58.175420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19315570-050d-4def-86bc-1a5fbf7045bb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:58.176884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:58.214661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa936c6c-78b0-4243-b45b-bb866b996abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:58.215296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa936c6c-78b0-4243-b45b-bb866b996abb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:58.215567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa936c6c-78b0-4243-b45b-bb866b996abb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:58.216202 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa936c6c-78b0-4243-b45b-bb866b996abb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:58.216541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa936c6c-78b0-4243-b45b-bb866b996abb None admin] RBAC: Adding query filter params (interface=public, service_id=e7a348a7ed3d4cdebf5baf5610155da7, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:58.216843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa936c6c-78b0-4243-b45b-bb866b996abb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:58.218255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa936c6c-78b0-4243-b45b-bb866b996abb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:58.224644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 445/887] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 22 21:57:58 2022] GET /identity/v3/endpoints?service_id=e7a348a7ed3d4cdebf5baf5610155da7&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:58.230603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd111a-9561-44d3-bfb2-3c0f0300a47a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:58.322438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465f03-d849-44ad-bd2b-38f1f4e43d3c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:58.323075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465f03-d849-44ad-bd2b-38f1f4e43d3c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:58.323536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465f03-d849-44ad-bd2b-38f1f4e43d3c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:58.325587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 446/888] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:58.331294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1809c8-d484-4243-8a6d-1596fec4a639 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:58.331582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1809c8-d484-4243-8a6d-1596fec4a639 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:58.331859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1809c8-d484-4243-8a6d-1596fec4a639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:58.344136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd111a-9561-44d3-bfb2-3c0f0300a47a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:58.355633 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-de1809c8-d484-4243-8a6d-1596fec4a639 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:58.357162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-de1809c8-d484-4243-8a6d-1596fec4a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:58.361581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:58.385960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95fcbd-6623-4384-9bfe-d49a147566dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:58.386579 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95fcbd-6623-4384-9bfe-d49a147566dd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:58.386853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95fcbd-6623-4384-9bfe-d49a147566dd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:58.387117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95fcbd-6623-4384-9bfe-d49a147566dd None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:58.387727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95fcbd-6623-4384-9bfe-d49a147566dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:58.389088 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95fcbd-6623-4384-9bfe-d49a147566dd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:58.396429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 443/889] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 22 21:57:58 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 21:57:58.454274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 447/890] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:57:58.729794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95fcbd-6623-4384-9bfe-d49a147566dd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:58.781508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587353-01ec-4435-99ad-922aecda9a5e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:58.781873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587353-01ec-4435-99ad-922aecda9a5e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:58.782092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587353-01ec-4435-99ad-922aecda9a5e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:58.783720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 448/891] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:58.789364 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715973e-6681-4eb3-9386-a1122b101e2a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:58.789628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715973e-6681-4eb3-9386-a1122b101e2a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:58.789969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715973e-6681-4eb3-9386-a1122b101e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:58.807614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c715973e-6681-4eb3-9386-a1122b101e2a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:58.808789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c715973e-6681-4eb3-9386-a1122b101e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:58.856907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95fcbd-6623-4384-9bfe-d49a147566dd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:58.877521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 449/892] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:57:58.885859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848df0af-cd45-4f76-8a80-d9aaa40ee667 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:58.885859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848df0af-cd45-4f76-8a80-d9aaa40ee667 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:58.885859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848df0af-cd45-4f76-8a80-d9aaa40ee667 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:58.885859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 450/893] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:57:58.886345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f00dc-6e44-47f9-85d4-b2fa4c6c14e5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:58.886626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f00dc-6e44-47f9-85d4-b2fa4c6c14e5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:58.886935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f00dc-6e44-47f9-85d4-b2fa4c6c14e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:58.905164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89bd2a-b02f-487c-bb7a-1dd9b18f3a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:58.905800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89bd2a-b02f-487c-bb7a-1dd9b18f3a88 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:58.906102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89bd2a-b02f-487c-bb7a-1dd9b18f3a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:58.906368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89bd2a-b02f-487c-bb7a-1dd9b18f3a88 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:58.907245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-913f00dc-6e44-47f9-85d4-b2fa4c6c14e5 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:57:58.908727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-913f00dc-6e44-47f9-85d4-b2fa4c6c14e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:57:58.917768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89bd2a-b02f-487c-bb7a-1dd9b18f3a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2b89bd2a-b02f-487c-bb7a-1dd9b18f3a88 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:57:58.922586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:58.923503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:58.924324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 444/894] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 22 21:57:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:58.929885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89bd2a-b02f-487c-bb7a-1dd9b18f3a88 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:58.935942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:58.973921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:58.992103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 451/895] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:57:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:57:59.042198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89bd2a-b02f-487c-bb7a-1dd9b18f3a88 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:59.077999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c06b56-cbea-4966-b181-52a83b4799d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:59.078932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c06b56-cbea-4966-b181-52a83b4799d0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:59.079368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c06b56-cbea-4966-b181-52a83b4799d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:59.079779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c06b56-cbea-4966-b181-52a83b4799d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:59.080596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c06b56-cbea-4966-b181-52a83b4799d0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:59.081039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c06b56-cbea-4966-b181-52a83b4799d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:59.082634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c06b56-cbea-4966-b181-52a83b4799d0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:59.096924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 445/896] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 22 21:57:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:59.098584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f00dc-6e44-47f9-85d4-b2fa4c6c14e5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:59.186679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c06b56-cbea-4966-b181-52a83b4799d0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:59.205456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f00dc-6e44-47f9-85d4-b2fa4c6c14e5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:59.242077 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123d213-62e1-471e-a2e1-502b2ddb7334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:59.242940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d213-62e1-471e-a2e1-502b2ddb7334 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:59.243399 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d213-62e1-471e-a2e1-502b2ddb7334 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:59.243846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d213-62e1-471e-a2e1-502b2ddb7334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:59.254702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123d213-62e1-471e-a2e1-502b2ddb7334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:59.256336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123d213-62e1-471e-a2e1-502b2ddb7334 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b123d213-62e1-471e-a2e1-502b2ddb7334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:57:59.272314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:59.273278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:57:59.274268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:57:59.274268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:57:59.274268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:59.274268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 452/897] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:59.275016 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123d213-62e1-471e-a2e1-502b2ddb7334 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:59.288722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:59.304464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c06b56-cbea-4966-b181-52a83b4799d0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:59.306616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:59.345354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23805e7e-9e5d-4964-aad1-42289055bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:59.345992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23805e7e-9e5d-4964-aad1-42289055bfa4 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:59.346269 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23805e7e-9e5d-4964-aad1-42289055bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:59.346536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23805e7e-9e5d-4964-aad1-42289055bfa4 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:59.347291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23805e7e-9e5d-4964-aad1-42289055bfa4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:59.348794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23805e7e-9e5d-4964-aad1-42289055bfa4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:59.369882 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 446/898] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:57:59 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 21:57:59.369882 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23805e7e-9e5d-4964-aad1-42289055bfa4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:59.391684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123d213-62e1-471e-a2e1-502b2ddb7334 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:59.447039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ae9a5-c28c-4a17-b83c-901121492c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:59.448181 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ae9a5-c28c-4a17-b83c-901121492c60 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:59.448463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ae9a5-c28c-4a17-b83c-901121492c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:59.448811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ae9a5-c28c-4a17-b83c-901121492c60 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:59.449461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ae9a5-c28c-4a17-b83c-901121492c60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:59.451011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ae9a5-c28c-4a17-b83c-901121492c60 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-aa3ae9a5-c28c-4a17-b83c-901121492c60 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:59.465362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:59.466709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:57:59.467584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 453/899] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Sep 22 21:57:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:57:59.472619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ae9a5-c28c-4a17-b83c-901121492c60 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:59.523881 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23805e7e-9e5d-4964-aad1-42289055bfa4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:59.548944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:59.572000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008cec0-c688-4026-bd76-d30a0391a52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:59.572000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008cec0-c688-4026-bd76-d30a0391a52d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:59.572615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008cec0-c688-4026-bd76-d30a0391a52d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:59.573782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008cec0-c688-4026-bd76-d30a0391a52d None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:59.573782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008cec0-c688-4026-bd76-d30a0391a52d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:59.574072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008cec0-c688-4026-bd76-d30a0391a52d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:59.575511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008cec0-c688-4026-bd76-d30a0391a52d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:59.591842 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ae9a5-c28c-4a17-b83c-901121492c60 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:59.596050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 447/900] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:59.602304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008cec0-c688-4026-bd76-d30a0391a52d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:59.628612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:59.638622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69067c2f-2a31-423d-80ea-17b2a92345f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:59.639258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69067c2f-2a31-423d-80ea-17b2a92345f5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:59.639534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69067c2f-2a31-423d-80ea-17b2a92345f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:59.639803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69067c2f-2a31-423d-80ea-17b2a92345f5 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:59.640449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69067c2f-2a31-423d-80ea-17b2a92345f5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:59.640753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69067c2f-2a31-423d-80ea-17b2a92345f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:59.642198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69067c2f-2a31-423d-80ea-17b2a92345f5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:59.648903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 454/901] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 22 21:57:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:59.655103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69067c2f-2a31-423d-80ea-17b2a92345f5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:59.730221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008cec0-c688-4026-bd76-d30a0391a52d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:59.777635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8894249-42a1-49c8-ba15-736b8412c6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:59.778303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8894249-42a1-49c8-ba15-736b8412c6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:59.778638 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8894249-42a1-49c8-ba15-736b8412c6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:59.778968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8894249-42a1-49c8-ba15-736b8412c6a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:59.780005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69067c2f-2a31-423d-80ea-17b2a92345f5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:59.788016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8894249-42a1-49c8-ba15-736b8412c6a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:59.790177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8894249-42a1-49c8-ba15-736b8412c6a9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b8894249-42a1-49c8-ba15-736b8412c6a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:57:59.806120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:57:59.807105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:57:59.808023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:57:59.808023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:57:59.808023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:57:59.808023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:57:59.808023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:57:59.808023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:57:59.808023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:57:59.808023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:57:59.808023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:57:59.808023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:57:59.808023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 448/902] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 22 21:57:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:57:59.813322 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8894249-42a1-49c8-ba15-736b8412c6a9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:59.814957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:59.822231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe4dd-856b-4e3f-8da0-957cbb9578b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:59.823642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe4dd-856b-4e3f-8da0-957cbb9578b8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:59.824120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe4dd-856b-4e3f-8da0-957cbb9578b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:59.824608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe4dd-856b-4e3f-8da0-957cbb9578b8 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:59.825786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fe4dd-856b-4e3f-8da0-957cbb9578b8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:59.826374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fe4dd-856b-4e3f-8da0-957cbb9578b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:59.828645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fe4dd-856b-4e3f-8da0-957cbb9578b8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:59.835644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 455/903] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 22 21:57:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:57:59.841576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe4dd-856b-4e3f-8da0-957cbb9578b8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:59.922085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8894249-42a1-49c8-ba15-736b8412c6a9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:59.930368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:57:59.948775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe4dd-856b-4e3f-8da0-957cbb9578b8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:57:59.959932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e5392-3c80-4397-b8a1-c715a7057fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:59.960924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e5392-3c80-4397-b8a1-c715a7057fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:59.961797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e5392-3c80-4397-b8a1-c715a7057fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:59.962328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e5392-3c80-4397-b8a1-c715a7057fd7 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:59.963257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e5392-3c80-4397-b8a1-c715a7057fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:59.963828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e5392-3c80-4397-b8a1-c715a7057fd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:59.965592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e5392-3c80-4397-b8a1-c715a7057fd7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:59.985476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88035c75-9b08-490d-8a72-d9b07f07de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:57:59.985476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88035c75-9b08-490d-8a72-d9b07f07de89 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:57:59.985476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88035c75-9b08-490d-8a72-d9b07f07de89 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:57:59.985800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88035c75-9b08-490d-8a72-d9b07f07de89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:57:59.989565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88035c75-9b08-490d-8a72-d9b07f07de89 None admin] RBAC: Adding query filter params (interface=public, service_id=33fbe18580e146ba814a396375a63fbd, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:57:59.989565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88035c75-9b08-490d-8a72-d9b07f07de89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:57:59.989565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88035c75-9b08-490d-8a72-d9b07f07de89 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:57:59.990272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 449/904] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 22 21:57:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:57:59.991799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e5392-3c80-4397-b8a1-c715a7057fd7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:57:59.994004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 456/905] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 22 21:57:59 2022] GET /identity/v3/endpoints?service_id=33fbe18580e146ba814a396375a63fbd&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:00.002896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88035c75-9b08-490d-8a72-d9b07f07de89 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:00.067055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:00.099560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e5392-3c80-4397-b8a1-c715a7057fd7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:00.111040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88035c75-9b08-490d-8a72-d9b07f07de89 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:00.135637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac1188-cd44-477f-8ff0-645044812cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:00.136511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac1188-cd44-477f-8ff0-645044812cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:00.136929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac1188-cd44-477f-8ff0-645044812cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:00.137358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac1188-cd44-477f-8ff0-645044812cd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:00.147906 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3adee-ff3a-4aaf-983a-8de410f26d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:00.148897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:00.150088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3adee-ff3a-4aaf-983a-8de410f26d47 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:00.150689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3adee-ff3a-4aaf-983a-8de410f26d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:00.151200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3adee-ff3a-4aaf-983a-8de410f26d47 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:00.152100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3adee-ff3a-4aaf-983a-8de410f26d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:00.153742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3adee-ff3a-4aaf-983a-8de410f26d47 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:00.166359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 457/906] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 22 21:58:00 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 21:58:00.214030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac1188-cd44-477f-8ff0-645044812cd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:00.215531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac1188-cd44-477f-8ff0-645044812cd3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:00.334133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 450/907] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:57:59 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 21:58:00.337178 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3adee-ff3a-4aaf-983a-8de410f26d47 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:00.448541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3adee-ff3a-4aaf-983a-8de410f26d47 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:00.478239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:00.489720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9fd86-1834-4798-ba38-2a367f6f9ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:00.490394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9fd86-1834-4798-ba38-2a367f6f9ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:00.490674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9fd86-1834-4798-ba38-2a367f6f9ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:00.490949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9fd86-1834-4798-ba38-2a367f6f9ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:00.502101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9fd86-1834-4798-ba38-2a367f6f9ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:00.503558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9fd86-1834-4798-ba38-2a367f6f9ff3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-27c9fd86-1834-4798-ba38-2a367f6f9ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:00.519331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:00.520309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:00.521185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:00.521185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:00.521185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:00.524444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 458/908] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:00.527127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac1188-cd44-477f-8ff0-645044812cd3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:00.574276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:00.639721 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac1188-cd44-477f-8ff0-645044812cd3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:00.663292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf8b8-36e8-4ee6-9c7a-4decee1a89e5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:00.663628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf8b8-36e8-4ee6-9c7a-4decee1a89e5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:00.663844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf8b8-36e8-4ee6-9c7a-4decee1a89e5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:00.667956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 459/909] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:00.671653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822292c-eeba-4a2c-ba12-feb85f940b84 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:00.672032 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822292c-eeba-4a2c-ba12-feb85f940b84 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:00.672315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822292c-eeba-4a2c-ba12-feb85f940b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:00.676993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768e393-5073-4778-ae10-407517ac09e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:00.677612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768e393-5073-4778-ae10-407517ac09e1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:00.677922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768e393-5073-4778-ae10-407517ac09e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:00.678193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768e393-5073-4778-ae10-407517ac09e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:00.678839 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768e393-5073-4778-ae10-407517ac09e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:00.679140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768e393-5073-4778-ae10-407517ac09e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:00.680772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768e393-5073-4778-ae10-407517ac09e1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:00.692586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2822292c-eeba-4a2c-ba12-feb85f940b84 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:00.693790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2822292c-eeba-4a2c-ba12-feb85f940b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:00.697525 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 451/910] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:00.701226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768e393-5073-4778-ae10-407517ac09e1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:00.784492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 460/911] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:00.801088 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:00.804245 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768e393-5073-4778-ae10-407517ac09e1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:00.841031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed6c0-ab58-4b98-bc20-4c6ab5d465c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:00.841666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed6c0-ab58-4b98-bc20-4c6ab5d465c2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:00.841969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed6c0-ab58-4b98-bc20-4c6ab5d465c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:00.842236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed6c0-ab58-4b98-bc20-4c6ab5d465c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:00.848992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bed6c0-ab58-4b98-bc20-4c6ab5d465c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:00.850471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bed6c0-ab58-4b98-bc20-4c6ab5d465c2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e1bed6c0-ab58-4b98-bc20-4c6ab5d465c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:58:00.863567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:00.864705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:00.865884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:58:00.865884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:58:00.865884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:58:00.865884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:58:00.865884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:58:00.865884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:58:00.865884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:00.865884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:00.869622 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 452/912] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:00.871032 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822292c-eeba-4a2c-ba12-feb85f940b84 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:00.969611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822292c-eeba-4a2c-ba12-feb85f940b84 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:00.977278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:01.008170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a3bd2-745a-45f5-b9db-821a4aba6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:01.008964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a3bd2-745a-45f5-b9db-821a4aba6e94 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:01.009333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a3bd2-745a-45f5-b9db-821a4aba6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:01.009696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a3bd2-745a-45f5-b9db-821a4aba6e94 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:01.010523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a3bd2-745a-45f5-b9db-821a4aba6e94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:01.010919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a3bd2-745a-45f5-b9db-821a4aba6e94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:01.012442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a3bd2-745a-45f5-b9db-821a4aba6e94 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:01.025260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 461/913] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:01.031068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed6c0-ab58-4b98-bc20-4c6ab5d465c2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:01.070159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a3bd2-745a-45f5-b9db-821a4aba6e94 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:01.134377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed6c0-ab58-4b98-bc20-4c6ab5d465c2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:01.169880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e923-3fe3-4c6e-be4a-58e608543955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:01.170511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e923-3fe3-4c6e-be4a-58e608543955 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:01.170893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e923-3fe3-4c6e-be4a-58e608543955 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:01.171191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e923-3fe3-4c6e-be4a-58e608543955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:01.172017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7e923-3fe3-4c6e-be4a-58e608543955 None admin] RBAC: Adding query filter params (role.id=22d0e8156009474698e29ac27aef7f02, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=d51d2b73c22747f2b40bccc45352135f) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:01.172330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7e923-3fe3-4c6e-be4a-58e608543955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:01.173822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7e923-3fe3-4c6e-be4a-58e608543955 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:01.175193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a3bd2-745a-45f5-b9db-821a4aba6e94 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:01.186013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 453/914] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:58:01 2022] GET /identity/v3/role_assignments?user.id=d51d2b73c22747f2b40bccc45352135f&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=22d0e8156009474698e29ac27aef7f02 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:01.215822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836028a-5a22-4b54-9827-bfa9b4562507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:01.216697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836028a-5a22-4b54-9827-bfa9b4562507 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:01.216971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836028a-5a22-4b54-9827-bfa9b4562507 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:01.217240 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836028a-5a22-4b54-9827-bfa9b4562507 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:01.217862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836028a-5a22-4b54-9827-bfa9b4562507 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:01.219334 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836028a-5a22-4b54-9827-bfa9b4562507 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3836028a-5a22-4b54-9827-bfa9b4562507 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:01.229893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:01.230941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:01.231775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 462/915] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:58:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:01.239044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e923-3fe3-4c6e-be4a-58e608543955 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:01.274508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:01.363308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e923-3fe3-4c6e-be4a-58e608543955 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:01.400248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe01a73-a4ae-4f69-a91d-f6f725cfb885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:01.400864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe01a73-a4ae-4f69-a91d-f6f725cfb885 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:01.401139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe01a73-a4ae-4f69-a91d-f6f725cfb885 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:01.401408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe01a73-a4ae-4f69-a91d-f6f725cfb885 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:01.402079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe01a73-a4ae-4f69-a91d-f6f725cfb885 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:01.402383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe01a73-a4ae-4f69-a91d-f6f725cfb885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:01.403856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe01a73-a4ae-4f69-a91d-f6f725cfb885 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:01.409434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 454/916] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:58:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:01.415875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836028a-5a22-4b54-9827-bfa9b4562507 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:01.450531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:01.528449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836028a-5a22-4b54-9827-bfa9b4562507 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:01.564778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a61d3-6afb-4e87-9b6a-2ab1022f9653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:01.565392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a61d3-6afb-4e87-9b6a-2ab1022f9653 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:01.565666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a61d3-6afb-4e87-9b6a-2ab1022f9653 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:01.565957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a61d3-6afb-4e87-9b6a-2ab1022f9653 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:01.566593 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a61d3-6afb-4e87-9b6a-2ab1022f9653 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:01.566888 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a61d3-6afb-4e87-9b6a-2ab1022f9653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:01.568247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a61d3-6afb-4e87-9b6a-2ab1022f9653 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:01.573936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 463/917] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 22 21:58:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:01.579589 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe01a73-a4ae-4f69-a91d-f6f725cfb885 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:01.605804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afc70-d291-48b8-b25e-ff1aa348691a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:01.606152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afc70-d291-48b8-b25e-ff1aa348691a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:01.606379 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afc70-d291-48b8-b25e-ff1aa348691a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:01.608257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 464/918] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:58:01.614162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931505a-34b1-4e34-a9dd-58c6728f42b4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:01.614456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931505a-34b1-4e34-a9dd-58c6728f42b4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:01.614712 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931505a-34b1-4e34-a9dd-58c6728f42b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:01.636969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d931505a-34b1-4e34-a9dd-58c6728f42b4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:01.638584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d931505a-34b1-4e34-a9dd-58c6728f42b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:01.683937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:01.697782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe01a73-a4ae-4f69-a91d-f6f725cfb885 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:01.720885 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 465/919] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:01.740227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f073b-3cd5-4fd4-8ef9-1920a7d49c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:01.740902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f073b-3cd5-4fd4-8ef9-1920a7d49c25 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:01.741181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f073b-3cd5-4fd4-8ef9-1920a7d49c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:01.741456 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f073b-3cd5-4fd4-8ef9-1920a7d49c25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:01.742222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f073b-3cd5-4fd4-8ef9-1920a7d49c25 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:01.743766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f073b-3cd5-4fd4-8ef9-1920a7d49c25 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:01.774347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 455/920] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 21:58:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:01.992903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931505a-34b1-4e34-a9dd-58c6728f42b4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:02.019375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:02.096194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931505a-34b1-4e34-a9dd-58c6728f42b4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:02.138840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6462e5c-c147-4125-aed2-ab29a0fca8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:02.139510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6462e5c-c147-4125-aed2-ab29a0fca8dd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:02.139790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6462e5c-c147-4125-aed2-ab29a0fca8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:02.140067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6462e5c-c147-4125-aed2-ab29a0fca8dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:02.140678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6462e5c-c147-4125-aed2-ab29a0fca8dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:02.142137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6462e5c-c147-4125-aed2-ab29a0fca8dd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f6462e5c-c147-4125-aed2-ab29a0fca8dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:02.151890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:02.152915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:02.153800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 466/921] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 22 21:58:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:02.161259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f073b-3cd5-4fd4-8ef9-1920a7d49c25 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:02.265001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f073b-3cd5-4fd4-8ef9-1920a7d49c25 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:02.299574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea99c72-a9b0-478f-9021-fe80ad88ea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:02.300209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea99c72-a9b0-478f-9021-fe80ad88ea49 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:02.300481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea99c72-a9b0-478f-9021-fe80ad88ea49 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:02.300748 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea99c72-a9b0-478f-9021-fe80ad88ea49 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:02.301394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea99c72-a9b0-478f-9021-fe80ad88ea49 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:02.301695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea99c72-a9b0-478f-9021-fe80ad88ea49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:02.303126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea99c72-a9b0-478f-9021-fe80ad88ea49 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:02.309315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 456/922] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 22 21:58:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:02.315151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6462e5c-c147-4125-aed2-ab29a0fca8dd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:02.410265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:02.428355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6462e5c-c147-4125-aed2-ab29a0fca8dd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:02.463142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fcff7-e6d0-4a61-90cf-d424a31f599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:02.463763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fcff7-e6d0-4a61-90cf-d424a31f599b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:02.464039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fcff7-e6d0-4a61-90cf-d424a31f599b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:02.464306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fcff7-e6d0-4a61-90cf-d424a31f599b None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:02.464946 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fcff7-e6d0-4a61-90cf-d424a31f599b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:02.465255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fcff7-e6d0-4a61-90cf-d424a31f599b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:02.466724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fcff7-e6d0-4a61-90cf-d424a31f599b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:02.472205 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 467/923] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 22 21:58:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:02.478129 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea99c72-a9b0-478f-9021-fe80ad88ea49 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:02.512969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955587d-7ef7-474e-8cde-e62e854910c9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:02.513303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955587d-7ef7-474e-8cde-e62e854910c9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:02.513518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955587d-7ef7-474e-8cde-e62e854910c9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:02.514432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:02.515463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 468/924] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:02.522432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10da268-8b52-4feb-8e97-dfeac64b0520 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:02.522711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10da268-8b52-4feb-8e97-dfeac64b0520 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:02.522978 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10da268-8b52-4feb-8e97-dfeac64b0520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:02.542671 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d10da268-8b52-4feb-8e97-dfeac64b0520 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:02.543861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d10da268-8b52-4feb-8e97-dfeac64b0520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:02.601815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea99c72-a9b0-478f-9021-fe80ad88ea49 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:02.615150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 469/925] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:02.643715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82011-e6fa-48c8-be0e-1d3d0f119c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:02.644332 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82011-e6fa-48c8-be0e-1d3d0f119c84 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:02.644607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82011-e6fa-48c8-be0e-1d3d0f119c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:02.644921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82011-e6fa-48c8-be0e-1d3d0f119c84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:02.645635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c82011-e6fa-48c8-be0e-1d3d0f119c84 None admin] RBAC: Adding query filter params (interface=public, service_id=6ec90ca152d24ae386c86c37d4a3975c, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:02.646013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c82011-e6fa-48c8-be0e-1d3d0f119c84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:02.647392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c82011-e6fa-48c8-be0e-1d3d0f119c84 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:02.653410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 457/926] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 22 21:58:02 2022] GET /identity/v3/endpoints?service_id=6ec90ca152d24ae386c86c37d4a3975c&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:02.659118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10da268-8b52-4feb-8e97-dfeac64b0520 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:02.742589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:02.768368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10da268-8b52-4feb-8e97-dfeac64b0520 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:02.802442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f9731-70ca-4262-9e44-59e204a479da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:02.803050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f9731-70ca-4262-9e44-59e204a479da None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:02.803321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f9731-70ca-4262-9e44-59e204a479da None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:02.803585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f9731-70ca-4262-9e44-59e204a479da None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:02.804188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f9731-70ca-4262-9e44-59e204a479da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:02.805717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f9731-70ca-4262-9e44-59e204a479da None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:02.811958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 470/927] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 22 21:58:02 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 21:58:02.915330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82011-e6fa-48c8-be0e-1d3d0f119c84 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:02.991954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:03.024457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82011-e6fa-48c8-be0e-1d3d0f119c84 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:03.060324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be2698-efb5-42d8-9ddb-934719f89954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:03.061019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2698-efb5-42d8-9ddb-934719f89954 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:03.061288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2698-efb5-42d8-9ddb-934719f89954 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:03.061548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2698-efb5-42d8-9ddb-934719f89954 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:03.062195 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be2698-efb5-42d8-9ddb-934719f89954 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:03.063609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be2698-efb5-42d8-9ddb-934719f89954 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-69be2698-efb5-42d8-9ddb-934719f89954 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:03.072607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:03.073557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 21:58:03.074475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:03.077938 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 458/928] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Sep 22 21:58:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:03.082987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f9731-70ca-4262-9e44-59e204a479da None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:03.186033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f9731-70ca-4262-9e44-59e204a479da None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:03.221378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97623275-0bb6-48af-a59a-f9c68cc6231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:03.222029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97623275-0bb6-48af-a59a-f9c68cc6231d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:03.222304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97623275-0bb6-48af-a59a-f9c68cc6231d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:03.222573 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97623275-0bb6-48af-a59a-f9c68cc6231d None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:03.223203 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97623275-0bb6-48af-a59a-f9c68cc6231d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:03.223503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97623275-0bb6-48af-a59a-f9c68cc6231d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:03.224929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97623275-0bb6-48af-a59a-f9c68cc6231d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:03.234049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 471/929] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 22 21:58:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:03.236064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be2698-efb5-42d8-9ddb-934719f89954 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:03.338082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be2698-efb5-42d8-9ddb-934719f89954 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:03.377388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed908b-89db-4457-8667-a11f10ccb96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:03.378036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed908b-89db-4457-8667-a11f10ccb96d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:03.378305 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed908b-89db-4457-8667-a11f10ccb96d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:03.378568 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed908b-89db-4457-8667-a11f10ccb96d None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:03.379203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed908b-89db-4457-8667-a11f10ccb96d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:03.379493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed908b-89db-4457-8667-a11f10ccb96d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:03.380929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed908b-89db-4457-8667-a11f10ccb96d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:03.383636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:03.392350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 459/930] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 22 21:58:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:03.393941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97623275-0bb6-48af-a59a-f9c68cc6231d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:03.410186 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:03.472330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966147fe-f125-4dae-9815-0f37bcd64976 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:03.472660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966147fe-f125-4dae-9815-0f37bcd64976 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:03.472863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966147fe-f125-4dae-9815-0f37bcd64976 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:03.474541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 460/931] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:03.481522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7221-16fc-4d1b-b3a8-345652e4c11d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:03.482127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7221-16fc-4d1b-b3a8-345652e4c11d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:03.482127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7221-16fc-4d1b-b3a8-345652e4c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:03.505997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e65c7221-16fc-4d1b-b3a8-345652e4c11d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:03.506175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97623275-0bb6-48af-a59a-f9c68cc6231d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:03.509079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e65c7221-16fc-4d1b-b3a8-345652e4c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:03.541292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d33b-2435-4570-be41-5eb500070c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:03.541935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d33b-2435-4570-be41-5eb500070c22 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:03.542211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d33b-2435-4570-be41-5eb500070c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:03.542478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d33b-2435-4570-be41-5eb500070c22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:03.543141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d33b-2435-4570-be41-5eb500070c22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:03.544507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d33b-2435-4570-be41-5eb500070c22 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:03.573873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 472/932] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 21:58:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:03.602776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 461/933] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:03.887211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d33b-2435-4570-be41-5eb500070c22 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:03.957300 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:04.017191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d33b-2435-4570-be41-5eb500070c22 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:04.062196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb65a0-3c8f-41f1-b7b9-376db101aa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:04.062846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb65a0-3c8f-41f1-b7b9-376db101aa98 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:04.063115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb65a0-3c8f-41f1-b7b9-376db101aa98 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:04.063407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb65a0-3c8f-41f1-b7b9-376db101aa98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:04.074918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb65a0-3c8f-41f1-b7b9-376db101aa98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-dfdb65a0-3c8f-41f1-b7b9-376db101aa98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:58:04.080344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:04.081260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:04.082124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 473/934] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 22 21:58:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:04.090027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7221-16fc-4d1b-b3a8-345652e4c11d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:04.093093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ed0b6-ce7d-4c68-80b6-79cf433b2b0e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:04.093372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ed0b6-ce7d-4c68-80b6-79cf433b2b0e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:04.093644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ed0b6-ce7d-4c68-80b6-79cf433b2b0e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:04.095329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 474/935] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:58:04.100931 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74866c9-5890-4915-86a5-a6506645cd52 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:04.101237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74866c9-5890-4915-86a5-a6506645cd52 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:04.101505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74866c9-5890-4915-86a5-a6506645cd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:04.120256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d74866c9-5890-4915-86a5-a6506645cd52 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:04.121464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d74866c9-5890-4915-86a5-a6506645cd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:04.197943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 475/936] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:04.217848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7221-16fc-4d1b-b3a8-345652e4c11d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:04.247592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:04.258662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458a252-f3d2-4335-9eab-4f0db5639b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:04.259633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458a252-f3d2-4335-9eab-4f0db5639b5e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:04.260115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458a252-f3d2-4335-9eab-4f0db5639b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:04.260570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458a252-f3d2-4335-9eab-4f0db5639b5e None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:04.261515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458a252-f3d2-4335-9eab-4f0db5639b5e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:04.262023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458a252-f3d2-4335-9eab-4f0db5639b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:04.263571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458a252-f3d2-4335-9eab-4f0db5639b5e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:04.272845 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 462/937] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 22 21:58:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:04.278908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74866c9-5890-4915-86a5-a6506645cd52 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:04.340544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:04.404315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74866c9-5890-4915-86a5-a6506645cd52 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:04.440924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725fa6a-cf68-4061-8e9f-a1d9296ebea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:04.441986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725fa6a-cf68-4061-8e9f-a1d9296ebea0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:04.442472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725fa6a-cf68-4061-8e9f-a1d9296ebea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:04.442944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725fa6a-cf68-4061-8e9f-a1d9296ebea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:04.454370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725fa6a-cf68-4061-8e9f-a1d9296ebea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:04.456229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725fa6a-cf68-4061-8e9f-a1d9296ebea0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-9725fa6a-cf68-4061-8e9f-a1d9296ebea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:04.475795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:04.476836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:04.477729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:04.477729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:04.477729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:04.479430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 476/938] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:04.479902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458a252-f3d2-4335-9eab-4f0db5639b5e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:04.485937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725fa6a-cf68-4061-8e9f-a1d9296ebea0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:04.592890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725fa6a-cf68-4061-8e9f-a1d9296ebea0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:04.602223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:04.627500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458a252-f3d2-4335-9eab-4f0db5639b5e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:04.643887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20471af-44fc-43a8-bc97-60f35aa445e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:04.645170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20471af-44fc-43a8-bc97-60f35aa445e2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:04.645652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20471af-44fc-43a8-bc97-60f35aa445e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:04.646619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20471af-44fc-43a8-bc97-60f35aa445e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:04.647510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20471af-44fc-43a8-bc97-60f35aa445e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:04.648299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20471af-44fc-43a8-bc97-60f35aa445e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:04.651797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20471af-44fc-43a8-bc97-60f35aa445e2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:04.670395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b705a-e7d2-4256-967d-3c3129e37c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:04.671008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b705a-e7d2-4256-967d-3c3129e37c6e None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:04.671277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b705a-e7d2-4256-967d-3c3129e37c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:04.671547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b705a-e7d2-4256-967d-3c3129e37c6e None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:04.672193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b705a-e7d2-4256-967d-3c3129e37c6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:04.673052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 477/939] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:04.673684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b705a-e7d2-4256-967d-3c3129e37c6e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:04.680256 dv-cinder-849143-6-smb devstack@keystone.service[81639]: WARNING keystone.server.flask.common [None req-c12b705a-e7d2-4256-967d-3c3129e37c6e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 22 21:58:04.682093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20471af-44fc-43a8-bc97-60f35aa445e2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:04.711655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.sql.core [None req-c12b705a-e7d2-4256-967d-3c3129e37c6e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 21:58:04.711655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 21:58:04.711655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [parameters: {'id': 'b63e95fc64a440ccbe04369159bb4ffa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 21:58:04.711655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81639) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c12b705a-e7d2-4256-967d-3c3129e37c6e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b63e95fc64a440ccbe04369159bb4ffa.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b63e95fc64a440ccbe04369159bb4ffa. Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application conn.query(q) Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 21:58:04.735586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application result.read() Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 22 21:58:04.736487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application next(self.gen) Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application yield resource Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application next(self.gen) Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise self.value Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application session.commit() Sep 22 21:58:04.737484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.session.flush() Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application compat.raise_( Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 21:58:04.739137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 21:58:04.740072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application conn.query(q) Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application result.read() Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 21:58:04.740867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [parameters: {'id': 'b63e95fc64a440ccbe04369159bb4ffa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:04.742941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:04.745404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:04.748108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:04.748108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 22 21:58:04.748108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 22 21:58:04.748108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:04.748108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:04.748108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 22 21:58:04.748108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 22 21:58:04.748108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b63e95fc64a440ccbe04369159bb4ffa. Sep 22 21:58:04.748108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:04.748108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 463/940] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Sep 22 21:58:04 2022] POST /identity/v3/projects => generated 262 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:04.748108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b705a-e7d2-4256-967d-3c3129e37c6e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:04.811576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:04.840062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20471af-44fc-43a8-bc97-60f35aa445e2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:04.884452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b705a-e7d2-4256-967d-3c3129e37c6e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:04.886510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecaf38-f8a1-4b3f-8004-434253a004fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:04.888301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecaf38-f8a1-4b3f-8004-434253a004fa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:04.888801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecaf38-f8a1-4b3f-8004-434253a004fa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:04.889283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecaf38-f8a1-4b3f-8004-434253a004fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:04.899189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecaf38-f8a1-4b3f-8004-434253a004fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:04.901118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecaf38-f8a1-4b3f-8004-434253a004fa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-9cecaf38-f8a1-4b3f-8004-434253a004fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:58:04.917494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:04.918652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:04.919830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:04.919830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:04.919830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:58:04.919830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:58:04.919830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:58:04.919830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:58:04.919830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:58:04.919830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:58:04.919830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:58:04.919830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:04.922143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 478/941] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 22 21:58:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:04.927441 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecaf38-f8a1-4b3f-8004-434253a004fa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:04.930358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f772f7-3cdf-47a0-843f-801d26efcbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:04.931014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f772f7-3cdf-47a0-843f-801d26efcbef None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:04.931470 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f772f7-3cdf-47a0-843f-801d26efcbef None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:04.931668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f772f7-3cdf-47a0-843f-801d26efcbef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:04.940097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f772f7-3cdf-47a0-843f-801d26efcbef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:04.941982 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f772f7-3cdf-47a0-843f-801d26efcbef None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-54f772f7-3cdf-47a0-843f-801d26efcbef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:58:04.955293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:04.956254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:04.957116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:58:04.957116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:58:04.957116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:58:04.957116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:58:04.957116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:58:04.957116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:58:04.957116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:04.957116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:04.962234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 464/942] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:58:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:04.962666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:04.964853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f772f7-3cdf-47a0-843f-801d26efcbef None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:05.043106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecaf38-f8a1-4b3f-8004-434253a004fa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:05.078751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21191824-e735-4ff9-b320-2d4a404c3cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:05.079811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191824-e735-4ff9-b320-2d4a404c3cbe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:05.080323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191824-e735-4ff9-b320-2d4a404c3cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:05.080777 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191824-e735-4ff9-b320-2d4a404c3cbe None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:05.081717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21191824-e735-4ff9-b320-2d4a404c3cbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:05.082257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21191824-e735-4ff9-b320-2d4a404c3cbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:05.083885 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21191824-e735-4ff9-b320-2d4a404c3cbe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:05.094061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f772f7-3cdf-47a0-843f-801d26efcbef None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:05.098411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:05.112344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 479/943] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 22 21:58:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:05.113911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21191824-e735-4ff9-b320-2d4a404c3cbe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:05.143260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe66b9-69e0-463e-9334-b7636f561299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:05.143877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe66b9-69e0-463e-9334-b7636f561299 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:05.144156 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe66b9-69e0-463e-9334-b7636f561299 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:05.144459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe66b9-69e0-463e-9334-b7636f561299 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:05.145541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe66b9-69e0-463e-9334-b7636f561299 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:05.146021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe66b9-69e0-463e-9334-b7636f561299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:05.147831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe66b9-69e0-463e-9334-b7636f561299 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:05.177928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 465/944] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:58:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:05.214822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:05.225326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b2cf8-9063-4787-bd88-7dbc3f5b41b4 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:05.225673 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b2cf8-9063-4787-bd88-7dbc3f5b41b4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:05.225883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b2cf8-9063-4787-bd88-7dbc3f5b41b4 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:05.227466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 466/945] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:58:05.233241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682bd34-520f-4aea-9490-f24ddc8de543 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:05.233556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682bd34-520f-4aea-9490-f24ddc8de543 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:05.233815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682bd34-520f-4aea-9490-f24ddc8de543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:05.238946 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21191824-e735-4ff9-b320-2d4a404c3cbe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:05.254483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0682bd34-520f-4aea-9490-f24ddc8de543 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:05.256313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0682bd34-520f-4aea-9490-f24ddc8de543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:05.278461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d2c8e-ceb5-4390-aec8-46a699a5b45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:05.279116 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2c8e-ceb5-4390-aec8-46a699a5b45a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:05.279396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2c8e-ceb5-4390-aec8-46a699a5b45a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:05.279802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2c8e-ceb5-4390-aec8-46a699a5b45a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:05.295993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d2c8e-ceb5-4390-aec8-46a699a5b45a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:05.297581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d2c8e-ceb5-4390-aec8-46a699a5b45a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4f9d2c8e-ceb5-4390-aec8-46a699a5b45a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:05.317736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:05.318784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:05.319699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:05.319699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:05.319699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:05.322000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 480/946] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:05.324992 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d2c8e-ceb5-4390-aec8-46a699a5b45a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:05.348169 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 467/947] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:05.441875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d2c8e-ceb5-4390-aec8-46a699a5b45a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:05.478066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dea72-d2ba-4209-bcf2-488fc0508021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:05.478934 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dea72-d2ba-4209-bcf2-488fc0508021 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:05.479213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dea72-d2ba-4209-bcf2-488fc0508021 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:05.479485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dea72-d2ba-4209-bcf2-488fc0508021 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:05.480141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dea72-d2ba-4209-bcf2-488fc0508021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:05.480445 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dea72-d2ba-4209-bcf2-488fc0508021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:05.481811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dea72-d2ba-4209-bcf2-488fc0508021 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:05.483392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:05.496497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 481/948] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:05.501771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682bd34-520f-4aea-9490-f24ddc8de543 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:05.596560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:05.603930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682bd34-520f-4aea-9490-f24ddc8de543 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:05.637373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dea72-d2ba-4209-bcf2-488fc0508021 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:05.641392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85828c-c3a1-4e89-a528-ad926ee4d52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:05.642063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85828c-c3a1-4e89-a528-ad926ee4d52e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:05.642342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85828c-c3a1-4e89-a528-ad926ee4d52e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:05.642672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85828c-c3a1-4e89-a528-ad926ee4d52e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:05.651394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85828c-c3a1-4e89-a528-ad926ee4d52e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:05.652856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85828c-c3a1-4e89-a528-ad926ee4d52e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0c85828c-c3a1-4e89-a528-ad926ee4d52e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:58:05.668082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:05.669041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:05.670543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:58:05.670543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:58:05.670543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:58:05.670543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:58:05.670543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:58:05.670543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:58:05.670543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:05.670543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:05.670543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 468/949] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:05.679069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85828c-c3a1-4e89-a528-ad926ee4d52e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:05.765456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dea72-d2ba-4209-bcf2-488fc0508021 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:05.791621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85828c-c3a1-4e89-a528-ad926ee4d52e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:05.810263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeaa45-7d5b-4aa5-b171-94a166e32bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:05.811357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeaa45-7d5b-4aa5-b171-94a166e32bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:05.811835 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeaa45-7d5b-4aa5-b171-94a166e32bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:05.812304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeaa45-7d5b-4aa5-b171-94a166e32bf1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:05.813111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeaa45-7d5b-4aa5-b171-94a166e32bf1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:05.814800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeaa45-7d5b-4aa5-b171-94a166e32bf1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-effeaa45-7d5b-4aa5-b171-94a166e32bf1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:05.826707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:05.827747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:05.828578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:05.829328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a6045-632c-4f0f-aa05-f7b54f77e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:05.829328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6045-632c-4f0f-aa05-f7b54f77e91a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:05.829328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6045-632c-4f0f-aa05-f7b54f77e91a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:05.829328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6045-632c-4f0f-aa05-f7b54f77e91a None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:05.830244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a6045-632c-4f0f-aa05-f7b54f77e91a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:05.830244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a6045-632c-4f0f-aa05-f7b54f77e91a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:05.831635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a6045-632c-4f0f-aa05-f7b54f77e91a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:05.836516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 482/950] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 22 21:58:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:05.839167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeaa45-7d5b-4aa5-b171-94a166e32bf1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:05.849972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 469/951] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:05.852240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a6045-632c-4f0f-aa05-f7b54f77e91a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:05.869085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:05.917303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:05.961969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeaa45-7d5b-4aa5-b171-94a166e32bf1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:05.965279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a6045-632c-4f0f-aa05-f7b54f77e91a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:05.998723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0452a5-76c6-4a9e-9153-c60f82c9a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:05.999598 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0452a5-76c6-4a9e-9153-c60f82c9a334 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:06.000002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0452a5-76c6-4a9e-9153-c60f82c9a334 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:06.000532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0452a5-76c6-4a9e-9153-c60f82c9a334 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:06.001091 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ca4fe-8c23-42ad-9a2a-aec141a5ab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:06.001741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0452a5-76c6-4a9e-9153-c60f82c9a334 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:06.001865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ca4fe-8c23-42ad-9a2a-aec141a5ab81 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:06.002066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0452a5-76c6-4a9e-9153-c60f82c9a334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:06.002164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ca4fe-8c23-42ad-9a2a-aec141a5ab81 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:06.002352 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ca4fe-8c23-42ad-9a2a-aec141a5ab81 None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/d51d2b73c22747f2b40bccc45352135f/roles/22d0e8156009474698e29ac27aef7f02` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:06.003845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0452a5-76c6-4a9e-9153-c60f82c9a334 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:06.004710 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ca4fe-8c23-42ad-9a2a-aec141a5ab81 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=d51d2b73c22747f2b40bccc45352135f, role_id=22d0e8156009474698e29ac27aef7f02)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:06.006280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ca4fe-8c23-42ad-9a2a-aec141a5ab81 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:06.009894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 483/952] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 22 21:58:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:06.011123 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d57e27-1386-40f5-8bbf-d4c05c31f33e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:06.011465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d57e27-1386-40f5-8bbf-d4c05c31f33e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:06.011738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d57e27-1386-40f5-8bbf-d4c05c31f33e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:06.013064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 484/953] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:06.018101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d57e27-1386-40f5-8bbf-d4c05c31f33e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:06.028421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 470/954] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:58:05 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/d51d2b73c22747f2b40bccc45352135f/roles/22d0e8156009474698e29ac27aef7f02 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:58:06.030171 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f1b38-db3b-42d6-9126-35756982c1b7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:06.030627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f1b38-db3b-42d6-9126-35756982c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:06.031066 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f1b38-db3b-42d6-9126-35756982c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:06.052118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-845f1b38-db3b-42d6-9126-35756982c1b7 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:06.053712 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-845f1b38-db3b-42d6-9126-35756982c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:06.133398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 471/955] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:06.162247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d57e27-1386-40f5-8bbf-d4c05c31f33e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:06.188437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:06.202304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690e307-b4e4-4b43-a1a1-71585a827422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:06.202932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690e307-b4e4-4b43-a1a1-71585a827422 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:06.203207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690e307-b4e4-4b43-a1a1-71585a827422 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:06.203480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690e307-b4e4-4b43-a1a1-71585a827422 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:06.204133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690e307-b4e4-4b43-a1a1-71585a827422 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:06.204437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690e307-b4e4-4b43-a1a1-71585a827422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:06.205829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690e307-b4e4-4b43-a1a1-71585a827422 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:06.217053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 485/956] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 22 21:58:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:06.218492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f1b38-db3b-42d6-9126-35756982c1b7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:06.223764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:06.332823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f1b38-db3b-42d6-9126-35756982c1b7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:06.368425 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6ca24-fa60-43e0-b8b8-843ade4c1158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:06.369043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6ca24-fa60-43e0-b8b8-843ade4c1158 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:06.369319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6ca24-fa60-43e0-b8b8-843ade4c1158 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:06.369585 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6ca24-fa60-43e0-b8b8-843ade4c1158 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:06.370287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6ca24-fa60-43e0-b8b8-843ade4c1158 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:06.371655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6ca24-fa60-43e0-b8b8-843ade4c1158 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:06.397987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 472/957] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 21:58:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:06.436455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690e307-b4e4-4b43-a1a1-71585a827422 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:06.555234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690e307-b4e4-4b43-a1a1-71585a827422 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:06.598578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0345ab-21ac-4b95-bd8c-3b9a5004b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:06.599137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0345ab-21ac-4b95-bd8c-3b9a5004b9ec None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:06.599466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0345ab-21ac-4b95-bd8c-3b9a5004b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:06.599739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0345ab-21ac-4b95-bd8c-3b9a5004b9ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:06.600323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0345ab-21ac-4b95-bd8c-3b9a5004b9ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:06.601791 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0345ab-21ac-4b95-bd8c-3b9a5004b9ec None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-eb0345ab-21ac-4b95-bd8c-3b9a5004b9ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:06.611315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:06.612419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:06.613322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 486/958] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:58:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:06.618879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6ca24-fa60-43e0-b8b8-843ade4c1158 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:06.685844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:06.733901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6ca24-fa60-43e0-b8b8-843ade4c1158 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:06.769820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21498bf8-9614-4919-9b6b-811074617a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:06.770465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21498bf8-9614-4919-9b6b-811074617a87 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:06.770734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21498bf8-9614-4919-9b6b-811074617a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:06.771001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21498bf8-9614-4919-9b6b-811074617a87 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:06.771629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21498bf8-9614-4919-9b6b-811074617a87 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:06.771926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21498bf8-9614-4919-9b6b-811074617a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:06.773287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21498bf8-9614-4919-9b6b-811074617a87 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:06.778952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 473/959] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:58:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:06.784450 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0345ab-21ac-4b95-bd8c-3b9a5004b9ec None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:06.848937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:06.905317 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0345ab-21ac-4b95-bd8c-3b9a5004b9ec None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:06.942755 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905edf64-18fc-4861-a485-8d4d77845a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:06.943754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905edf64-18fc-4861-a485-8d4d77845a85 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:06.944235 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905edf64-18fc-4861-a485-8d4d77845a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:06.944714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905edf64-18fc-4861-a485-8d4d77845a85 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:06.945602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905edf64-18fc-4861-a485-8d4d77845a85 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:06.946232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905edf64-18fc-4861-a485-8d4d77845a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:06.947807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905edf64-18fc-4861-a485-8d4d77845a85 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:06.953031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 487/960] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:58:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:07.534662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc0ef-ea00-4853-a5f4-ce7560e01786 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:07.535012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc0ef-ea00-4853-a5f4-ce7560e01786 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:07.535214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc0ef-ea00-4853-a5f4-ce7560e01786 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:07.536700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 474/961] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:07.542164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73f2f4-5725-4370-9d89-70f9b9197097 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:07.542708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73f2f4-5725-4370-9d89-70f9b9197097 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:07.543213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73f2f4-5725-4370-9d89-70f9b9197097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:07.562048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fb73f2f4-5725-4370-9d89-70f9b9197097 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:07.563627 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fb73f2f4-5725-4370-9d89-70f9b9197097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:07.628645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 488/962] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:07.899325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dc0ef-ea00-4853-a5f4-ce7560e01786 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:08.002234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dc0ef-ea00-4853-a5f4-ce7560e01786 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:08.030285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:08.038279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b9302-33d3-42c4-b72c-a2f692c29f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:08.038908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b9302-33d3-42c4-b72c-a2f692c29f07 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:08.039288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b9302-33d3-42c4-b72c-a2f692c29f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:08.039559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b9302-33d3-42c4-b72c-a2f692c29f07 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:08.040207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b9302-33d3-42c4-b72c-a2f692c29f07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:08.041623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b9302-33d3-42c4-b72c-a2f692c29f07 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:08.058296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.sql.core [None req-dd6b9302-33d3-42c4-b72c-a2f692c29f07 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 21:58:08.058296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 21:58:08.058296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [parameters: {'user_id': 'fcd520ed6dc14560ae8a924fde696a95', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 21:58:08.058296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81639) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-dd6b9302-33d3-42c4-b72c-a2f692c29f07 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application conn.query(q) Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application result.read() Sep 22 21:58:08.065697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 21:58:08.066625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application next(self.gen) Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application yield resource Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application next(self.gen) Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise self.value Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application session.commit() Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 21:58:08.067576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.session.flush() Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application compat.raise_( Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 21:58:08.068548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 21:58:08.069453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application conn.query(q) Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application result.read() Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 21:58:08.070410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fcd520ed6dc14560ae8a924fde696a95', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:08.071405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 22 21:58:08.072215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 22 21:58:08.075605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 22 21:58:08.075605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 22 21:58:08.075605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 21:58:08.075605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 21:58:08.075605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 21:58:08.075605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:08.075605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 475/963] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Sep 22 21:58:07 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:08.084764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73f2f4-5725-4370-9d89-70f9b9197097 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:08.125418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:08.185126 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73f2f4-5725-4370-9d89-70f9b9197097 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:08.221154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad260607-8fb8-4a22-8c4c-cab65864868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:08.222264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad260607-8fb8-4a22-8c4c-cab65864868c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:08.222770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad260607-8fb8-4a22-8c4c-cab65864868c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:08.223282 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad260607-8fb8-4a22-8c4c-cab65864868c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:08.232847 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad260607-8fb8-4a22-8c4c-cab65864868c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:08.234800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad260607-8fb8-4a22-8c4c-cab65864868c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ad260607-8fb8-4a22-8c4c-cab65864868c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:58:08.248894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:08.249988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:08.250958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:08.250958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:08.250958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:58:08.250958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:58:08.250958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:58:08.250958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:58:08.250958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:58:08.250958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:58:08.250958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 21:58:08.250958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:08.253746 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 489/964] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:58:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:08.260512 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b9302-33d3-42c4-b72c-a2f692c29f07 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:08.358314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d147e-91de-4661-8039-2ea5e8da65ed None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:08.358689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d147e-91de-4661-8039-2ea5e8da65ed None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:08.359051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d147e-91de-4661-8039-2ea5e8da65ed None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:08.360683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 490/965] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:58:08.366071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9be8-9108-44b8-90ec-03d23759a99f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:08.366794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9be8-9108-44b8-90ec-03d23759a99f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:08.367198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9be8-9108-44b8-90ec-03d23759a99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:08.373120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b9302-33d3-42c4-b72c-a2f692c29f07 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:08.386617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e9aa9be8-9108-44b8-90ec-03d23759a99f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:08.388151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e9aa9be8-9108-44b8-90ec-03d23759a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:08.411706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b9c08-a16c-4fdc-81a5-cea18e9339f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:08.412434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9c08-a16c-4fdc-81a5-cea18e9339f1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:08.412713 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9c08-a16c-4fdc-81a5-cea18e9339f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:08.412981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9c08-a16c-4fdc-81a5-cea18e9339f1 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:08.413688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b9c08-a16c-4fdc-81a5-cea18e9339f1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:08.414021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b9c08-a16c-4fdc-81a5-cea18e9339f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:08.415846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b9c08-a16c-4fdc-81a5-cea18e9339f1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:08.461952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 476/966] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 22 21:58:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:08.474139 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 491/967] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:08.666970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcaaa7-e3fc-4e3c-8d81-1a9f90ac923f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:08.667250 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcaaa7-e3fc-4e3c-8d81-1a9f90ac923f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:08.667518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcaaa7-e3fc-4e3c-8d81-1a9f90ac923f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:08.669119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 477/968] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:08.674526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcea58-7050-441e-93ff-62296715ef40 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:08.674761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcea58-7050-441e-93ff-62296715ef40 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:08.675036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcea58-7050-441e-93ff-62296715ef40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:08.693505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-adfcea58-7050-441e-93ff-62296715ef40 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:08.694711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-adfcea58-7050-441e-93ff-62296715ef40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:08.720900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:08.749709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcaaa7-e3fc-4e3c-8d81-1a9f90ac923f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:08.771549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 492/969] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:08.801620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:08.859014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcaaa7-e3fc-4e3c-8d81-1a9f90ac923f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:08.893762 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724619d-1656-4b00-8741-e1852157ed42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:08.894417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724619d-1656-4b00-8741-e1852157ed42 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:08.894654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724619d-1656-4b00-8741-e1852157ed42 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:08.894957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724619d-1656-4b00-8741-e1852157ed42 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:08.905661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724619d-1656-4b00-8741-e1852157ed42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e724619d-1656-4b00-8741-e1852157ed42 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:58:08.910487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:08.911424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:08.914478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 478/970] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 22 21:58:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:08.918390 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcea58-7050-441e-93ff-62296715ef40 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.025639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcea58-7050-441e-93ff-62296715ef40 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:09.059986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d4578-c183-4f85-a277-b6e3e8dfeb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:09.060316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724619d-1656-4b00-8741-e1852157ed42 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.060604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d4578-c183-4f85-a277-b6e3e8dfeb8d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.060880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d4578-c183-4f85-a277-b6e3e8dfeb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.061193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d4578-c183-4f85-a277-b6e3e8dfeb8d None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.061814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d4578-c183-4f85-a277-b6e3e8dfeb8d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:09.062159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d4578-c183-4f85-a277-b6e3e8dfeb8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:09.063654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d4578-c183-4f85-a277-b6e3e8dfeb8d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:09.072347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 493/971] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 22 21:58:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:09.078736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d4578-c183-4f85-a277-b6e3e8dfeb8d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.105387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:09.171803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724619d-1656-4b00-8741-e1852157ed42 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:09.174750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:09.190052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d4578-c183-4f85-a277-b6e3e8dfeb8d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:09.210584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a9c3-7c7a-4deb-80bb-9232007fefce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:09.211640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a9c3-7c7a-4deb-80bb-9232007fefce None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.211954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a9c3-7c7a-4deb-80bb-9232007fefce None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.212222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a9c3-7c7a-4deb-80bb-9232007fefce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.212806 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1a9c3-7c7a-4deb-80bb-9232007fefce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:09.214217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1a9c3-7c7a-4deb-80bb-9232007fefce None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-94b1a9c3-7c7a-4deb-80bb-9232007fefce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:09.223678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:09.224677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:09.225494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 479/972] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 22 21:58:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:09.231104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a9c3-7c7a-4deb-80bb-9232007fefce None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.232988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce2a7c-9c4c-40c5-9d6b-0ecdff3ad8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:09.233652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2a7c-9c4c-40c5-9d6b-0ecdff3ad8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.233952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2a7c-9c4c-40c5-9d6b-0ecdff3ad8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.234227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2a7c-9c4c-40c5-9d6b-0ecdff3ad8d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.246007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce2a7c-9c4c-40c5-9d6b-0ecdff3ad8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:09.247480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce2a7c-9c4c-40c5-9d6b-0ecdff3ad8d0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-02ce2a7c-9c4c-40c5-9d6b-0ecdff3ad8d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:09.262442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:09.263513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:09.264430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:09.264430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:09.264430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:09.264430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 494/973] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:09.269616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce2a7c-9c4c-40c5-9d6b-0ecdff3ad8d0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.351361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a9c3-7c7a-4deb-80bb-9232007fefce None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:09.353132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:09.381153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce2a7c-9c4c-40c5-9d6b-0ecdff3ad8d0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:09.385815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec2637-2228-4cba-b715-c289b260a2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:09.386444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec2637-2228-4cba-b715-c289b260a2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.386716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec2637-2228-4cba-b715-c289b260a2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.386980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec2637-2228-4cba-b715-c289b260a2b2 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.387602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec2637-2228-4cba-b715-c289b260a2b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:09.387896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec2637-2228-4cba-b715-c289b260a2b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:09.389254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec2637-2228-4cba-b715-c289b260a2b2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:09.394105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 480/974] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 22 21:58:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:09.396295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0aff1-104a-4adb-b30f-93a9862f96e6 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.396567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0aff1-104a-4adb-b30f-93a9862f96e6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.396841 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0aff1-104a-4adb-b30f-93a9862f96e6 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.398312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 481/975] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:09.403090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0aff1-104a-4adb-b30f-93a9862f96e6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.422960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30ac8f-8894-43d3-8186-11b40b3af9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:09.423917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30ac8f-8894-43d3-8186-11b40b3af9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.424352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30ac8f-8894-43d3-8186-11b40b3af9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.424789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30ac8f-8894-43d3-8186-11b40b3af9d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.425858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30ac8f-8894-43d3-8186-11b40b3af9d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:09.426387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30ac8f-8894-43d3-8186-11b40b3af9d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:09.428598 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30ac8f-8894-43d3-8186-11b40b3af9d7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:09.442363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 495/976] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:09.443649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035a76-4956-4739-9079-494e6604fa5a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.443931 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035a76-4956-4739-9079-494e6604fa5a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.444196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035a76-4956-4739-9079-494e6604fa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.450515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:09.463852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-92035a76-4956-4739-9079-494e6604fa5a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:09.465054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-92035a76-4956-4739-9079-494e6604fa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:09.522339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0aff1-104a-4adb-b30f-93a9862f96e6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:09.531987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 496/977] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:09.532814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92035a76-4956-4739-9079-494e6604fa5a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.573827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532278db-9f75-4280-9b99-5443470aac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:09.574455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532278db-9f75-4280-9b99-5443470aac03 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.574725 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532278db-9f75-4280-9b99-5443470aac03 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.574988 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532278db-9f75-4280-9b99-5443470aac03 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.575612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532278db-9f75-4280-9b99-5443470aac03 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:09.575907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532278db-9f75-4280-9b99-5443470aac03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:09.577262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532278db-9f75-4280-9b99-5443470aac03 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:09.585890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 482/978] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 22 21:58:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:09.588525 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532278db-9f75-4280-9b99-5443470aac03 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.603155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:09.646150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92035a76-4956-4739-9079-494e6604fa5a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:09.687044 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bd4aa-c45e-4891-adda-731bbf8899fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:09.687682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bd4aa-c45e-4891-adda-731bbf8899fe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.687957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bd4aa-c45e-4891-adda-731bbf8899fe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.688294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bd4aa-c45e-4891-adda-731bbf8899fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.690677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:09.696262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bd4aa-c45e-4891-adda-731bbf8899fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:09.697711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bd4aa-c45e-4891-adda-731bbf8899fe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:09.698033 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532278db-9f75-4280-9b99-5443470aac03 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-283bd4aa-c45e-4891-adda-731bbf8899fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:58:09.713725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:09.714804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:09.715836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:09.715836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:09.715836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:58:09.715836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:58:09.715836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:58:09.715836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:58:09.715836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:58:09.715836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:58:09.715836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 21:58:09.715836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:09.715836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 497/979] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 22 21:58:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:09.720706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bd4aa-c45e-4891-adda-731bbf8899fe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.737944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a2679-6476-4e91-a025-44b0f16350ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:09.738555 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a2679-6476-4e91-a025-44b0f16350ed None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.738875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a2679-6476-4e91-a025-44b0f16350ed None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.739091 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a2679-6476-4e91-a025-44b0f16350ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.739862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a2679-6476-4e91-a025-44b0f16350ed None admin] RBAC: Adding query filter params (interface=admin, service_id=6ec90ca152d24ae386c86c37d4a3975c, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:09.740113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a2679-6476-4e91-a025-44b0f16350ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:09.741462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a2679-6476-4e91-a025-44b0f16350ed None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:09.747171 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 483/980] 10.222.0.20 () {56 vars in 1249 bytes} [Thu Sep 22 21:58:09 2022] GET /identity/v3/endpoints?service_id=6ec90ca152d24ae386c86c37d4a3975c&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:09.752324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a2679-6476-4e91-a025-44b0f16350ed None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.829483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bd4aa-c45e-4891-adda-731bbf8899fe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:09.851139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a2679-6476-4e91-a025-44b0f16350ed None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:09.852983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:09.865603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b283e2a-ff43-4710-b8bc-8f74830766cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:09.866182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283e2a-ff43-4710-b8bc-8f74830766cc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.866461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283e2a-ff43-4710-b8bc-8f74830766cc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.866733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283e2a-ff43-4710-b8bc-8f74830766cc None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.867555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b283e2a-ff43-4710-b8bc-8f74830766cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:09.867859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b283e2a-ff43-4710-b8bc-8f74830766cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:09.869296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b283e2a-ff43-4710-b8bc-8f74830766cc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:09.885278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02e147-7105-4603-9ce7-93d2e65ce158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:09.885899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02e147-7105-4603-9ce7-93d2e65ce158 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:09.886170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02e147-7105-4603-9ce7-93d2e65ce158 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:09.886432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02e147-7105-4603-9ce7-93d2e65ce158 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:09.887025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02e147-7105-4603-9ce7-93d2e65ce158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:09.892003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 498/981] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 22 21:58:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:09.892003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b283e2a-ff43-4710-b8bc-8f74830766cc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.892222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02e147-7105-4603-9ce7-93d2e65ce158 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:09.895086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 484/982] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 22 21:58:09 2022] GET /identity/v3/services => generated 1497 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 21:58:09.895862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02e147-7105-4603-9ce7-93d2e65ce158 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:09.937583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:10.001449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b283e2a-ff43-4710-b8bc-8f74830766cc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:10.022772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02e147-7105-4603-9ce7-93d2e65ce158 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:10.038407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff8249-2bc4-47fe-856a-d237d83842dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:10.039031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff8249-2bc4-47fe-856a-d237d83842dd None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:10.039375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff8249-2bc4-47fe-856a-d237d83842dd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:10.039637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff8249-2bc4-47fe-856a-d237d83842dd None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:10.040304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff8249-2bc4-47fe-856a-d237d83842dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:10.041700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff8249-2bc4-47fe-856a-d237d83842dd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:10.061962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 499/983] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:58:09 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:10.073923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dec38-7b05-4a0c-a3d9-d1b098c77408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:10.075014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dec38-7b05-4a0c-a3d9-d1b098c77408 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:10.075502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dec38-7b05-4a0c-a3d9-d1b098c77408 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:10.076001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dec38-7b05-4a0c-a3d9-d1b098c77408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:10.156690 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dec38-7b05-4a0c-a3d9-d1b098c77408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:10.158143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dec38-7b05-4a0c-a3d9-d1b098c77408 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:10.183239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:10.271514 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 485/984] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:58:09 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:58:10.277651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff8249-2bc4-47fe-856a-d237d83842dd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:10.324731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:10.386508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff8249-2bc4-47fe-856a-d237d83842dd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:10.421330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ab58e-7d19-4e93-b835-ced1b60d9d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:10.422022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ab58e-7d19-4e93-b835-ced1b60d9d28 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:10.422367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ab58e-7d19-4e93-b835-ced1b60d9d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:10.422702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ab58e-7d19-4e93-b835-ced1b60d9d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:10.433610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ab58e-7d19-4e93-b835-ced1b60d9d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:10.435170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ab58e-7d19-4e93-b835-ced1b60d9d28 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7e6ab58e-7d19-4e93-b835-ced1b60d9d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:10.449828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:10.451002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:10.452158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:10.452158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:10.452158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:10.452965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 500/985] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:10.458594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dec38-7b05-4a0c-a3d9-d1b098c77408 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:10.558783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dec38-7b05-4a0c-a3d9-d1b098c77408 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:10.579896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:10.595324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44372762-cc37-462d-865f-905081318c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:10.595942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372762-cc37-462d-865f-905081318c37 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:10.596216 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372762-cc37-462d-865f-905081318c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:10.596483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372762-cc37-462d-865f-905081318c37 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:10.597122 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44372762-cc37-462d-865f-905081318c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:10.597423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44372762-cc37-462d-865f-905081318c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:10.598810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44372762-cc37-462d-865f-905081318c37 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:10.610688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 486/986] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:10.616191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ab58e-7d19-4e93-b835-ced1b60d9d28 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:10.719805 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:10.727625 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ab58e-7d19-4e93-b835-ced1b60d9d28 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:10.762257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79123-e6ed-4dd4-b442-dbdba83262a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:10.762894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79123-e6ed-4dd4-b442-dbdba83262a8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:10.763167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79123-e6ed-4dd4-b442-dbdba83262a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:10.763411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79123-e6ed-4dd4-b442-dbdba83262a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:10.770440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b79123-e6ed-4dd4-b442-dbdba83262a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:10.771882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b79123-e6ed-4dd4-b442-dbdba83262a8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f6b79123-e6ed-4dd4-b442-dbdba83262a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:58:10.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:10.784299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:10.785187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:58:10.785187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:58:10.785187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:58:10.785187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:58:10.785187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:58:10.785187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:58:10.785187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:10.785187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:10.786245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 501/987] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:10.790464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44372762-cc37-462d-865f-905081318c37 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:10.900247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44372762-cc37-462d-865f-905081318c37 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:10.934410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2719d49-cc50-499a-8009-7b6032cf9479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:10.935139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719d49-cc50-499a-8009-7b6032cf9479 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:10.935503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719d49-cc50-499a-8009-7b6032cf9479 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:10.935865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719d49-cc50-499a-8009-7b6032cf9479 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:10.936640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2719d49-cc50-499a-8009-7b6032cf9479 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:10.937034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2719d49-cc50-499a-8009-7b6032cf9479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:10.938591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2719d49-cc50-499a-8009-7b6032cf9479 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:10.956314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 487/988] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:10.957764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79123-e6ed-4dd4-b442-dbdba83262a8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:11.062112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79123-e6ed-4dd4-b442-dbdba83262a8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:11.095381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b7ab4-9421-4fb5-90c7-d377d402505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:11.096131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b7ab4-9421-4fb5-90c7-d377d402505b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:11.096412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b7ab4-9421-4fb5-90c7-d377d402505b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:11.096670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b7ab4-9421-4fb5-90c7-d377d402505b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:11.097385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b7ab4-9421-4fb5-90c7-d377d402505b None admin] RBAC: Adding query filter params (role.id=22d0e8156009474698e29ac27aef7f02, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=d51d2b73c22747f2b40bccc45352135f) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:11.097688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b7ab4-9421-4fb5-90c7-d377d402505b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:11.099120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b7ab4-9421-4fb5-90c7-d377d402505b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:11.104948 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 502/989] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:58:10 2022] GET /identity/v3/role_assignments?user.id=d51d2b73c22747f2b40bccc45352135f&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=22d0e8156009474698e29ac27aef7f02 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:12.083584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1c96d-d220-47cc-a8c9-765f01a4e87f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:12.084156 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1c96d-d220-47cc-a8c9-765f01a4e87f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:12.084156 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1c96d-d220-47cc-a8c9-765f01a4e87f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:12.085614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 488/990] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:12.091536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731b5eb-c5b3-41a1-bb3e-457814e3b976 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:12.091985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731b5eb-c5b3-41a1-bb3e-457814e3b976 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:12.092089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731b5eb-c5b3-41a1-bb3e-457814e3b976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:12.110617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f731b5eb-c5b3-41a1-bb3e-457814e3b976 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:12.111813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f731b5eb-c5b3-41a1-bb3e-457814e3b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:12.127018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:12.190102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 503/991] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:12.247074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678b7c7-0ba9-4fe4-9593-dd7735df8e98 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:12.247324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678b7c7-0ba9-4fe4-9593-dd7735df8e98 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:12.247604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678b7c7-0ba9-4fe4-9593-dd7735df8e98 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:12.249095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 489/992] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:12.254253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a321c-9fb0-4f61-b6bc-e66e57839ae5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:12.254498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a321c-9fb0-4f61-b6bc-e66e57839ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:12.254800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a321c-9fb0-4f61-b6bc-e66e57839ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:12.274134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-536a321c-9fb0-4f61-b6bc-e66e57839ae5 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:12.275189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-536a321c-9fb0-4f61-b6bc-e66e57839ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:12.342795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 504/993] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:12.453295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678b7c7-0ba9-4fe4-9593-dd7735df8e98 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:12.497464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:12.558827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678b7c7-0ba9-4fe4-9593-dd7735df8e98 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:12.593722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d066ea5-83c5-43d0-a767-a1fbd9d28095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:12.594308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d066ea5-83c5-43d0-a767-a1fbd9d28095 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:12.594582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d066ea5-83c5-43d0-a767-a1fbd9d28095 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:12.594851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d066ea5-83c5-43d0-a767-a1fbd9d28095 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:12.595433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d066ea5-83c5-43d0-a767-a1fbd9d28095 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:12.596798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d066ea5-83c5-43d0-a767-a1fbd9d28095 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4d066ea5-83c5-43d0-a767-a1fbd9d28095 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:12.605864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:12.606888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 21:58:12.607728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:12.610188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 490/994] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 22 21:58:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:12.613011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a321c-9fb0-4f61-b6bc-e66e57839ae5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:12.613122 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d066ea5-83c5-43d0-a767-a1fbd9d28095 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:12.695357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:12.727821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a321c-9fb0-4f61-b6bc-e66e57839ae5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:12.729230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d066ea5-83c5-43d0-a767-a1fbd9d28095 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:12.732543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:12.762219 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e99295-3741-47e9-8eba-658944ab3860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:12.763036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99295-3741-47e9-8eba-658944ab3860 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:12.763651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99295-3741-47e9-8eba-658944ab3860 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:12.764084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99295-3741-47e9-8eba-658944ab3860 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:12.764717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e99295-3741-47e9-8eba-658944ab3860 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:12.765024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e99295-3741-47e9-8eba-658944ab3860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:12.766440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e99295-3741-47e9-8eba-658944ab3860 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:12.768781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f64a6d-5a0c-402d-942d-83ccf8aefed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:12.769576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f64a6d-5a0c-402d-942d-83ccf8aefed1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:12.769863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f64a6d-5a0c-402d-942d-83ccf8aefed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:12.770147 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f64a6d-5a0c-402d-942d-83ccf8aefed1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:12.770862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f64a6d-5a0c-402d-942d-83ccf8aefed1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:12.771963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 505/995] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 22 21:58:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:12.772178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f64a6d-5a0c-402d-942d-83ccf8aefed1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:12.777602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e99295-3741-47e9-8eba-658944ab3860 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b7f64a6d-5a0c-402d-942d-83ccf8aefed1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:12.782473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:12.783465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 21:58:12.784408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:12.789933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 491/996] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:58:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:12.790817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f64a6d-5a0c-402d-942d-83ccf8aefed1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:12.886184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e99295-3741-47e9-8eba-658944ab3860 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:12.893082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f64a6d-5a0c-402d-942d-83ccf8aefed1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:12.925988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b67b5b-481c-4b34-840d-bfcf70e48df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:12.926643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b67b5b-481c-4b34-840d-bfcf70e48df8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:12.926925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b67b5b-481c-4b34-840d-bfcf70e48df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:12.927203 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b67b5b-481c-4b34-840d-bfcf70e48df8 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:12.927858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b67b5b-481c-4b34-840d-bfcf70e48df8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:12.928153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b67b5b-481c-4b34-840d-bfcf70e48df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:12.929522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b67b5b-481c-4b34-840d-bfcf70e48df8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:12.933317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a97bb-d437-4b53-9afe-0ed676dc789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:12.933963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a97bb-d437-4b53-9afe-0ed676dc789c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:12.934244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a97bb-d437-4b53-9afe-0ed676dc789c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:12.934517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a97bb-d437-4b53-9afe-0ed676dc789c None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:12.939313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 506/997] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 22 21:58:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:12.939440 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a97bb-d437-4b53-9afe-0ed676dc789c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:12.939440 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a97bb-d437-4b53-9afe-0ed676dc789c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:12.939440 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a97bb-d437-4b53-9afe-0ed676dc789c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:12.940467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b67b5b-481c-4b34-840d-bfcf70e48df8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:12.942485 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 492/998] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:58:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:12.948100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a97bb-d437-4b53-9afe-0ed676dc789c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:12.949488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:12.982571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:13.046735 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b67b5b-481c-4b34-840d-bfcf70e48df8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:13.059879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a97bb-d437-4b53-9afe-0ed676dc789c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:13.084669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1956e0-d19d-4760-b564-ec1239f7024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:13.085304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1956e0-d19d-4760-b564-ec1239f7024b None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:13.085751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1956e0-d19d-4760-b564-ec1239f7024b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:13.086155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1956e0-d19d-4760-b564-ec1239f7024b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:13.087693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1956e0-d19d-4760-b564-ec1239f7024b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:13.089002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1956e0-d19d-4760-b564-ec1239f7024b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:13.094560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953230d9-0c74-42c3-91d4-b371cb9095c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:13.095690 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953230d9-0c74-42c3-91d4-b371cb9095c3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:13.095960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953230d9-0c74-42c3-91d4-b371cb9095c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:13.096315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953230d9-0c74-42c3-91d4-b371cb9095c3 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:13.096974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953230d9-0c74-42c3-91d4-b371cb9095c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:13.097293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953230d9-0c74-42c3-91d4-b371cb9095c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:13.098825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953230d9-0c74-42c3-91d4-b371cb9095c3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:13.107321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 507/999] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 21:58:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:13.109337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 493/1000] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:58:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:13.119361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1956e0-d19d-4760-b564-ec1239f7024b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:13.198081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:13.246704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1956e0-d19d-4760-b564-ec1239f7024b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:13.283383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788832f-7071-49e6-b5ee-2437e8b789fa None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:13.283664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788832f-7071-49e6-b5ee-2437e8b789fa None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:13.283932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788832f-7071-49e6-b5ee-2437e8b789fa None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:13.284513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec1496-b381-47dd-ad14-0fd4d4906f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:13.285201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec1496-b381-47dd-ad14-0fd4d4906f07 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:13.285298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 494/1001] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:13.285646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec1496-b381-47dd-ad14-0fd4d4906f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:13.285748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec1496-b381-47dd-ad14-0fd4d4906f07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:13.286490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec1496-b381-47dd-ad14-0fd4d4906f07 None admin] RBAC: Adding query filter params (interface=public, service_id=628999a5e0134a82bd1fc53bf2aa9291, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:13.286799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec1496-b381-47dd-ad14-0fd4d4906f07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:13.288212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec1496-b381-47dd-ad14-0fd4d4906f07 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:13.291596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d0dd9-4880-4ee7-b98b-69dd3f2cacab None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:13.291875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d0dd9-4880-4ee7-b98b-69dd3f2cacab None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:13.292140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d0dd9-4880-4ee7-b98b-69dd3f2cacab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:13.294057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 508/1002] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 22 21:58:13 2022] GET /identity/v3/endpoints?service_id=628999a5e0134a82bd1fc53bf2aa9291&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:13.299633 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec1496-b381-47dd-ad14-0fd4d4906f07 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:13.315963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-292d0dd9-4880-4ee7-b98b-69dd3f2cacab None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:13.317485 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-292d0dd9-4880-4ee7-b98b-69dd3f2cacab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:13.389664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 495/1003] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:13.405655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec1496-b381-47dd-ad14-0fd4d4906f07 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:13.430899 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:13.440654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac13f75-b337-4c64-a7a6-0589aa69745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:13.441273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac13f75-b337-4c64-a7a6-0589aa69745d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:13.441544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac13f75-b337-4c64-a7a6-0589aa69745d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:13.441808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac13f75-b337-4c64-a7a6-0589aa69745d None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:13.442429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac13f75-b337-4c64-a7a6-0589aa69745d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:13.443781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac13f75-b337-4c64-a7a6-0589aa69745d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:13.450664 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 509/1004] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 22 21:58:13 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 21:58:13.654048 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d0dd9-4880-4ee7-b98b-69dd3f2cacab None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:13.681448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:13.759822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d0dd9-4880-4ee7-b98b-69dd3f2cacab None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:13.796763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee806e99-becc-47aa-bba2-0850b53f54d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:13.797423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee806e99-becc-47aa-bba2-0850b53f54d8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:13.797695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee806e99-becc-47aa-bba2-0850b53f54d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:13.797993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee806e99-becc-47aa-bba2-0850b53f54d8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:13.798572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee806e99-becc-47aa-bba2-0850b53f54d8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:13.799924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee806e99-becc-47aa-bba2-0850b53f54d8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ee806e99-becc-47aa-bba2-0850b53f54d8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:13.808822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:13.809822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:13.811009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 496/1005] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Sep 22 21:58:13 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:13.817770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac13f75-b337-4c64-a7a6-0589aa69745d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:13.917729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac13f75-b337-4c64-a7a6-0589aa69745d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:13.951004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1772927-2d22-47d9-82b8-44564c2cd352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:13.951614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1772927-2d22-47d9-82b8-44564c2cd352 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:13.951858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1772927-2d22-47d9-82b8-44564c2cd352 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:13.952160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1772927-2d22-47d9-82b8-44564c2cd352 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:13.952795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1772927-2d22-47d9-82b8-44564c2cd352 None admin] RBAC: Adding query filter params (name=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:13.953095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1772927-2d22-47d9-82b8-44564c2cd352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:13.954574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1772927-2d22-47d9-82b8-44564c2cd352 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:13.959611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 510/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:13.965667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee806e99-becc-47aa-bba2-0850b53f54d8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:14.063214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:14.074014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee806e99-becc-47aa-bba2-0850b53f54d8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:14.107669 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad33b74-b788-4b53-87ad-f4169371c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:14.108337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33b74-b788-4b53-87ad-f4169371c803 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:14.108571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33b74-b788-4b53-87ad-f4169371c803 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:14.108789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33b74-b788-4b53-87ad-f4169371c803 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:14.109417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad33b74-b788-4b53-87ad-f4169371c803 None admin] RBAC: Adding query filter params (type=image) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:14.109713 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad33b74-b788-4b53-87ad-f4169371c803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:14.111109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad33b74-b788-4b53-87ad-f4169371c803 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:14.115693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 497/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:15.278666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86330a4f-bd39-4c54-b549-e9cc783f1607 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:15.279222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86330a4f-bd39-4c54-b549-e9cc783f1607 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:15.279222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86330a4f-bd39-4c54-b549-e9cc783f1607 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:15.280498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 511/1008] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:15.286150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb9f4-2784-4744-b9b0-004835351aab None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:15.286604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb9f4-2784-4744-b9b0-004835351aab None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:15.286695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb9f4-2784-4744-b9b0-004835351aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:15.305817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-eb8fb9f4-2784-4744-b9b0-004835351aab None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:15.307022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eb8fb9f4-2784-4744-b9b0-004835351aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:15.375641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 498/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:15 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:15.639970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86330a4f-bd39-4c54-b549-e9cc783f1607 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:15.650251 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38139a9-8dee-486c-9886-80436f7afb3c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:15.650546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38139a9-8dee-486c-9886-80436f7afb3c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:15.650823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38139a9-8dee-486c-9886-80436f7afb3c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:15.652357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 499/1010] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:58:15.658693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12cfac-ce93-4c76-8422-c4eaf0101ea8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:15.658975 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12cfac-ce93-4c76-8422-c4eaf0101ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:15.659244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12cfac-ce93-4c76-8422-c4eaf0101ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:15.677451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fb12cfac-ce93-4c76-8422-c4eaf0101ea8 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:15.678651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fb12cfac-ce93-4c76-8422-c4eaf0101ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:15.708460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:15.755038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 500/1011] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:15 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:15.762309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86330a4f-bd39-4c54-b549-e9cc783f1607 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:15.796298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da66194-bb66-48f9-b4f1-8fece751a2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:15.796950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66194-bb66-48f9-b4f1-8fece751a2fa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:15.797221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66194-bb66-48f9-b4f1-8fece751a2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:15.797481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66194-bb66-48f9-b4f1-8fece751a2fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:15.798614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da66194-bb66-48f9-b4f1-8fece751a2fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:15.800045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da66194-bb66-48f9-b4f1-8fece751a2fa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:15.801812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 512/1012] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:15.807362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12cfac-ce93-4c76-8422-c4eaf0101ea8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:15.823262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:15.912387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12cfac-ce93-4c76-8422-c4eaf0101ea8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:15.946699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d410ae-90e6-41e1-b07a-4aa117d8f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:15.947301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d410ae-90e6-41e1-b07a-4aa117d8f2dc None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:15.947573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d410ae-90e6-41e1-b07a-4aa117d8f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:15.947833 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d410ae-90e6-41e1-b07a-4aa117d8f2dc None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:15.948536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d410ae-90e6-41e1-b07a-4aa117d8f2dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:15.950020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d410ae-90e6-41e1-b07a-4aa117d8f2dc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:15.985861 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 501/1013] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:58:15 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 21:58:16.026311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da66194-bb66-48f9-b4f1-8fece751a2fa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:16.142834 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da66194-bb66-48f9-b4f1-8fece751a2fa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:16.171012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:16.184432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2812337-3335-4204-be08-8f5547db3651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:16.185072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812337-3335-4204-be08-8f5547db3651 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:16.185348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812337-3335-4204-be08-8f5547db3651 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:16.185612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812337-3335-4204-be08-8f5547db3651 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:16.186267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2812337-3335-4204-be08-8f5547db3651 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:16.187644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2812337-3335-4204-be08-8f5547db3651 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f2812337-3335-4204-be08-8f5547db3651 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:16.196649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:16.197681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:16.199247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 513/1014] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:58:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:16.203871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d410ae-90e6-41e1-b07a-4aa117d8f2dc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:16.238821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823329-ce9f-4306-b6ea-a919af94e203 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:16.239093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823329-ce9f-4306-b6ea-a919af94e203 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:16.239360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823329-ce9f-4306-b6ea-a919af94e203 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:16.240857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 514/1015] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:58:16.246317 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0e7a9-493a-48d0-95a1-7247dd08cb58 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:16.246596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0e7a9-493a-48d0-95a1-7247dd08cb58 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:16.247241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0e7a9-493a-48d0-95a1-7247dd08cb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:16.265245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-43e0e7a9-493a-48d0-95a1-7247dd08cb58 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:16.266514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-43e0e7a9-493a-48d0-95a1-7247dd08cb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:16.275415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:16.313156 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d410ae-90e6-41e1-b07a-4aa117d8f2dc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:16.341880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 515/1016] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:16 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:16.354502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039aa67e-6123-4d74-95db-a534db92cceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:16.355113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aa67e-6123-4d74-95db-a534db92cceb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:16.355389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aa67e-6123-4d74-95db-a534db92cceb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:16.355657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aa67e-6123-4d74-95db-a534db92cceb None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:16.356298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039aa67e-6123-4d74-95db-a534db92cceb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:16.356596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039aa67e-6123-4d74-95db-a534db92cceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:16.357999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039aa67e-6123-4d74-95db-a534db92cceb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:16.367721 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 502/1017] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:58:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:16.368870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0e7a9-493a-48d0-95a1-7247dd08cb58 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:16.465812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0e7a9-493a-48d0-95a1-7247dd08cb58 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:16.481552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:16.500297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0c51-cab8-4bbc-ad5d-0fd6daf8b1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:16.500965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0c51-cab8-4bbc-ad5d-0fd6daf8b1fc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:16.501251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0c51-cab8-4bbc-ad5d-0fd6daf8b1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:16.501519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0c51-cab8-4bbc-ad5d-0fd6daf8b1fc None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:16.502185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b0c51-cab8-4bbc-ad5d-0fd6daf8b1fc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:16.502484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b0c51-cab8-4bbc-ad5d-0fd6daf8b1fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:16.503851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b0c51-cab8-4bbc-ad5d-0fd6daf8b1fc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:16.509274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 516/1018] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 22 21:58:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:16.517212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039aa67e-6123-4d74-95db-a534db92cceb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:16.623227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039aa67e-6123-4d74-95db-a534db92cceb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:16.633175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0c51-cab8-4bbc-ad5d-0fd6daf8b1fc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:16.657778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:16.665151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73c823-e921-44bb-9422-8bf53ce26c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:16.665764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c823-e921-44bb-9422-8bf53ce26c5c None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:16.666103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c823-e921-44bb-9422-8bf53ce26c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:16.666360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c823-e921-44bb-9422-8bf53ce26c5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:16.667034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73c823-e921-44bb-9422-8bf53ce26c5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:16.668412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73c823-e921-44bb-9422-8bf53ce26c5c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:16.697858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 503/1019] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 21:58:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:16.752981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0c51-cab8-4bbc-ad5d-0fd6daf8b1fc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:16.798872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d593faa-b7ed-44b9-98ae-62d1e3de529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:16.799549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d593faa-b7ed-44b9-98ae-62d1e3de529c None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:16.799824 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d593faa-b7ed-44b9-98ae-62d1e3de529c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:16.800096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d593faa-b7ed-44b9-98ae-62d1e3de529c None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:16.800761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d593faa-b7ed-44b9-98ae-62d1e3de529c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:16.802207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d593faa-b7ed-44b9-98ae-62d1e3de529c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:16.820009 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 517/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:58:16 2022] POST /identity/v3/services => generated 242 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:18.226039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4480a0-364b-4863-996b-9bb344e61bf0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:18.226694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4480a0-364b-4863-996b-9bb344e61bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:18.226787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4480a0-364b-4863-996b-9bb344e61bf0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:18.228622 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 504/1021] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:18.233779 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60996102-be4f-426e-a445-d332ec6a1add None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:18.234227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60996102-be4f-426e-a445-d332ec6a1add None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:18.234401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60996102-be4f-426e-a445-d332ec6a1add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:18.253543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-60996102-be4f-426e-a445-d332ec6a1add None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:18.254859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-60996102-be4f-426e-a445-d332ec6a1add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:18.285082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:18.332226 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 518/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:18.600840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4480a0-364b-4863-996b-9bb344e61bf0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:18.715370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4480a0-364b-4863-996b-9bb344e61bf0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:18.751277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab80f23-6b66-46b9-82db-3daeef2d473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:18.751906 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab80f23-6b66-46b9-82db-3daeef2d473c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:18.752175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab80f23-6b66-46b9-82db-3daeef2d473c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:18.752436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab80f23-6b66-46b9-82db-3daeef2d473c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:18.753544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab80f23-6b66-46b9-82db-3daeef2d473c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:18.755014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab80f23-6b66-46b9-82db-3daeef2d473c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:18.756792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 505/1023] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:18.762427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60996102-be4f-426e-a445-d332ec6a1add None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:18.875978 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60996102-be4f-426e-a445-d332ec6a1add None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:18.910963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792797e-ab8f-44ed-a9cf-e9e5cb952875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:18.911577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792797e-ab8f-44ed-a9cf-e9e5cb952875 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:18.911846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792797e-ab8f-44ed-a9cf-e9e5cb952875 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:18.912109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792797e-ab8f-44ed-a9cf-e9e5cb952875 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:18.912769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792797e-ab8f-44ed-a9cf-e9e5cb952875 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:18.914332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792797e-ab8f-44ed-a9cf-e9e5cb952875 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:18.930462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1f310-8d82-4c46-bde6-6e8f4397ab9c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:18.930723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1f310-8d82-4c46-bde6-6e8f4397ab9c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:18.931034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1f310-8d82-4c46-bde6-6e8f4397ab9c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:18.932512 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 506/1024] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:18.937968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9076bd-a92d-4f51-8620-c61f4c2604b2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:18.938243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9076bd-a92d-4f51-8620-c61f4c2604b2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:18.938509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9076bd-a92d-4f51-8620-c61f4c2604b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:18.940907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 519/1025] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:58:18 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:18.963701 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bf9076bd-a92d-4f51-8620-c61f4c2604b2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:18.964919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bf9076bd-a92d-4f51-8620-c61f4c2604b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:18.973498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34076b-aa04-4457-959e-16c328981bc7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:18.973781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34076b-aa04-4457-959e-16c328981bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:18.974085 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34076b-aa04-4457-959e-16c328981bc7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:18.975456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 520/1026] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:58:18.981301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae705-9eea-4332-8fa3-51a67017f532 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:18.981596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae705-9eea-4332-8fa3-51a67017f532 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:18.981930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae705-9eea-4332-8fa3-51a67017f532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:19.002384 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3f5ae705-9eea-4332-8fa3-51a67017f532 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:19.003607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3f5ae705-9eea-4332-8fa3-51a67017f532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:19.019371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:19.027469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:19.051358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 507/1027] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:19.088183 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 521/1028] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:19.314806 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9076bd-a92d-4f51-8620-c61f4c2604b2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:19.349427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ae705-9eea-4332-8fa3-51a67017f532 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:19.421500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9076bd-a92d-4f51-8620-c61f4c2604b2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:19.455208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ae705-9eea-4332-8fa3-51a67017f532 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:19.457561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257c589-7d90-4bf9-83a7-7f8ab02584d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:19.458229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257c589-7d90-4bf9-83a7-7f8ab02584d4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:19.458504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257c589-7d90-4bf9-83a7-7f8ab02584d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:19.458767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257c589-7d90-4bf9-83a7-7f8ab02584d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:19.470383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257c589-7d90-4bf9-83a7-7f8ab02584d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8257c589-7d90-4bf9-83a7-7f8ab02584d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:58:19.475161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:19.476173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:19.477146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 508/1029] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 22 21:58:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:19.482683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257c589-7d90-4bf9-83a7-7f8ab02584d4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:19.498146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7e34b-65c0-41f6-a615-4bec200227dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:19.498800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7e34b-65c0-41f6-a615-4bec200227dc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:19.499077 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7e34b-65c0-41f6-a615-4bec200227dc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:19.499345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7e34b-65c0-41f6-a615-4bec200227dc None admin] PATH_INFO: `/v3/services/image` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:19.499936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7e34b-65c0-41f6-a615-4bec200227dc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:19.501468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7e34b-65c0-41f6-a615-4bec200227dc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-dfc7e34b-65c0-41f6-a615-4bec200227dc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:19.512807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:19.513882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:19.514736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 522/1030] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Sep 22 21:58:19 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:19.519912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7e34b-65c0-41f6-a615-4bec200227dc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:19.532252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:19.536759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:19.589772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257c589-7d90-4bf9-83a7-7f8ab02584d4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:19.626363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d905e0-d2da-4c22-a9aa-e8265868337f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:19.626963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d905e0-d2da-4c22-a9aa-e8265868337f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:19.627235 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d905e0-d2da-4c22-a9aa-e8265868337f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:19.627499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d905e0-d2da-4c22-a9aa-e8265868337f None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:19.628152 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d905e0-d2da-4c22-a9aa-e8265868337f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:19.628448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d905e0-d2da-4c22-a9aa-e8265868337f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:19.629522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7e34b-65c0-41f6-a615-4bec200227dc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:19.629810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d905e0-d2da-4c22-a9aa-e8265868337f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:19.638229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 509/1031] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 22 21:58:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:19.643735 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d905e0-d2da-4c22-a9aa-e8265868337f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:19.670879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfdd58-5f16-472a-a830-aed101d14f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:19.671802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfdd58-5f16-472a-a830-aed101d14f76 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:19.672086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfdd58-5f16-472a-a830-aed101d14f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:19.672382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfdd58-5f16-472a-a830-aed101d14f76 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:19.672994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfdd58-5f16-472a-a830-aed101d14f76 None admin] RBAC: Adding query filter params (name=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:19.673310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfdd58-5f16-472a-a830-aed101d14f76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:19.674720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfdd58-5f16-472a-a830-aed101d14f76 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:19.684538 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 523/1032] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:19.686478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfdd58-5f16-472a-a830-aed101d14f76 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:19.749265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d905e0-d2da-4c22-a9aa-e8265868337f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:19.756567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:19.778094 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:19.785226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72ecca-5099-49fb-86bf-8c460fc13657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:19.785885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ecca-5099-49fb-86bf-8c460fc13657 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:19.786164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ecca-5099-49fb-86bf-8c460fc13657 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:19.786439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ecca-5099-49fb-86bf-8c460fc13657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:19.796875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72ecca-5099-49fb-86bf-8c460fc13657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:19.798397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72ecca-5099-49fb-86bf-8c460fc13657 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:19.803210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfdd58-5f16-472a-a830-aed101d14f76 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0c72ecca-5099-49fb-86bf-8c460fc13657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:19.813991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:19.815020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:19.815932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:19.815932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:19.815932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:19.815932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 510/1033] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:19.820879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72ecca-5099-49fb-86bf-8c460fc13657 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:19.843472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519108e2-442a-4d9f-8746-bbcd0770a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:19.843835 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519108e2-442a-4d9f-8746-bbcd0770a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:19.844112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519108e2-442a-4d9f-8746-bbcd0770a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:19.844383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519108e2-442a-4d9f-8746-bbcd0770a4f5 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:19.845018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519108e2-442a-4d9f-8746-bbcd0770a4f5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:19.845321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519108e2-442a-4d9f-8746-bbcd0770a4f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:19.846712 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519108e2-442a-4d9f-8746-bbcd0770a4f5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:19.856352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 524/1034] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:19.857359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519108e2-442a-4d9f-8746-bbcd0770a4f5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:19.931477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72ecca-5099-49fb-86bf-8c460fc13657 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:19.965773 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519108e2-442a-4d9f-8746-bbcd0770a4f5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:19.967207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf75fe6-3eaf-447c-a5c4-587717d4dc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:19.967817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf75fe6-3eaf-447c-a5c4-587717d4dc64 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:19.968094 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf75fe6-3eaf-447c-a5c4-587717d4dc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:19.968365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf75fe6-3eaf-447c-a5c4-587717d4dc64 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:19.969002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf75fe6-3eaf-447c-a5c4-587717d4dc64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:19.969303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf75fe6-3eaf-447c-a5c4-587717d4dc64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:19.970699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf75fe6-3eaf-447c-a5c4-587717d4dc64 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:19.982492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 511/1035] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:19.987991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf75fe6-3eaf-447c-a5c4-587717d4dc64 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:20.005962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:20.009011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b510a-5c11-4267-990f-2479b20549f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:20.009954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b510a-5c11-4267-990f-2479b20549f7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:20.010236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b510a-5c11-4267-990f-2479b20549f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:20.010496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b510a-5c11-4267-990f-2479b20549f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:20.011197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b510a-5c11-4267-990f-2479b20549f7 None admin] RBAC: Adding query filter params (interface=public, service_id=6658469b3f25432bb0f8f6cac1fc17e7, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:20.011496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b510a-5c11-4267-990f-2479b20549f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:20.012855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b510a-5c11-4267-990f-2479b20549f7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:20.017890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 525/1036] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 22 21:58:19 2022] GET /identity/v3/endpoints?service_id=6658469b3f25432bb0f8f6cac1fc17e7&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:20.023523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b510a-5c11-4267-990f-2479b20549f7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:20.027558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:20.092564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf75fe6-3eaf-447c-a5c4-587717d4dc64 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:20.126595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a4330-8af2-48ff-b7e1-be9969353cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:20.127557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4330-8af2-48ff-b7e1-be9969353cbe None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:20.127683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b510a-5c11-4267-990f-2479b20549f7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:20.128164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4330-8af2-48ff-b7e1-be9969353cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:20.128624 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4330-8af2-48ff-b7e1-be9969353cbe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:20.136240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a4330-8af2-48ff-b7e1-be9969353cbe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:20.137950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a4330-8af2-48ff-b7e1-be9969353cbe None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-5d7a4330-8af2-48ff-b7e1-be9969353cbe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:58:20.150074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:20.151025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:20.151993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:20.151993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:20.151993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:58:20.151993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:58:20.151993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:58:20.151993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:58:20.151993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:58:20.151993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:58:20.151993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:58:20.151993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:20.154240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 512/1037] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 22 21:58:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:20.159932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a4330-8af2-48ff-b7e1-be9969353cbe None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:20.167068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2dc25-47b0-41db-b0f2-a06cc69ed64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:20.168011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2dc25-47b0-41db-b0f2-a06cc69ed64d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:20.168480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2dc25-47b0-41db-b0f2-a06cc69ed64d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:20.169361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2dc25-47b0-41db-b0f2-a06cc69ed64d None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:20.170271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2dc25-47b0-41db-b0f2-a06cc69ed64d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:20.172261 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2dc25-47b0-41db-b0f2-a06cc69ed64d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:20.179138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 526/1038] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 22 21:58:20 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 21:58:20.247591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:20.275819 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a4330-8af2-48ff-b7e1-be9969353cbe None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:20.312743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d028d-011a-467a-9170-c9af981a47f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:20.313365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d028d-011a-467a-9170-c9af981a47f7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:20.313640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d028d-011a-467a-9170-c9af981a47f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:20.313946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d028d-011a-467a-9170-c9af981a47f7 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:20.314687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d028d-011a-467a-9170-c9af981a47f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:20.314992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d028d-011a-467a-9170-c9af981a47f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:20.316478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d028d-011a-467a-9170-c9af981a47f7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:20.336666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 513/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 22 21:58:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:20.342673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2dc25-47b0-41db-b0f2-a06cc69ed64d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:20.415111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:20.450116 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2dc25-47b0-41db-b0f2-a06cc69ed64d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:20.484481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc301ef4-79ec-409d-9b53-8815c6cec2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:20.485090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc301ef4-79ec-409d-9b53-8815c6cec2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:20.485363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc301ef4-79ec-409d-9b53-8815c6cec2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:20.485626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc301ef4-79ec-409d-9b53-8815c6cec2e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:20.555324 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc301ef4-79ec-409d-9b53-8815c6cec2e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:20.556784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc301ef4-79ec-409d-9b53-8815c6cec2e8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:20.622085 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:20.662900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 527/1040] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:58:20 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 21:58:20.664399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d028d-011a-467a-9170-c9af981a47f7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:20.775824 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d028d-011a-467a-9170-c9af981a47f7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:20.812528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5fa7-ae87-4c54-8a8c-bc9260af3abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:20.813153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5fa7-ae87-4c54-8a8c-bc9260af3abc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:20.813424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5fa7-ae87-4c54-8a8c-bc9260af3abc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:20.813685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5fa7-ae87-4c54-8a8c-bc9260af3abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:20.816407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:20.826072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb5fa7-ae87-4c54-8a8c-bc9260af3abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:20.827535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb5fa7-ae87-4c54-8a8c-bc9260af3abc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-95cb5fa7-ae87-4c54-8a8c-bc9260af3abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:20.842836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:20.843816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:20.844729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:20.844729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:20.844729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:20.846201 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 514/1041] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:20.849711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc301ef4-79ec-409d-9b53-8815c6cec2e8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:20.952475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc301ef4-79ec-409d-9b53-8815c6cec2e8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:20.987329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec98774-19b9-44fb-9f01-f66b1f86590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:20.987964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec98774-19b9-44fb-9f01-f66b1f86590a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:20.988208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec98774-19b9-44fb-9f01-f66b1f86590a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:20.988491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec98774-19b9-44fb-9f01-f66b1f86590a None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:20.989133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec98774-19b9-44fb-9f01-f66b1f86590a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:20.989429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec98774-19b9-44fb-9f01-f66b1f86590a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:20.990824 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec98774-19b9-44fb-9f01-f66b1f86590a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:21.007045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 528/1042] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:21.008541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5fa7-ae87-4c54-8a8c-bc9260af3abc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:21.116643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5fa7-ae87-4c54-8a8c-bc9260af3abc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:21.151069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8287-b2f0-4a7c-9594-c1e2a80e1027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:21.151696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8287-b2f0-4a7c-9594-c1e2a80e1027 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:21.151965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8287-b2f0-4a7c-9594-c1e2a80e1027 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:21.152223 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8287-b2f0-4a7c-9594-c1e2a80e1027 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:21.159079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c8287-b2f0-4a7c-9594-c1e2a80e1027 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:21.160514 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c8287-b2f0-4a7c-9594-c1e2a80e1027 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:21.169026 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e432dd2-770b-4d06-a28d-0dcbd17afc0c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:21.169303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e432dd2-770b-4d06-a28d-0dcbd17afc0c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:21.169584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e432dd2-770b-4d06-a28d-0dcbd17afc0c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:21.170982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 529/1043] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:58:21.176021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e024cc-d6b4-41e1-9242-81802106b3fc None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7e4c8287-b2f0-4a7c-9594-c1e2a80e1027 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:58:21.176149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:21.177056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:21.182875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:58:21.182875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:58:21.182875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:58:21.182875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:58:21.182875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:58:21.182875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:58:21.182875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:21.182875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:21.183312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e024cc-d6b4-41e1-9242-81802106b3fc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:21.183312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e024cc-d6b4-41e1-9242-81802106b3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:21.183441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 515/1044] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:21.185031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8287-b2f0-4a7c-9594-c1e2a80e1027 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:21.196804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-10e024cc-d6b4-41e1-9242-81802106b3fc None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:21.198041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-10e024cc-d6b4-41e1-9242-81802106b3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:21.221860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:21.238478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:21.270958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 530/1045] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:21.293765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8287-b2f0-4a7c-9594-c1e2a80e1027 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:21.327318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa8243-917e-4700-9bfe-2b02e81bccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:21.327952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa8243-917e-4700-9bfe-2b02e81bccc4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:21.328210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa8243-917e-4700-9bfe-2b02e81bccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:21.328437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa8243-917e-4700-9bfe-2b02e81bccc4 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:21.329115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa8243-917e-4700-9bfe-2b02e81bccc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:21.329405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa8243-917e-4700-9bfe-2b02e81bccc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:21.330845 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa8243-917e-4700-9bfe-2b02e81bccc4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:21.343659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 516/1046] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:21.349629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e024cc-d6b4-41e1-9242-81802106b3fc None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:21.460071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e024cc-d6b4-41e1-9242-81802106b3fc None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:21.496195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8355d0-5b3f-4d41-9478-3f297393702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:21.496716 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8355d0-5b3f-4d41-9478-3f297393702a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:21.496985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8355d0-5b3f-4d41-9478-3f297393702a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:21.497250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8355d0-5b3f-4d41-9478-3f297393702a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:21.498017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8355d0-5b3f-4d41-9478-3f297393702a None admin] RBAC: Adding query filter params (role.id=22d0e8156009474698e29ac27aef7f02, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=a044973e9e84495dbf8d14e19fc84716) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:21.498319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8355d0-5b3f-4d41-9478-3f297393702a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:21.499735 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8355d0-5b3f-4d41-9478-3f297393702a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:21.505443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 531/1047] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:58:21 2022] GET /identity/v3/role_assignments?user.id=a044973e9e84495dbf8d14e19fc84716&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=22d0e8156009474698e29ac27aef7f02 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:21.534877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa8243-917e-4700-9bfe-2b02e81bccc4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:21.646844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa8243-917e-4700-9bfe-2b02e81bccc4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:21.657871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:21.686489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb0f62-9822-45ef-a979-930812031f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:21.687549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb0f62-9822-45ef-a979-930812031f9e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:21.688019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb0f62-9822-45ef-a979-930812031f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:21.688498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb0f62-9822-45ef-a979-930812031f9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:21.700684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb0f62-9822-45ef-a979-930812031f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-65eb0f62-9822-45ef-a979-930812031f9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:58:21.705629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:21.706618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:21.708637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 517/1048] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:58:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:21.713356 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8355d0-5b3f-4d41-9478-3f297393702a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:21.739940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:21.815798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8355d0-5b3f-4d41-9478-3f297393702a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:21.857871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a57381-d3d3-40fa-bac7-7356402a57a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:21.858574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a57381-d3d3-40fa-bac7-7356402a57a5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:21.858846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a57381-d3d3-40fa-bac7-7356402a57a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:21.859109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a57381-d3d3-40fa-bac7-7356402a57a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:21.859786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a57381-d3d3-40fa-bac7-7356402a57a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:21.860095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a57381-d3d3-40fa-bac7-7356402a57a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:21.861460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a57381-d3d3-40fa-bac7-7356402a57a5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:21.872179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 532/1049] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:58:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:21.877956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb0f62-9822-45ef-a979-930812031f9e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:21.982559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb0f62-9822-45ef-a979-930812031f9e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:22.018231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7caba-1440-47d3-b922-2ea25ee6ea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:22.018863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7caba-1440-47d3-b922-2ea25ee6ea88 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:22.019137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7caba-1440-47d3-b922-2ea25ee6ea88 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:22.019403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7caba-1440-47d3-b922-2ea25ee6ea88 None admin] PATH_INFO: `/v3/users/98308648a01a4ed8be237610649289ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:22.033420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7caba-1440-47d3-b922-2ea25ee6ea88 None admin] RBAC: Authorizing `identity:get_user(user_id=98308648a01a4ed8be237610649289ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:22.034885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7caba-1440-47d3-b922-2ea25ee6ea88 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:22.036697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 518/1050] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:21 2022] GET /identity/v3/users/98308648a01a4ed8be237610649289ad => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:22.042566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a57381-d3d3-40fa-bac7-7356402a57a5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:22.128900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:22.147942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a57381-d3d3-40fa-bac7-7356402a57a5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:22.187871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b065968-696e-4e0e-96bf-aadce6dd5c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:22.188763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065968-696e-4e0e-96bf-aadce6dd5c43 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:22.189170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065968-696e-4e0e-96bf-aadce6dd5c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:22.189565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065968-696e-4e0e-96bf-aadce6dd5c43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:22.275962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b065968-696e-4e0e-96bf-aadce6dd5c43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:22.277433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b065968-696e-4e0e-96bf-aadce6dd5c43 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:22.363798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:22.367191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232464-0986-4ae8-97f5-2d4a75812952 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:22.368073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232464-0986-4ae8-97f5-2d4a75812952 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:22.368410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232464-0986-4ae8-97f5-2d4a75812952 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:22.370016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 519/1051] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:22.375975 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366543b8-336e-44d3-bfc2-28e75f87d871 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:22.376279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366543b8-336e-44d3-bfc2-28e75f87d871 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:22.376534 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366543b8-336e-44d3-bfc2-28e75f87d871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:22.382702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 533/1052] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:58:22 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:58:22.388553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b065968-696e-4e0e-96bf-aadce6dd5c43 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:22.396041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-366543b8-336e-44d3-bfc2-28e75f87d871 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:22.397249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-366543b8-336e-44d3-bfc2-28e75f87d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:22.419310 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:22.473896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 520/1053] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:22.494927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b065968-696e-4e0e-96bf-aadce6dd5c43 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:22.531034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c28dd-f7f2-4fed-8a76-75f0d1088956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:22.531683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c28dd-f7f2-4fed-8a76-75f0d1088956 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:22.531959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c28dd-f7f2-4fed-8a76-75f0d1088956 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:22.532228 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c28dd-f7f2-4fed-8a76-75f0d1088956 None admin] PATH_INFO: `/v3/projects/ab55988503ec45fb811f5d5d9e9df443` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:22.533374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c28dd-f7f2-4fed-8a76-75f0d1088956 None admin] RBAC: Authorizing `identity:get_project(project_id=ab55988503ec45fb811f5d5d9e9df443)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:22.534848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c28dd-f7f2-4fed-8a76-75f0d1088956 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:22.536684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 534/1054] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:58:22 2022] GET /identity/v3/projects/ab55988503ec45fb811f5d5d9e9df443 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:22.542911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366543b8-336e-44d3-bfc2-28e75f87d871 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:22.654657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366543b8-336e-44d3-bfc2-28e75f87d871 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:22.689673 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10d971-897d-4a10-9153-bf03b31437c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:22.690305 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10d971-897d-4a10-9153-bf03b31437c7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:22.690578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10d971-897d-4a10-9153-bf03b31437c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:22.690846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10d971-897d-4a10-9153-bf03b31437c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:22.691566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10d971-897d-4a10-9153-bf03b31437c7 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=ab55988503ec45fb811f5d5d9e9df443, user.id=98308648a01a4ed8be237610649289ad) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:22.691868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10d971-897d-4a10-9153-bf03b31437c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:22.693297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10d971-897d-4a10-9153-bf03b31437c7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:22.706212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 521/1055] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:58:22 2022] GET /identity/v3/role_assignments?user.id=98308648a01a4ed8be237610649289ad&scope.project.id=ab55988503ec45fb811f5d5d9e9df443&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:22.743318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c28dd-f7f2-4fed-8a76-75f0d1088956 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:22.804847 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:22.861249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c28dd-f7f2-4fed-8a76-75f0d1088956 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:22.904386 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c004f3-c384-48bb-b139-28b0952d405b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:22.905168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c004f3-c384-48bb-b139-28b0952d405b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:22.905385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c004f3-c384-48bb-b139-28b0952d405b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:22.905651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c004f3-c384-48bb-b139-28b0952d405b None admin] PATH_INFO: `/v3/services/image` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:22.906280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c004f3-c384-48bb-b139-28b0952d405b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:22.907659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c004f3-c384-48bb-b139-28b0952d405b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-87c004f3-c384-48bb-b139-28b0952d405b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:22.918008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:22.919052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:22.919997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 535/1056] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Sep 22 21:58:22 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:22.925120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10d971-897d-4a10-9153-bf03b31437c7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:22.949122 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:23.042953 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10d971-897d-4a10-9153-bf03b31437c7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:23.078058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e84df0-d063-4354-985c-2862f2da45b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:23.078665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84df0-d063-4354-985c-2862f2da45b4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:23.078936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84df0-d063-4354-985c-2862f2da45b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:23.079201 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84df0-d063-4354-985c-2862f2da45b4 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:23.079834 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e84df0-d063-4354-985c-2862f2da45b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:23.080129 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e84df0-d063-4354-985c-2862f2da45b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:23.081494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e84df0-d063-4354-985c-2862f2da45b4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:23.091991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 522/1057] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:23.093252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c004f3-c384-48bb-b139-28b0952d405b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:23.202923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c004f3-c384-48bb-b139-28b0952d405b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:23.221020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:23.245176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249782c-130c-42c0-a9ca-b5d0bc412c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:23.245937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249782c-130c-42c0-a9ca-b5d0bc412c96 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:23.246390 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249782c-130c-42c0-a9ca-b5d0bc412c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:23.246811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249782c-130c-42c0-a9ca-b5d0bc412c96 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:23.247627 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249782c-130c-42c0-a9ca-b5d0bc412c96 None admin] RBAC: Adding query filter params (type=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:23.248078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249782c-130c-42c0-a9ca-b5d0bc412c96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:23.249681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249782c-130c-42c0-a9ca-b5d0bc412c96 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:23.260866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 536/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:23.262115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e84df0-d063-4354-985c-2862f2da45b4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:23.355384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:23.373975 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e84df0-d063-4354-985c-2862f2da45b4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:23.409036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec6e43-2589-4607-b06a-aec3e7de213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:23.409649 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec6e43-2589-4607-b06a-aec3e7de213e None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:23.410027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec6e43-2589-4607-b06a-aec3e7de213e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:23.410296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec6e43-2589-4607-b06a-aec3e7de213e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:23.410973 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec6e43-2589-4607-b06a-aec3e7de213e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:23.412395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec6e43-2589-4607-b06a-aec3e7de213e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:23.442267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 523/1059] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 21:58:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:23.687949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e58be-ea38-49cf-a5e2-3e665dc01007 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:23.688535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e58be-ea38-49cf-a5e2-3e665dc01007 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:23.688535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e58be-ea38-49cf-a5e2-3e665dc01007 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:23.690036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 537/1060] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:23.695221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b421c-6c3a-4a92-a358-34981eb630e6 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:23.695531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b421c-6c3a-4a92-a358-34981eb630e6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:23.695917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b421c-6c3a-4a92-a358-34981eb630e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:23.718742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c42b421c-6c3a-4a92-a358-34981eb630e6 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:23.719956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c42b421c-6c3a-4a92-a358-34981eb630e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:23.795211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 524/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:24.059007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e58be-ea38-49cf-a5e2-3e665dc01007 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:24.162911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e58be-ea38-49cf-a5e2-3e665dc01007 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:24.197200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9fd6d-0dc0-45cc-9d3c-0efd3cdc8fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:24.197921 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9fd6d-0dc0-45cc-9d3c-0efd3cdc8fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:24.198206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9fd6d-0dc0-45cc-9d3c-0efd3cdc8fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:24.198474 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9fd6d-0dc0-45cc-9d3c-0efd3cdc8fb2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:24.209381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9fd6d-0dc0-45cc-9d3c-0efd3cdc8fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-85a9fd6d-0dc0-45cc-9d3c-0efd3cdc8fb2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:58:24.214767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:24.215706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:58:24.216536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:24.220968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 538/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 22 21:58:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:24.222197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b421c-6c3a-4a92-a358-34981eb630e6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:24.290168 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:24.327915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b421c-6c3a-4a92-a358-34981eb630e6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:24.363376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbdd9c-3726-4430-a45f-3d5b094287f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:24.364010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbdd9c-3726-4430-a45f-3d5b094287f6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:24.364268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbdd9c-3726-4430-a45f-3d5b094287f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:24.364544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbdd9c-3726-4430-a45f-3d5b094287f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:24.365236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbdd9c-3726-4430-a45f-3d5b094287f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:24.365529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbdd9c-3726-4430-a45f-3d5b094287f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:24.366986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbdd9c-3726-4430-a45f-3d5b094287f6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:24.381329 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 525/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 22 21:58:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:24.382817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9fd6d-0dc0-45cc-9d3c-0efd3cdc8fb2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:24.428321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:24.488482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9fd6d-0dc0-45cc-9d3c-0efd3cdc8fb2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:24.521599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c776d8-a524-4afd-af0d-bd21c23b0892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:24.522261 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c776d8-a524-4afd-af0d-bd21c23b0892 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:24.522534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c776d8-a524-4afd-af0d-bd21c23b0892 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:24.522795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c776d8-a524-4afd-af0d-bd21c23b0892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:24.533197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c776d8-a524-4afd-af0d-bd21c23b0892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:24.534670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c776d8-a524-4afd-af0d-bd21c23b0892 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-38c776d8-a524-4afd-af0d-bd21c23b0892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:24.548395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:24.549366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:24.550693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:24.550693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:24.550693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:24.550693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 539/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:24.555569 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbdd9c-3726-4430-a45f-3d5b094287f6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:24.660236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbdd9c-3726-4430-a45f-3d5b094287f6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:24.687752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:24.697777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2ad4c-26f8-43d6-a755-95fa85076217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:24.698675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2ad4c-26f8-43d6-a755-95fa85076217 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:24.699099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2ad4c-26f8-43d6-a755-95fa85076217 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:24.699503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2ad4c-26f8-43d6-a755-95fa85076217 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:24.700296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2ad4c-26f8-43d6-a755-95fa85076217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:24.700733 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2ad4c-26f8-43d6-a755-95fa85076217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:24.702335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2ad4c-26f8-43d6-a755-95fa85076217 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:24.718016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 526/1065] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:24.724287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c776d8-a524-4afd-af0d-bd21c23b0892 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:24.833442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:24.842172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5c4f-45d6-4550-b0b9-455736dd2eaf None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:24.842437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5c4f-45d6-4550-b0b9-455736dd2eaf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:24.842699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5c4f-45d6-4550-b0b9-455736dd2eaf None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:24.844118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 527/1066] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:24.845731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c776d8-a524-4afd-af0d-bd21c23b0892 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:24.849078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a226e-2997-4301-a20f-066ccd63dfc2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:24.849355 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a226e-2997-4301-a20f-066ccd63dfc2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:24.849624 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a226e-2997-4301-a20f-066ccd63dfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:24.869277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-360a226e-2997-4301-a20f-066ccd63dfc2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:24.870507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-360a226e-2997-4301-a20f-066ccd63dfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:24.886385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedcd57-a3da-4c71-bcb9-3d618680a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:24.887012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcd57-a3da-4c71-bcb9-3d618680a89e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:24.887290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcd57-a3da-4c71-bcb9-3d618680a89e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:24.887551 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcd57-a3da-4c71-bcb9-3d618680a89e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:24.895392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedcd57-a3da-4c71-bcb9-3d618680a89e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:24.896731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedcd57-a3da-4c71-bcb9-3d618680a89e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5aedcd57-a3da-4c71-bcb9-3d618680a89e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:58:24.910167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:24.911262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:24.912404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:24.912404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:24.912404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:58:24.912404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:58:24.912404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:58:24.912404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:58:24.912404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:58:24.912404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:58:24.912404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:58:24.912404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:24.912996 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 540/1067] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 22 21:58:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:24.918896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedcd57-a3da-4c71-bcb9-3d618680a89e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:24.945921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 528/1068] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:25.029474 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedcd57-a3da-4c71-bcb9-3d618680a89e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:25.063494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e4297-23d9-429b-beb1-8a6aff01f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:25.064106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e4297-23d9-429b-beb1-8a6aff01f581 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:25.064377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e4297-23d9-429b-beb1-8a6aff01f581 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:25.064639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e4297-23d9-429b-beb1-8a6aff01f581 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:25.065366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e4297-23d9-429b-beb1-8a6aff01f581 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:25.065654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e4297-23d9-429b-beb1-8a6aff01f581 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:25.067124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e4297-23d9-429b-beb1-8a6aff01f581 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:25.084959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 541/1069] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 22 21:58:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:25.091605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a226e-2997-4301-a20f-066ccd63dfc2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:25.193705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a226e-2997-4301-a20f-066ccd63dfc2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:25.212598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:25.228967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e4297-23d9-429b-beb1-8a6aff01f581 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:25.230721 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aa492-6759-46bd-926c-fe9d33f78d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:25.231344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aa492-6759-46bd-926c-fe9d33f78d06 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:25.231616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aa492-6759-46bd-926c-fe9d33f78d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:25.231875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aa492-6759-46bd-926c-fe9d33f78d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:25.242050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:25.244273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aa492-6759-46bd-926c-fe9d33f78d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:25.245736 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aa492-6759-46bd-926c-fe9d33f78d06 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a40aa492-6759-46bd-926c-fe9d33f78d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:25.262340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:25.263370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:25.264282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:25.264282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:25.264282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:25.264282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 529/1070] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:25.269012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aa492-6759-46bd-926c-fe9d33f78d06 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:25.350105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e4297-23d9-429b-beb1-8a6aff01f581 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:25.385596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aa492-6759-46bd-926c-fe9d33f78d06 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:25.390530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0698f1-dac5-4c0e-a0bd-db327e989287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:25.391178 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0698f1-dac5-4c0e-a0bd-db327e989287 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:25.391453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0698f1-dac5-4c0e-a0bd-db327e989287 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:25.391721 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0698f1-dac5-4c0e-a0bd-db327e989287 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:25.402943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0698f1-dac5-4c0e-a0bd-db327e989287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4a0698f1-dac5-4c0e-a0bd-db327e989287 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:58:25.407702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:25.408649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:25.409516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 542/1071] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:58:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:25.415395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0698f1-dac5-4c0e-a0bd-db327e989287 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:25.423029 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8caa4-4d77-449e-856c-82fabfdaa252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:25.423632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8caa4-4d77-449e-856c-82fabfdaa252 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:25.423907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8caa4-4d77-449e-856c-82fabfdaa252 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:25.424132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8caa4-4d77-449e-856c-82fabfdaa252 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:25.424763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8caa4-4d77-449e-856c-82fabfdaa252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:25.425069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8caa4-4d77-449e-856c-82fabfdaa252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:25.426481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8caa4-4d77-449e-856c-82fabfdaa252 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:25.438848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 530/1072] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:25.444531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8caa4-4d77-449e-856c-82fabfdaa252 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:25.475728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:25.493021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:25.530088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0698f1-dac5-4c0e-a0bd-db327e989287 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:25.552805 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8caa4-4d77-449e-856c-82fabfdaa252 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:25.569886 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63931b42-3024-4015-b055-8786c3a46355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:25.570907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63931b42-3024-4015-b055-8786c3a46355 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:25.571357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63931b42-3024-4015-b055-8786c3a46355 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:25.571819 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63931b42-3024-4015-b055-8786c3a46355 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:25.572690 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63931b42-3024-4015-b055-8786c3a46355 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:25.572990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63931b42-3024-4015-b055-8786c3a46355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:25.574432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63931b42-3024-4015-b055-8786c3a46355 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:25.583698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 543/1073] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:25.589634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63931b42-3024-4015-b055-8786c3a46355 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:25.597192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e9915-d793-4275-bd12-2f1d04308a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:25.597827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e9915-d793-4275-bd12-2f1d04308a74 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:25.598097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e9915-d793-4275-bd12-2f1d04308a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:25.598389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e9915-d793-4275-bd12-2f1d04308a74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:25.607336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e9915-d793-4275-bd12-2f1d04308a74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:25.609035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e9915-d793-4275-bd12-2f1d04308a74 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-324e9915-d793-4275-bd12-2f1d04308a74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:58:25.623664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:25.624606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:25.630469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:58:25.630469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:58:25.630469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:58:25.630469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:58:25.630469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:58:25.630469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:58:25.630469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:25.630469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:25.630469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 531/1074] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:25.630986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e9915-d793-4275-bd12-2f1d04308a74 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:25.689655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63931b42-3024-4015-b055-8786c3a46355 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:25.722046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:25.727605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca27b0-0b97-4e48-b40b-1faea007a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:25.728232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:25.728344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca27b0-0b97-4e48-b40b-1faea007a802 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:25.728552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca27b0-0b97-4e48-b40b-1faea007a802 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:25.728759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca27b0-0b97-4e48-b40b-1faea007a802 None admin] PATH_INFO: `/v3/users/98308648a01a4ed8be237610649289ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:25.730336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca27b0-0b97-4e48-b40b-1faea007a802 None admin] RBAC: Authorizing `identity:get_user(user_id=98308648a01a4ed8be237610649289ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:25.731770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca27b0-0b97-4e48-b40b-1faea007a802 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:25.733533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 544/1075] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:25 2022] GET /identity/v3/users/98308648a01a4ed8be237610649289ad => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:25.734655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb2505-5efc-4c9d-b6ae-a4fc5f1fbe6f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:25.734936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb2505-5efc-4c9d-b6ae-a4fc5f1fbe6f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:25.735206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb2505-5efc-4c9d-b6ae-a4fc5f1fbe6f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:25.736376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 545/1076] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:25.738908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb2505-5efc-4c9d-b6ae-a4fc5f1fbe6f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:25.745338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e9915-d793-4275-bd12-2f1d04308a74 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:25.777772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e61f9b-1f5b-43f9-971a-ea8c49674c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:25.778404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e61f9b-1f5b-43f9-971a-ea8c49674c90 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:25.778676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e61f9b-1f5b-43f9-971a-ea8c49674c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:25.778943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e61f9b-1f5b-43f9-971a-ea8c49674c90 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:25.779622 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e61f9b-1f5b-43f9-971a-ea8c49674c90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:25.779921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e61f9b-1f5b-43f9-971a-ea8c49674c90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:25.781369 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e61f9b-1f5b-43f9-971a-ea8c49674c90 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:25.794372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 532/1077] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:25.795679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5006bf-b94e-4b4b-8d93-4c36c9a5653b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:25.795960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5006bf-b94e-4b4b-8d93-4c36c9a5653b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:25.796224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5006bf-b94e-4b4b-8d93-4c36c9a5653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:25.813573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1c5006bf-b94e-4b4b-8d93-4c36c9a5653b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:25.814771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1c5006bf-b94e-4b4b-8d93-4c36c9a5653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:25.846136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb2505-5efc-4c9d-b6ae-a4fc5f1fbe6f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:25.880986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 533/1078] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:25.881896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5006bf-b94e-4b4b-8d93-4c36c9a5653b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:25.887252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6dec86-359b-4e3a-b115-3e8c1bc68659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:25.887897 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dec86-359b-4e3a-b115-3e8c1bc68659 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:25.888191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dec86-359b-4e3a-b115-3e8c1bc68659 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:25.888463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dec86-359b-4e3a-b115-3e8c1bc68659 None admin] PATH_INFO: `/v3/projects/ab55988503ec45fb811f5d5d9e9df443` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:25.889794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6dec86-359b-4e3a-b115-3e8c1bc68659 None admin] RBAC: Authorizing `identity:get_project(project_id=ab55988503ec45fb811f5d5d9e9df443)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:25.891266 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6dec86-359b-4e3a-b115-3e8c1bc68659 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:25.897260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 546/1079] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:58:25 2022] GET /identity/v3/projects/ab55988503ec45fb811f5d5d9e9df443 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:25.898841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6dec86-359b-4e3a-b115-3e8c1bc68659 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:25.967723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:25.972305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:25.991923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5006bf-b94e-4b4b-8d93-4c36c9a5653b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:26.005696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6dec86-359b-4e3a-b115-3e8c1bc68659 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:26.029183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5987cc9-54cc-4565-a4b2-ceadad5fca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:26.030265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5987cc9-54cc-4565-a4b2-ceadad5fca69 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:26.030776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5987cc9-54cc-4565-a4b2-ceadad5fca69 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:26.031211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5987cc9-54cc-4565-a4b2-ceadad5fca69 None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/a044973e9e84495dbf8d14e19fc84716/roles/22d0e8156009474698e29ac27aef7f02` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:26.033739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5987cc9-54cc-4565-a4b2-ceadad5fca69 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=a044973e9e84495dbf8d14e19fc84716, role_id=22d0e8156009474698e29ac27aef7f02)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:26.035351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5987cc9-54cc-4565-a4b2-ceadad5fca69 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:26.037859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c57171-0a30-4b03-9b37-0786034c0ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:26.038523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c57171-0a30-4b03-9b37-0786034c0ab5 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:26.038799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c57171-0a30-4b03-9b37-0786034c0ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:26.039131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c57171-0a30-4b03-9b37-0786034c0ab5 None admin] PATH_INFO: `/v3/projects/ab55988503ec45fb811f5d5d9e9df443/users/98308648a01a4ed8be237610649289ad/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:26.041194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c57171-0a30-4b03-9b37-0786034c0ab5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab55988503ec45fb811f5d5d9e9df443, user_id=98308648a01a4ed8be237610649289ad, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:26.042735 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c57171-0a30-4b03-9b37-0786034c0ab5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:26.051298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 534/1080] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:58:25 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/a044973e9e84495dbf8d14e19fc84716/roles/22d0e8156009474698e29ac27aef7f02 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:58:26.059814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 547/1081] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:58:25 2022] PUT /identity/v3/projects/ab55988503ec45fb811f5d5d9e9df443/users/98308648a01a4ed8be237610649289ad/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:58:26.144062 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5987cc9-54cc-4565-a4b2-ceadad5fca69 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:26.264604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5987cc9-54cc-4565-a4b2-ceadad5fca69 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:26.300115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b9286-ae9b-40bc-bf83-e83a885e5be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:26.301112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b9286-ae9b-40bc-bf83-e83a885e5be9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:26.301580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b9286-ae9b-40bc-bf83-e83a885e5be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:26.302174 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b9286-ae9b-40bc-bf83-e83a885e5be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:26.313784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:26.376389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b9286-ae9b-40bc-bf83-e83a885e5be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:26.377910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b9286-ae9b-40bc-bf83-e83a885e5be9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:26.485876 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 535/1082] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:58:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:58:26.488224 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c57171-0a30-4b03-9b37-0786034c0ab5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:26.594168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c57171-0a30-4b03-9b37-0786034c0ab5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:26.620882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:26.630454 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dd1ba-0b67-47e1-9fff-7fd6b9c3f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:26.631108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dd1ba-0b67-47e1-9fff-7fd6b9c3f042 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:26.631402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dd1ba-0b67-47e1-9fff-7fd6b9c3f042 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:26.631659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dd1ba-0b67-47e1-9fff-7fd6b9c3f042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:26.642940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dd1ba-0b67-47e1-9fff-7fd6b9c3f042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:26.644394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dd1ba-0b67-47e1-9fff-7fd6b9c3f042 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6b1dd1ba-0b67-47e1-9fff-7fd6b9c3f042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:26.658808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:26.659794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:26.660689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:26.660689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:26.660689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:26.660689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 548/1083] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:26.667492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b9286-ae9b-40bc-bf83-e83a885e5be9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:26.717714 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:26.784013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b9286-ae9b-40bc-bf83-e83a885e5be9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:26.819591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ca501-c128-46d9-af2f-67291cf3dcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:26.820220 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ca501-c128-46d9-af2f-67291cf3dcd6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:26.820490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ca501-c128-46d9-af2f-67291cf3dcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:26.820765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ca501-c128-46d9-af2f-67291cf3dcd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:26.821527 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ca501-c128-46d9-af2f-67291cf3dcd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:26.821824 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ca501-c128-46d9-af2f-67291cf3dcd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:26.823213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ca501-c128-46d9-af2f-67291cf3dcd6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:26.834954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 536/1084] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:28.210488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39448d91-fa68-44cf-b39b-5371c427e0d2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:28.212018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39448d91-fa68-44cf-b39b-5371c427e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:28.212018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39448d91-fa68-44cf-b39b-5371c427e0d2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:28.212214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b7c57-0eab-4841-8b6a-383a1c7e79eb None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:28.212214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b7c57-0eab-4841-8b6a-383a1c7e79eb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:28.212655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b7c57-0eab-4841-8b6a-383a1c7e79eb None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:28.212856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 549/1085] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:28.213741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 537/1086] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 21:58:28.217799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dc8aa-2946-4972-8562-72ebf2069390 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:28.218109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dc8aa-2946-4972-8562-72ebf2069390 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:28.218381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dc8aa-2946-4972-8562-72ebf2069390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:28.218711 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da142e-9e27-4ad0-843c-b00d180592d0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:28.218990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da142e-9e27-4ad0-843c-b00d180592d0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:28.219258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da142e-9e27-4ad0-843c-b00d180592d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:28.236486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-913dc8aa-2946-4972-8562-72ebf2069390 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:28.237665 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-913dc8aa-2946-4972-8562-72ebf2069390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:28.239109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-26da142e-9e27-4ad0-843c-b00d180592d0 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:28.240276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-26da142e-9e27-4ad0-843c-b00d180592d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:28.305669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 550/1087] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:28.307876 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 538/1088] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:28.566771 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dc8aa-2946-4972-8562-72ebf2069390 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:28.577463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da142e-9e27-4ad0-843c-b00d180592d0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:28.607224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:28.664666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dc8aa-2946-4972-8562-72ebf2069390 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:28.675070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:28.675755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da142e-9e27-4ad0-843c-b00d180592d0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:28.698919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479e5ab-2ce2-466b-a0db-cc318232a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:28.699558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e5ab-2ce2-466b-a0db-cc318232a936 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:28.699832 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e5ab-2ce2-466b-a0db-cc318232a936 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:28.700097 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e5ab-2ce2-466b-a0db-cc318232a936 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:28.713863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479e5ab-2ce2-466b-a0db-cc318232a936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:58:28.714980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c5283-9638-44ba-80c7-912e227cefc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:28.715643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5283-9638-44ba-80c7-912e227cefc6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:28.715870 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5283-9638-44ba-80c7-912e227cefc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:28.716129 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5283-9638-44ba-80c7-912e227cefc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8479e5ab-2ce2-466b-a0db-cc318232a936 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:58:28.718682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:28.719793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:28.720626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 551/1089] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 22 21:58:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:28.725787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479e5ab-2ce2-466b-a0db-cc318232a936 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:28.728939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c5283-9638-44ba-80c7-912e227cefc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e28c5283-9638-44ba-80c7-912e227cefc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:58:28.733682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:28.734707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:28.736194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 539/1090] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:28.740693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c5283-9638-44ba-80c7-912e227cefc6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:28.825411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479e5ab-2ce2-466b-a0db-cc318232a936 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:28.833150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:28.843366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c5283-9638-44ba-80c7-912e227cefc6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:28.860041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc3175-d8b0-4867-837f-7fb5185f92c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:28.860645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3175-d8b0-4867-837f-7fb5185f92c8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:28.860912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3175-d8b0-4867-837f-7fb5185f92c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:28.861176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3175-d8b0-4867-837f-7fb5185f92c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:28.861827 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc3175-d8b0-4867-837f-7fb5185f92c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:28.862157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc3175-d8b0-4867-837f-7fb5185f92c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:28.863527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc3175-d8b0-4867-837f-7fb5185f92c8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:28.871566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 552/1091] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 22 21:58:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:28.876639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b0b5-d89a-43bb-8b1f-4bfe7ee0986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:28.877240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b0b5-d89a-43bb-8b1f-4bfe7ee0986f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:28.877360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc3175-d8b0-4867-837f-7fb5185f92c8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:28.877501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b0b5-d89a-43bb-8b1f-4bfe7ee0986f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:28.877774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b0b5-d89a-43bb-8b1f-4bfe7ee0986f None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:28.878465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b0b5-d89a-43bb-8b1f-4bfe7ee0986f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:28.878761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b0b5-d89a-43bb-8b1f-4bfe7ee0986f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:28.880114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b0b5-d89a-43bb-8b1f-4bfe7ee0986f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:28.888532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 540/1092] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:28.894469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b0b5-d89a-43bb-8b1f-4bfe7ee0986f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:28.907816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:28.979314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc3175-d8b0-4867-837f-7fb5185f92c8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:28.996155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b0b5-d89a-43bb-8b1f-4bfe7ee0986f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:29.014589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded2e2a-32a2-4277-ba4d-bdced841452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:29.015246 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2e2a-32a2-4277-ba4d-bdced841452e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:29.015522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2e2a-32a2-4277-ba4d-bdced841452e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:29.015781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded2e2a-32a2-4277-ba4d-bdced841452e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:29.026217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded2e2a-32a2-4277-ba4d-bdced841452e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:29.027654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded2e2a-32a2-4277-ba4d-bdced841452e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:29.028681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58243fa-9e7d-427a-9b02-a27ac2a2bbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:29.029311 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58243fa-9e7d-427a-9b02-a27ac2a2bbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:29.029636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58243fa-9e7d-427a-9b02-a27ac2a2bbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:29.029945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58243fa-9e7d-427a-9b02-a27ac2a2bbc9 None admin] PATH_INFO: `/v3/users/98308648a01a4ed8be237610649289ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:29.031067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58243fa-9e7d-427a-9b02-a27ac2a2bbc9 None admin] RBAC: Authorizing `identity:get_user(user_id=98308648a01a4ed8be237610649289ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:29.032482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58243fa-9e7d-427a-9b02-a27ac2a2bbc9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:29.034114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 541/1093] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:28 2022] GET /identity/v3/users/98308648a01a4ed8be237610649289ad => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:29.039878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58243fa-9e7d-427a-9b02-a27ac2a2bbc9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-aded2e2a-32a2-4277-ba4d-bdced841452e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:29.041681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:29.042679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:29.043987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:29.043987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:29.043987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:29.043987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 553/1094] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:29.048309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded2e2a-32a2-4277-ba4d-bdced841452e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:29.064565 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:29.131419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:29.141245 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58243fa-9e7d-427a-9b02-a27ac2a2bbc9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:29.148062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded2e2a-32a2-4277-ba4d-bdced841452e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:29.174176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbffd17-84c0-4da4-a5b3-9c8aa630a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:29.174785 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffd17-84c0-4da4-a5b3-9c8aa630a72e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:29.175058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffd17-84c0-4da4-a5b3-9c8aa630a72e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:29.175328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffd17-84c0-4da4-a5b3-9c8aa630a72e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:29.181555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f13539-8179-4bb9-a36a-4bd931a925aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:29.182188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f13539-8179-4bb9-a36a-4bd931a925aa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:29.182467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f13539-8179-4bb9-a36a-4bd931a925aa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:29.182735 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f13539-8179-4bb9-a36a-4bd931a925aa None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:29.183378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f13539-8179-4bb9-a36a-4bd931a925aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:29.183680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f13539-8179-4bb9-a36a-4bd931a925aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:29.185053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f13539-8179-4bb9-a36a-4bd931a925aa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:29.196653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 554/1095] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:29.202428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f13539-8179-4bb9-a36a-4bd931a925aa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:29.246443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbffd17-84c0-4da4-a5b3-9c8aa630a72e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:29.248072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbffd17-84c0-4da4-a5b3-9c8aa630a72e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:29.273882 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:29.315319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f13539-8179-4bb9-a36a-4bd931a925aa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:29.354507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f612a7-fad0-4c18-a3fb-3074844c8a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:29.355270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f612a7-fad0-4c18-a3fb-3074844c8a0f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:29.355614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f612a7-fad0-4c18-a3fb-3074844c8a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:29.355948 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f612a7-fad0-4c18-a3fb-3074844c8a0f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:29.364919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f612a7-fad0-4c18-a3fb-3074844c8a0f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:29.366676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f612a7-fad0-4c18-a3fb-3074844c8a0f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:29.368526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 542/1096] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:58:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 21:58:29.374231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbffd17-84c0-4da4-a5b3-9c8aa630a72e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-14f612a7-fad0-4c18-a3fb-3074844c8a0f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 21:58:29.380024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:29.381003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:29.382713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:29.382713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:29.382713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 21:58:29.382713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 21:58:29.382713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 21:58:29.382713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 21:58:29.382713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 21:58:29.382713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 21:58:29.382713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 21:58:29.382713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:29.382713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 555/1097] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 22 21:58:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:58:29.387021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f612a7-fad0-4c18-a3fb-3074844c8a0f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:29.390639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:29.483092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbffd17-84c0-4da4-a5b3-9c8aa630a72e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:29.497339 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f612a7-fad0-4c18-a3fb-3074844c8a0f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:29.504755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:29.519308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74064c00-7889-48c3-87a5-d7432532ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:29.519936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74064c00-7889-48c3-87a5-d7432532ef48 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:29.520203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74064c00-7889-48c3-87a5-d7432532ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:29.520465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74064c00-7889-48c3-87a5-d7432532ef48 None admin] PATH_INFO: `/v3/projects/ab55988503ec45fb811f5d5d9e9df443` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:29.521574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74064c00-7889-48c3-87a5-d7432532ef48 None admin] RBAC: Authorizing `identity:get_project(project_id=ab55988503ec45fb811f5d5d9e9df443)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:29.523021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74064c00-7889-48c3-87a5-d7432532ef48 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:29.524707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 543/1098] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:58:29 2022] GET /identity/v3/projects/ab55988503ec45fb811f5d5d9e9df443 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:29.530764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74064c00-7889-48c3-87a5-d7432532ef48 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:29.535485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e0a8b-62f4-4652-be53-c7d1c8f7cbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:29.536103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e0a8b-62f4-4652-be53-c7d1c8f7cbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:29.536378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e0a8b-62f4-4652-be53-c7d1c8f7cbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:29.536644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e0a8b-62f4-4652-be53-c7d1c8f7cbe9 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:29.537387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e0a8b-62f4-4652-be53-c7d1c8f7cbe9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:29.537691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e0a8b-62f4-4652-be53-c7d1c8f7cbe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:29.539227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e0a8b-62f4-4652-be53-c7d1c8f7cbe9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:29.556294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 556/1099] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 22 21:58:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:29.562801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e0a8b-62f4-4652-be53-c7d1c8f7cbe9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:29.625985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:29.630471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74064c00-7889-48c3-87a5-d7432532ef48 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:29.664637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e0a8b-62f4-4652-be53-c7d1c8f7cbe9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:29.665374 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db47e6e-43e8-4b76-bcaa-54b1da292f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:29.666015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db47e6e-43e8-4b76-bcaa-54b1da292f06 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:29.666295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db47e6e-43e8-4b76-bcaa-54b1da292f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:29.666572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db47e6e-43e8-4b76-bcaa-54b1da292f06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:29.667314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db47e6e-43e8-4b76-bcaa-54b1da292f06 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=ab55988503ec45fb811f5d5d9e9df443, user.id=98308648a01a4ed8be237610649289ad) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:29.667586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db47e6e-43e8-4b76-bcaa-54b1da292f06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:29.669007 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db47e6e-43e8-4b76-bcaa-54b1da292f06 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:29.674858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 544/1100] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:58:29 2022] GET /identity/v3/role_assignments?user.id=98308648a01a4ed8be237610649289ad&scope.project.id=ab55988503ec45fb811f5d5d9e9df443&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 21:58:29.701776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0531-d2c7-4fc2-92e0-fedb802b4b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:29.702226 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0531-d2c7-4fc2-92e0-fedb802b4b7a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:29.702500 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0531-d2c7-4fc2-92e0-fedb802b4b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:29.702757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0531-d2c7-4fc2-92e0-fedb802b4b7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:29.776718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db0531-d2c7-4fc2-92e0-fedb802b4b7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:29.778230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db0531-d2c7-4fc2-92e0-fedb802b4b7a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:29.846082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:29.887986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 557/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:58:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 21:58:29.894180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db47e6e-43e8-4b76-bcaa-54b1da292f06 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:29.953475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:30.003562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db47e6e-43e8-4b76-bcaa-54b1da292f06 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:30.039333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fe0ff-53d5-4f1b-a76d-9475f78f7e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:30.040040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fe0ff-53d5-4f1b-a76d-9475f78f7e7f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:30.040312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fe0ff-53d5-4f1b-a76d-9475f78f7e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:30.040576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fe0ff-53d5-4f1b-a76d-9475f78f7e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:30.051524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fe0ff-53d5-4f1b-a76d-9475f78f7e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:30.052960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fe0ff-53d5-4f1b-a76d-9475f78f7e7f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-af9fe0ff-53d5-4f1b-a76d-9475f78f7e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:58:30.067486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:30.068665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 21:58:30.069691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:58:30.069691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 21:58:30.069691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:30.069691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 545/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:30.075125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0531-d2c7-4fc2-92e0-fedb802b4b7a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:30.176765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0531-d2c7-4fc2-92e0-fedb802b4b7a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:30.212463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb4ece-92ee-4746-b5f7-19a4e5fe84e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:30.212988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb4ece-92ee-4746-b5f7-19a4e5fe84e9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:30.213267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb4ece-92ee-4746-b5f7-19a4e5fe84e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:30.213535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb4ece-92ee-4746-b5f7-19a4e5fe84e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:30.214215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb4ece-92ee-4746-b5f7-19a4e5fe84e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:30.214514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb4ece-92ee-4746-b5f7-19a4e5fe84e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:30.215880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb4ece-92ee-4746-b5f7-19a4e5fe84e9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:30.227608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 558/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 21:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:30.233475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fe0ff-53d5-4f1b-a76d-9475f78f7e7f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:30.338272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fe0ff-53d5-4f1b-a76d-9475f78f7e7f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:30.340624 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:30.373700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8620-e249-4815-bbb8-0b79296056be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:30.374346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8620-e249-4815-bbb8-0b79296056be None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:30.374619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8620-e249-4815-bbb8-0b79296056be None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:30.374883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8620-e249-4815-bbb8-0b79296056be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:30.381628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f8620-e249-4815-bbb8-0b79296056be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:30.383161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f8620-e249-4815-bbb8-0b79296056be None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-011f8620-e249-4815-bbb8-0b79296056be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 21:58:30.394957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:30.395836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:30.397335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 21:58:30.397335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 21:58:30.397335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:58:30.397335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:58:30.397335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:58:30.397335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:58:30.397335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 21:58:30.397335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:30.397335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 546/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 21:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:30.402214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb4ece-92ee-4746-b5f7-19a4e5fe84e9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:30.428332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:30.505463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb4ece-92ee-4746-b5f7-19a4e5fe84e9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:30.539940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b48d6-f08c-44e8-89ad-4345175ff3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:30.540552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b48d6-f08c-44e8-89ad-4345175ff3ab None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:30.540816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b48d6-f08c-44e8-89ad-4345175ff3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:30.541091 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b48d6-f08c-44e8-89ad-4345175ff3ab None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:30.541784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b48d6-f08c-44e8-89ad-4345175ff3ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:30.542118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b48d6-f08c-44e8-89ad-4345175ff3ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:30.543555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b48d6-f08c-44e8-89ad-4345175ff3ab None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:30.555690 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 559/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 21:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:30.561957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8620-e249-4815-bbb8-0b79296056be None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:30.666188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8620-e249-4815-bbb8-0b79296056be None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:30.701438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc91646-f234-45d9-8d41-4ab916e75992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:30.702065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91646-f234-45d9-8d41-4ab916e75992 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:30.702317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91646-f234-45d9-8d41-4ab916e75992 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:30.702576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91646-f234-45d9-8d41-4ab916e75992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:30.703287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc91646-f234-45d9-8d41-4ab916e75992 None admin] RBAC: Adding query filter params (role.id=22d0e8156009474698e29ac27aef7f02, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=a044973e9e84495dbf8d14e19fc84716) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:30.703582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc91646-f234-45d9-8d41-4ab916e75992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:30.704996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc91646-f234-45d9-8d41-4ab916e75992 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:30.711395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 547/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:58:30 2022] GET /identity/v3/role_assignments?user.id=a044973e9e84495dbf8d14e19fc84716&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=22d0e8156009474698e29ac27aef7f02 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:31.853679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104004e-7567-4d7b-b623-6cec452b7ae2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:31.854592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104004e-7567-4d7b-b623-6cec452b7ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:31.854592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104004e-7567-4d7b-b623-6cec452b7ae2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:31.856582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 560/1107] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:31.865455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0aca0-7924-4627-bafd-81a7eb7b1f23 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:31.865916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0aca0-7924-4627-bafd-81a7eb7b1f23 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:31.866053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0aca0-7924-4627-bafd-81a7eb7b1f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:31.891413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-cea0aca0-7924-4627-bafd-81a7eb7b1f23 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:31.892619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cea0aca0-7924-4627-bafd-81a7eb7b1f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:31.918599 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:31.970618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 548/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:32.243782 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104004e-7567-4d7b-b623-6cec452b7ae2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:32.333250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:32.353463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104004e-7567-4d7b-b623-6cec452b7ae2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:32.388165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cea7b-4fcd-4e14-92fb-1247efc5eba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:32.388783 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cea7b-4fcd-4e14-92fb-1247efc5eba6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:32.389058 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cea7b-4fcd-4e14-92fb-1247efc5eba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:32.389330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cea7b-4fcd-4e14-92fb-1247efc5eba6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:32.390602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cea7b-4fcd-4e14-92fb-1247efc5eba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:32.392043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cea7b-4fcd-4e14-92fb-1247efc5eba6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:32.393600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 561/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:32.400492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0aca0-7924-4627-bafd-81a7eb7b1f23 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:32.506938 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0aca0-7924-4627-bafd-81a7eb7b1f23 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:32.542239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a456d1-2a9e-4446-98f3-94efb5a4d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:32.542826 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a456d1-2a9e-4446-98f3-94efb5a4d8f0 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:32.543099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a456d1-2a9e-4446-98f3-94efb5a4d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:32.543364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a456d1-2a9e-4446-98f3-94efb5a4d8f0 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:32.544006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a456d1-2a9e-4446-98f3-94efb5a4d8f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:32.545440 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a456d1-2a9e-4446-98f3-94efb5a4d8f0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:32.569992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 549/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:58:32 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:34.741576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ee8cf-4161-4461-acb6-7487a87589dc None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:34.742111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ee8cf-4161-4461-acb6-7487a87589dc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:34.742219 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ee8cf-4161-4461-acb6-7487a87589dc None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:34.743576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 562/1111] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:34.749274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d695-e02d-46a9-8700-13d53ac5193f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:34.749723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d695-e02d-46a9-8700-13d53ac5193f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:34.749813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d695-e02d-46a9-8700-13d53ac5193f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:34.772423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4bb9d695-e02d-46a9-8700-13d53ac5193f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:34.774532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4bb9d695-e02d-46a9-8700-13d53ac5193f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:34.789133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:34.857096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 550/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:35.130302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ee8cf-4161-4461-acb6-7487a87589dc None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:35.238599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ee8cf-4161-4461-acb6-7487a87589dc None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:35.274516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db71b36-f094-4c5b-8ef7-9d0a38379fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:35.275136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db71b36-f094-4c5b-8ef7-9d0a38379fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:35.275412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db71b36-f094-4c5b-8ef7-9d0a38379fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:35.275671 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db71b36-f094-4c5b-8ef7-9d0a38379fe5 None admin] PATH_INFO: `/v3/roles/dcc8ff85c52344698c38ecafb6b0978c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:35.277064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db71b36-f094-4c5b-8ef7-9d0a38379fe5 None admin] RBAC: Authorizing `identity:get_role(role_id=dcc8ff85c52344698c38ecafb6b0978c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:35.278469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db71b36-f094-4c5b-8ef7-9d0a38379fe5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:35.279765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 563/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:35 2022] GET /identity/v3/roles/dcc8ff85c52344698c38ecafb6b0978c => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:35.286285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9d695-e02d-46a9-8700-13d53ac5193f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:35.396815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9d695-e02d-46a9-8700-13d53ac5193f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:35.436914 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b471e80-808f-4940-a621-a62be188c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:35.437802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b471e80-808f-4940-a621-a62be188c310 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:35.438171 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b471e80-808f-4940-a621-a62be188c310 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:35.438565 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b471e80-808f-4940-a621-a62be188c310 None admin] PATH_INFO: `/v3/users/9da087c23a5a4df094b0efe24a8bda0c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:35.454361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b471e80-808f-4940-a621-a62be188c310 None admin] RBAC: Authorizing `identity:get_user(user_id=9da087c23a5a4df094b0efe24a8bda0c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:35.455799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b471e80-808f-4940-a621-a62be188c310 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:35.457604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 551/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:35 2022] GET /identity/v3/users/9da087c23a5a4df094b0efe24a8bda0c => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:35.467904 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db71b36-f094-4c5b-8ef7-9d0a38379fe5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:35.493434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:35.581466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db71b36-f094-4c5b-8ef7-9d0a38379fe5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:35.614284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e415e26-27be-48f7-85d2-e6bf4e6c3a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:35.614874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415e26-27be-48f7-85d2-e6bf4e6c3a00 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:35.615143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415e26-27be-48f7-85d2-e6bf4e6c3a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:35.615414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415e26-27be-48f7-85d2-e6bf4e6c3a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:35.680799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e415e26-27be-48f7-85d2-e6bf4e6c3a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:35.682394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e415e26-27be-48f7-85d2-e6bf4e6c3a00 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:35.700606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:35.782770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 564/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:58:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:58:35.789109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b471e80-808f-4940-a621-a62be188c310 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:35.792387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:35.910877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b471e80-808f-4940-a621-a62be188c310 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:35.951038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d013a-23fb-4e1e-9c5f-b0398a3b3a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:35.951587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d013a-23fb-4e1e-9c5f-b0398a3b3a67 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:35.951859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d013a-23fb-4e1e-9c5f-b0398a3b3a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:35.952128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d013a-23fb-4e1e-9c5f-b0398a3b3a67 None admin] PATH_INFO: `/v3/projects/ab55988503ec45fb811f5d5d9e9df443` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:35.953356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d013a-23fb-4e1e-9c5f-b0398a3b3a67 None admin] RBAC: Authorizing `identity:get_project(project_id=ab55988503ec45fb811f5d5d9e9df443)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:35.954821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d013a-23fb-4e1e-9c5f-b0398a3b3a67 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:35.956461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 552/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:58:35 2022] GET /identity/v3/projects/ab55988503ec45fb811f5d5d9e9df443 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:35.963416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e415e26-27be-48f7-85d2-e6bf4e6c3a00 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:36.067455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e415e26-27be-48f7-85d2-e6bf4e6c3a00 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:36.084530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:36.103552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9474f-9713-41ab-b0cd-3faae15af0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:36.104141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9474f-9713-41ab-b0cd-3faae15af0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:36.104409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9474f-9713-41ab-b0cd-3faae15af0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:36.104676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9474f-9713-41ab-b0cd-3faae15af0a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:36.105400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9474f-9713-41ab-b0cd-3faae15af0a5 None admin] RBAC: Adding query filter params (role.id=dcc8ff85c52344698c38ecafb6b0978c, scope.project.id=ab55988503ec45fb811f5d5d9e9df443, user.id=9da087c23a5a4df094b0efe24a8bda0c) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:36.105704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9474f-9713-41ab-b0cd-3faae15af0a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:36.107159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9474f-9713-41ab-b0cd-3faae15af0a5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:36.112368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 565/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:58:35 2022] GET /identity/v3/role_assignments?user.id=9da087c23a5a4df094b0efe24a8bda0c&scope.project.id=ab55988503ec45fb811f5d5d9e9df443&role.id=dcc8ff85c52344698c38ecafb6b0978c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:38.236102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025f88f-9612-4fe5-99b6-ba85afd1a7fb None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:38.237013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025f88f-9612-4fe5-99b6-ba85afd1a7fb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:38.237013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025f88f-9612-4fe5-99b6-ba85afd1a7fb None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:38.239180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 553/1118] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:38.246249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835601-5a0c-418c-9743-c13a3e22eea3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:38.246711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835601-5a0c-418c-9743-c13a3e22eea3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:38.246820 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835601-5a0c-418c-9743-c13a3e22eea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:38.268036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9e835601-5a0c-418c-9743-c13a3e22eea3 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:38.269214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9e835601-5a0c-418c-9743-c13a3e22eea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:38.356814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 566/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:38.622968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025f88f-9612-4fe5-99b6-ba85afd1a7fb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:38.706078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:38.741132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025f88f-9612-4fe5-99b6-ba85afd1a7fb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:38.777194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea33dc8-c4d9-46a3-b1be-85eefecff8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:38.777811 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea33dc8-c4d9-46a3-b1be-85eefecff8fb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:38.778115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea33dc8-c4d9-46a3-b1be-85eefecff8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:38.778383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea33dc8-c4d9-46a3-b1be-85eefecff8fb None admin] PATH_INFO: `/v3/roles/dcc8ff85c52344698c38ecafb6b0978c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:38.779889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea33dc8-c4d9-46a3-b1be-85eefecff8fb None admin] RBAC: Authorizing `identity:get_role(role_id=dcc8ff85c52344698c38ecafb6b0978c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:38.781262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea33dc8-c4d9-46a3-b1be-85eefecff8fb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:38.782647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 554/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:38 2022] GET /identity/v3/roles/dcc8ff85c52344698c38ecafb6b0978c => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:38.792089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e835601-5a0c-418c-9743-c13a3e22eea3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:38.903339 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e835601-5a0c-418c-9743-c13a3e22eea3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:38.916432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:38.939768 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2cebf-603f-4fa7-8d9a-c9ebe436c8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:38.940400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2cebf-603f-4fa7-8d9a-c9ebe436c8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:38.940672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2cebf-603f-4fa7-8d9a-c9ebe436c8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:38.940943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2cebf-603f-4fa7-8d9a-c9ebe436c8c5 None admin] PATH_INFO: `/v3/users/9da087c23a5a4df094b0efe24a8bda0c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:38.942234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2cebf-603f-4fa7-8d9a-c9ebe436c8c5 None admin] RBAC: Authorizing `identity:get_user(user_id=9da087c23a5a4df094b0efe24a8bda0c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:38.943680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2cebf-603f-4fa7-8d9a-c9ebe436c8c5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:38.945371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 567/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:38 2022] GET /identity/v3/users/9da087c23a5a4df094b0efe24a8bda0c => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:38.952203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea33dc8-c4d9-46a3-b1be-85eefecff8fb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:39.064645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea33dc8-c4d9-46a3-b1be-85eefecff8fb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:39.109488 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4673ba3-2949-4f06-ad82-5736734e9eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:39.110388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4673ba3-2949-4f06-ad82-5736734e9eea None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:39.110681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4673ba3-2949-4f06-ad82-5736734e9eea None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:39.110963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4673ba3-2949-4f06-ad82-5736734e9eea None admin] PATH_INFO: `/v3/projects/ab55988503ec45fb811f5d5d9e9df443` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:39.112818 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4673ba3-2949-4f06-ad82-5736734e9eea None admin] RBAC: Authorizing `identity:get_project(project_id=ab55988503ec45fb811f5d5d9e9df443)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:39.115089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4673ba3-2949-4f06-ad82-5736734e9eea None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:39.117552 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 555/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:58:38 2022] GET /identity/v3/projects/ab55988503ec45fb811f5d5d9e9df443 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:39.123915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2cebf-603f-4fa7-8d9a-c9ebe436c8c5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:39.229180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2cebf-603f-4fa7-8d9a-c9ebe436c8c5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:39.263668 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7db1fc-b8ad-4948-9cb7-999cf5e046f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:39.264285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db1fc-b8ad-4948-9cb7-999cf5e046f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:39.264572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db1fc-b8ad-4948-9cb7-999cf5e046f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:39.264841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db1fc-b8ad-4948-9cb7-999cf5e046f8 None admin] PATH_INFO: `/v3/projects/ab55988503ec45fb811f5d5d9e9df443/users/9da087c23a5a4df094b0efe24a8bda0c/roles/dcc8ff85c52344698c38ecafb6b0978c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:39.267349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7db1fc-b8ad-4948-9cb7-999cf5e046f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab55988503ec45fb811f5d5d9e9df443, user_id=9da087c23a5a4df094b0efe24a8bda0c, role_id=dcc8ff85c52344698c38ecafb6b0978c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:39.268781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7db1fc-b8ad-4948-9cb7-999cf5e046f8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:39.289485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 568/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:58:39 2022] PUT /identity/v3/projects/ab55988503ec45fb811f5d5d9e9df443/users/9da087c23a5a4df094b0efe24a8bda0c/roles/dcc8ff85c52344698c38ecafb6b0978c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:58:41.399068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39d5d5-95be-49ea-aade-78caa6432051 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:41.399637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39d5d5-95be-49ea-aade-78caa6432051 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:41.399637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39d5d5-95be-49ea-aade-78caa6432051 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:41.400929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 556/1124] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:41.407164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d1da-0825-462c-b78d-77e394800882 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:41.407850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d1da-0825-462c-b78d-77e394800882 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:41.407940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d1da-0825-462c-b78d-77e394800882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:41.430004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-20d3d1da-0825-462c-b78d-77e394800882 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:41.431195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-20d3d1da-0825-462c-b78d-77e394800882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:41.469601 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:41.506498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 569/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:41.782403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39d5d5-95be-49ea-aade-78caa6432051 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:41.793004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:41.904234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39d5d5-95be-49ea-aade-78caa6432051 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:41.949850 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532dac-2ded-48ef-a0ce-8d0593433acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:41.950505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532dac-2ded-48ef-a0ce-8d0593433acc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:41.950780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532dac-2ded-48ef-a0ce-8d0593433acc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:41.951049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532dac-2ded-48ef-a0ce-8d0593433acc None admin] PATH_INFO: `/v3/roles/dcc8ff85c52344698c38ecafb6b0978c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:41.952466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37532dac-2ded-48ef-a0ce-8d0593433acc None admin] RBAC: Authorizing `identity:get_role(role_id=dcc8ff85c52344698c38ecafb6b0978c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:41.953872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37532dac-2ded-48ef-a0ce-8d0593433acc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:41.955233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 557/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:41 2022] GET /identity/v3/roles/dcc8ff85c52344698c38ecafb6b0978c => generated 223 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:41.962956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3d1da-0825-462c-b78d-77e394800882 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:42.076794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3d1da-0825-462c-b78d-77e394800882 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:42.112772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a90062-c3e8-4719-85f0-c4ce0f95a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:42.113396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a90062-c3e8-4719-85f0-c4ce0f95a874 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:42.113672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a90062-c3e8-4719-85f0-c4ce0f95a874 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:42.113972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a90062-c3e8-4719-85f0-c4ce0f95a874 None admin] PATH_INFO: `/v3/users/9da087c23a5a4df094b0efe24a8bda0c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:42.115229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a90062-c3e8-4719-85f0-c4ce0f95a874 None admin] RBAC: Authorizing `identity:get_user(user_id=9da087c23a5a4df094b0efe24a8bda0c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:42.116680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a90062-c3e8-4719-85f0-c4ce0f95a874 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:42.118349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 570/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:41 2022] GET /identity/v3/users/9da087c23a5a4df094b0efe24a8bda0c => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:42.124372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532dac-2ded-48ef-a0ce-8d0593433acc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:42.202919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:42.231915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532dac-2ded-48ef-a0ce-8d0593433acc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:42.275045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71985dfe-16db-4167-a835-1d7bb2961727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:42.275992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71985dfe-16db-4167-a835-1d7bb2961727 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:42.276438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71985dfe-16db-4167-a835-1d7bb2961727 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:42.276870 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71985dfe-16db-4167-a835-1d7bb2961727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:42.362545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71985dfe-16db-4167-a835-1d7bb2961727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:42.363922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71985dfe-16db-4167-a835-1d7bb2961727 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:42.441482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:42.469258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 558/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:58:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:58:42.478733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a90062-c3e8-4719-85f0-c4ce0f95a874 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:42.522943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:42.593087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a90062-c3e8-4719-85f0-c4ce0f95a874 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:42.629949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df4c7d-ee4f-49ba-ad98-2ef2e5d4adb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:42.630527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df4c7d-ee4f-49ba-ad98-2ef2e5d4adb7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:42.630800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df4c7d-ee4f-49ba-ad98-2ef2e5d4adb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:42.631072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df4c7d-ee4f-49ba-ad98-2ef2e5d4adb7 None admin] PATH_INFO: `/v3/projects/ab55988503ec45fb811f5d5d9e9df443` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:42.632318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df4c7d-ee4f-49ba-ad98-2ef2e5d4adb7 None admin] RBAC: Authorizing `identity:get_project(project_id=ab55988503ec45fb811f5d5d9e9df443)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:42.634192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df4c7d-ee4f-49ba-ad98-2ef2e5d4adb7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:42.635826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 571/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:58:42 2022] GET /identity/v3/projects/ab55988503ec45fb811f5d5d9e9df443 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:42.642462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71985dfe-16db-4167-a835-1d7bb2961727 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:42.741769 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71985dfe-16db-4167-a835-1d7bb2961727 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:42.776905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa39a3a-45d0-4586-b256-f6cb03db9980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:42.777505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39a3a-45d0-4586-b256-f6cb03db9980 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:42.777765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39a3a-45d0-4586-b256-f6cb03db9980 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:42.778053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39a3a-45d0-4586-b256-f6cb03db9980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:42.778764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa39a3a-45d0-4586-b256-f6cb03db9980 None admin] RBAC: Adding query filter params (role.id=dcc8ff85c52344698c38ecafb6b0978c, scope.project.id=ab55988503ec45fb811f5d5d9e9df443, user.id=9da087c23a5a4df094b0efe24a8bda0c) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:42.779065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa39a3a-45d0-4586-b256-f6cb03db9980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:42.780474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa39a3a-45d0-4586-b256-f6cb03db9980 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:42.786277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 559/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:58:42 2022] GET /identity/v3/role_assignments?user.id=9da087c23a5a4df094b0efe24a8bda0c&scope.project.id=ab55988503ec45fb811f5d5d9e9df443&role.id=dcc8ff85c52344698c38ecafb6b0978c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:44.932671 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f153cee-39a2-4152-afad-1be4684120a7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:44.933518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f153cee-39a2-4152-afad-1be4684120a7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:44.933518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f153cee-39a2-4152-afad-1be4684120a7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:44.935713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 572/1131] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:44.941090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0045-11ff-46e9-803d-3f2884d4a9bd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:44.941538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0045-11ff-46e9-803d-3f2884d4a9bd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:44.941630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0045-11ff-46e9-803d-3f2884d4a9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:44.961587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3bcc0045-11ff-46e9-803d-3f2884d4a9bd None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:44.963123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3bcc0045-11ff-46e9-803d-3f2884d4a9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:44.993033 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:45.035227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 560/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:45.303965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f153cee-39a2-4152-afad-1be4684120a7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:45.420170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f153cee-39a2-4152-afad-1be4684120a7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:45.427335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:45.461154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64bd94-b6ba-4169-9b1a-d38ee4b52c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:45.462134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64bd94-b6ba-4169-9b1a-d38ee4b52c0b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:45.462409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64bd94-b6ba-4169-9b1a-d38ee4b52c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:45.462659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64bd94-b6ba-4169-9b1a-d38ee4b52c0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:45.463802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64bd94-b6ba-4169-9b1a-d38ee4b52c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:45.465227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64bd94-b6ba-4169-9b1a-d38ee4b52c0b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:45.466788 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 573/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:45.472841 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc0045-11ff-46e9-803d-3f2884d4a9bd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:45.584279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc0045-11ff-46e9-803d-3f2884d4a9bd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:45.620680 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850953d6-ab55-459b-bb13-529f6962f2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:45.621268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850953d6-ab55-459b-bb13-529f6962f2a4 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:45.621536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850953d6-ab55-459b-bb13-529f6962f2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:45.621797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850953d6-ab55-459b-bb13-529f6962f2a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:45.622457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850953d6-ab55-459b-bb13-529f6962f2a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:45.623871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850953d6-ab55-459b-bb13-529f6962f2a4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:45.653941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 561/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:58:45 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:47.802877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbf257-da1f-48cb-a5dd-4405ce6e87e8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:47.803692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbf257-da1f-48cb-a5dd-4405ce6e87e8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:47.803692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbf257-da1f-48cb-a5dd-4405ce6e87e8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:47.805998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 574/1135] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:47.813993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f9072-d0f9-4163-9596-a69076e60188 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:47.814455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f9072-d0f9-4163-9596-a69076e60188 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:47.814555 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f9072-d0f9-4163-9596-a69076e60188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:47.834850 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-974f9072-d0f9-4163-9596-a69076e60188 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:47.836141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-974f9072-d0f9-4163-9596-a69076e60188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:47.850827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:47.906468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 562/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 21:58:48.169128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbf257-da1f-48cb-a5dd-4405ce6e87e8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:48.279413 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbf257-da1f-48cb-a5dd-4405ce6e87e8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:48.314140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5141cb-6ac5-4afb-8173-c9bdeb8736f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:48.314750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5141cb-6ac5-4afb-8173-c9bdeb8736f9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:48.315025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5141cb-6ac5-4afb-8173-c9bdeb8736f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:48.315287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5141cb-6ac5-4afb-8173-c9bdeb8736f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:48.316491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5141cb-6ac5-4afb-8173-c9bdeb8736f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:48.317937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5141cb-6ac5-4afb-8173-c9bdeb8736f9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:48.319465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 575/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 21:58:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:48.325464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f9072-d0f9-4163-9596-a69076e60188 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:48.430685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f9072-d0f9-4163-9596-a69076e60188 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:48.469275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105109b-8b8b-47d3-b990-1755e9e43ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:48.469880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105109b-8b8b-47d3-b990-1755e9e43ce0 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:48.470160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105109b-8b8b-47d3-b990-1755e9e43ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:48.470423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105109b-8b8b-47d3-b990-1755e9e43ce0 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:48.471070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105109b-8b8b-47d3-b990-1755e9e43ce0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:48.472493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105109b-8b8b-47d3-b990-1755e9e43ce0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:48.502987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 563/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:58:48 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:58:50.729577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67a5c0-42e9-41d4-b6aa-db89c22d7900 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:50.730102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67a5c0-42e9-41d4-b6aa-db89c22d7900 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:50.730102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67a5c0-42e9-41d4-b6aa-db89c22d7900 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:50.732132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 576/1139] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:50.737412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709dc71-7414-4f2f-818c-4878d821d2e1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:50.737860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709dc71-7414-4f2f-818c-4878d821d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:50.737973 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709dc71-7414-4f2f-818c-4878d821d2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:50.751496 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:50.757257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2709dc71-7414-4f2f-818c-4878d821d2e1 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:50.758606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2709dc71-7414-4f2f-818c-4878d821d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:50.827030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 564/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:51.091798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67a5c0-42e9-41d4-b6aa-db89c22d7900 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:51.142275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:51.211590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67a5c0-42e9-41d4-b6aa-db89c22d7900 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:51.249199 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a47135-390a-4e64-98ac-706f8fb918a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:51.249823 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a47135-390a-4e64-98ac-706f8fb918a5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:51.250134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a47135-390a-4e64-98ac-706f8fb918a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:51.250402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a47135-390a-4e64-98ac-706f8fb918a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:51.261301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a47135-390a-4e64-98ac-706f8fb918a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a3a47135-390a-4e64-98ac-706f8fb918a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:58:51.266161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:51.267303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:51.268335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 577/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:51.276729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709dc71-7414-4f2f-818c-4878d821d2e1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:51.395267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709dc71-7414-4f2f-818c-4878d821d2e1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:51.433476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1aeda-f07e-47fb-83a1-583506ce831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:51.434090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1aeda-f07e-47fb-83a1-583506ce831e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:51.434360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1aeda-f07e-47fb-83a1-583506ce831e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:51.434617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1aeda-f07e-47fb-83a1-583506ce831e None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:51.435267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1aeda-f07e-47fb-83a1-583506ce831e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:51.435554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1aeda-f07e-47fb-83a1-583506ce831e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:51.436906 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1aeda-f07e-47fb-83a1-583506ce831e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:51.439443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:51.446643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 565/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:51.453033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a47135-390a-4e64-98ac-706f8fb918a5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:51.558777 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a47135-390a-4e64-98ac-706f8fb918a5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:51.560284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:51.619791 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13158ddf-9e42-4868-ba09-b79419f7c57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:51.620413 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13158ddf-9e42-4868-ba09-b79419f7c57d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:51.620688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13158ddf-9e42-4868-ba09-b79419f7c57d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:51.620951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13158ddf-9e42-4868-ba09-b79419f7c57d None admin] PATH_INFO: `/v3/users/c9ff9d9bb82e4e0c921c833115ae81b4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:51.634944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13158ddf-9e42-4868-ba09-b79419f7c57d None admin] RBAC: Authorizing `identity:get_user(user_id=c9ff9d9bb82e4e0c921c833115ae81b4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:51.636446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13158ddf-9e42-4868-ba09-b79419f7c57d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:51.638058 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 578/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:51 2022] GET /identity/v3/users/c9ff9d9bb82e4e0c921c833115ae81b4 => generated 286 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:51.644219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1aeda-f07e-47fb-83a1-583506ce831e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:51.753530 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1aeda-f07e-47fb-83a1-583506ce831e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:51.789441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7deb48-a82c-44e8-955c-866e7e5f367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:51.790060 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7deb48-a82c-44e8-955c-866e7e5f367a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:51.790333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7deb48-a82c-44e8-955c-866e7e5f367a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:51.790597 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7deb48-a82c-44e8-955c-866e7e5f367a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:51.858131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:51.862191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7deb48-a82c-44e8-955c-866e7e5f367a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:51.863828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7deb48-a82c-44e8-955c-866e7e5f367a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:51.971271 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 566/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:58:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:58:51.980842 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13158ddf-9e42-4868-ba09-b79419f7c57d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:52.095460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13158ddf-9e42-4868-ba09-b79419f7c57d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:52.131550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e094811-6fcc-491a-90e8-6853b952fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:52.132183 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e094811-6fcc-491a-90e8-6853b952fadc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:52.132471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e094811-6fcc-491a-90e8-6853b952fadc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:52.132741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e094811-6fcc-491a-90e8-6853b952fadc None admin] PATH_INFO: `/v3/projects/311df0c164f14cd8b83e796f703c119a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:52.134010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e094811-6fcc-491a-90e8-6853b952fadc None admin] RBAC: Authorizing `identity:get_project(project_id=311df0c164f14cd8b83e796f703c119a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:52.136026 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e094811-6fcc-491a-90e8-6853b952fadc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:52.137665 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 579/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:58:51 2022] GET /identity/v3/projects/311df0c164f14cd8b83e796f703c119a => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:52.144528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7deb48-a82c-44e8-955c-866e7e5f367a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:52.251545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:52.255438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7deb48-a82c-44e8-955c-866e7e5f367a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:52.293097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2897dd-1cec-4846-bab5-e4d5ae3ef2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:52.293689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2897dd-1cec-4846-bab5-e4d5ae3ef2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:52.293981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2897dd-1cec-4846-bab5-e4d5ae3ef2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:52.294274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2897dd-1cec-4846-bab5-e4d5ae3ef2d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:52.294980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2897dd-1cec-4846-bab5-e4d5ae3ef2d1 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=311df0c164f14cd8b83e796f703c119a, user.id=c9ff9d9bb82e4e0c921c833115ae81b4) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:52.295275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2897dd-1cec-4846-bab5-e4d5ae3ef2d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:52.296682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2897dd-1cec-4846-bab5-e4d5ae3ef2d1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:52.302347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 567/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:58:52 2022] GET /identity/v3/role_assignments?user.id=c9ff9d9bb82e4e0c921c833115ae81b4&scope.project.id=311df0c164f14cd8b83e796f703c119a&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:54.403471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d438140-8f4e-491a-b9ff-d9c4adec9174 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:54.404359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d438140-8f4e-491a-b9ff-d9c4adec9174 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:54.404359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d438140-8f4e-491a-b9ff-d9c4adec9174 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:54.406531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 580/1147] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:54.415279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02cd40-cf1f-4314-8e7e-3938ed375b51 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:54.415866 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02cd40-cf1f-4314-8e7e-3938ed375b51 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:54.416000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02cd40-cf1f-4314-8e7e-3938ed375b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:54.437482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-da02cd40-cf1f-4314-8e7e-3938ed375b51 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:54.438999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-da02cd40-cf1f-4314-8e7e-3938ed375b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:54.523317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 568/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:54.799364 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d438140-8f4e-491a-b9ff-d9c4adec9174 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:54.833263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:54.923297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d438140-8f4e-491a-b9ff-d9c4adec9174 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:54.960297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e42eb-104d-4921-977a-78893e4b8c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:54.960910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e42eb-104d-4921-977a-78893e4b8c0a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:54.961182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e42eb-104d-4921-977a-78893e4b8c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:54.961448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e42eb-104d-4921-977a-78893e4b8c0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:54.972464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e42eb-104d-4921-977a-78893e4b8c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ff9e42eb-104d-4921-977a-78893e4b8c0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:58:54.977160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:54.978487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:58:54.979493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 581/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:54.984507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02cd40-cf1f-4314-8e7e-3938ed375b51 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:55.082443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:55.091828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02cd40-cf1f-4314-8e7e-3938ed375b51 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:55.131464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdcfee-9184-4460-b55a-bcdf7218ec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:55.132063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdcfee-9184-4460-b55a-bcdf7218ec53 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:55.132332 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdcfee-9184-4460-b55a-bcdf7218ec53 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:55.132593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdcfee-9184-4460-b55a-bcdf7218ec53 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:55.133271 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdcfee-9184-4460-b55a-bcdf7218ec53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:55.133563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdcfee-9184-4460-b55a-bcdf7218ec53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:55.135055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdcfee-9184-4460-b55a-bcdf7218ec53 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:55.143001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 569/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:55.149066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e42eb-104d-4921-977a-78893e4b8c0a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:55.237399 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:55.251783 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e42eb-104d-4921-977a-78893e4b8c0a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:55.288857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65569e17-fe12-4e8d-b767-09fbbc64a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:55.289481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569e17-fe12-4e8d-b767-09fbbc64a4bc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:55.289758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569e17-fe12-4e8d-b767-09fbbc64a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:55.290052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569e17-fe12-4e8d-b767-09fbbc64a4bc None admin] PATH_INFO: `/v3/users/c9ff9d9bb82e4e0c921c833115ae81b4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:55.291326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569e17-fe12-4e8d-b767-09fbbc64a4bc None admin] RBAC: Authorizing `identity:get_user(user_id=c9ff9d9bb82e4e0c921c833115ae81b4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:55.292773 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569e17-fe12-4e8d-b767-09fbbc64a4bc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:55.294397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 582/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:55 2022] GET /identity/v3/users/c9ff9d9bb82e4e0c921c833115ae81b4 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:55.303053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdcfee-9184-4460-b55a-bcdf7218ec53 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:55.423808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdcfee-9184-4460-b55a-bcdf7218ec53 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:55.473344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f6a8b-9751-48cb-acdc-1a3aa8ac1e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:55.474132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6a8b-9751-48cb-acdc-1a3aa8ac1e19 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:55.474411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6a8b-9751-48cb-acdc-1a3aa8ac1e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:55.474674 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6a8b-9751-48cb-acdc-1a3aa8ac1e19 None admin] PATH_INFO: `/v3/projects/311df0c164f14cd8b83e796f703c119a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:55.475836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f6a8b-9751-48cb-acdc-1a3aa8ac1e19 None admin] RBAC: Authorizing `identity:get_project(project_id=311df0c164f14cd8b83e796f703c119a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:55.477264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f6a8b-9751-48cb-acdc-1a3aa8ac1e19 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:55.478915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 570/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:58:55 2022] GET /identity/v3/projects/311df0c164f14cd8b83e796f703c119a => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:55.485647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65569e17-fe12-4e8d-b767-09fbbc64a4bc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:55.596924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65569e17-fe12-4e8d-b767-09fbbc64a4bc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:55.631802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ba445-405c-4e91-b84d-be5d36df3bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:55.632450 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ba445-405c-4e91-b84d-be5d36df3bc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:55.632726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ba445-405c-4e91-b84d-be5d36df3bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:55.632996 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ba445-405c-4e91-b84d-be5d36df3bc7 None admin] PATH_INFO: `/v3/projects/311df0c164f14cd8b83e796f703c119a/users/c9ff9d9bb82e4e0c921c833115ae81b4/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:55.635228 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ba445-405c-4e91-b84d-be5d36df3bc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=311df0c164f14cd8b83e796f703c119a, user_id=c9ff9d9bb82e4e0c921c833115ae81b4, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:55.636666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ba445-405c-4e91-b84d-be5d36df3bc7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:55.657730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 583/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:58:55 2022] PUT /identity/v3/projects/311df0c164f14cd8b83e796f703c119a/users/c9ff9d9bb82e4e0c921c833115ae81b4/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:58:57.751798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af469c6d-ba88-49c8-831e-f81891a0a8a9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:57.752666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af469c6d-ba88-49c8-831e-f81891a0a8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:57.752666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af469c6d-ba88-49c8-831e-f81891a0a8a9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:57.754851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 571/1154] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:58:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:58:57.760352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6a6a-e92c-429d-98cf-bc69b76978be None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:57.760798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6a6a-e92c-429d-98cf-bc69b76978be None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:57.760896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6a6a-e92c-429d-98cf-bc69b76978be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:57.780752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8c2d6a6a-e92c-429d-98cf-bc69b76978be None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:58:57.781956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8c2d6a6a-e92c-429d-98cf-bc69b76978be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:58:57.792578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:57.851010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 584/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:58:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:58:58.115079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af469c6d-ba88-49c8-831e-f81891a0a8a9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:58.149726 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:58.234995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af469c6d-ba88-49c8-831e-f81891a0a8a9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:58.275586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d87c-fc42-45b6-bce8-ae79c5020bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:58.276206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d87c-fc42-45b6-bce8-ae79c5020bda None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:58.276476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d87c-fc42-45b6-bce8-ae79c5020bda None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:58.276737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d87c-fc42-45b6-bce8-ae79c5020bda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:58.288420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169d87c-fc42-45b6-bce8-ae79c5020bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9169d87c-fc42-45b6-bce8-ae79c5020bda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:58:58.293297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:58:58.294449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:58:58.295601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:58:58.298012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 572/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:58:58.300522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d6a6a-e92c-429d-98cf-bc69b76978be None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:58.399336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d6a6a-e92c-429d-98cf-bc69b76978be None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:58.434913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0e7e2-2466-41d1-a39f-32ac91f52843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:58.435514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0e7e2-2466-41d1-a39f-32ac91f52843 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:58.435787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0e7e2-2466-41d1-a39f-32ac91f52843 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:58.436058 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0e7e2-2466-41d1-a39f-32ac91f52843 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:58.436720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0e7e2-2466-41d1-a39f-32ac91f52843 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:58.437027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0e7e2-2466-41d1-a39f-32ac91f52843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:58.438446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0e7e2-2466-41d1-a39f-32ac91f52843 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:58.446508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 585/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:58.453494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d87c-fc42-45b6-bce8-ae79c5020bda None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:58.541481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:58.567478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d87c-fc42-45b6-bce8-ae79c5020bda None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:58.607525 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d8d82-b132-4241-8451-72a0e50f9e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:58.608146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d8d82-b132-4241-8451-72a0e50f9e8b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:58.608421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d8d82-b132-4241-8451-72a0e50f9e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:58.608687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d8d82-b132-4241-8451-72a0e50f9e8b None admin] PATH_INFO: `/v3/users/c9ff9d9bb82e4e0c921c833115ae81b4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:58.609867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d8d82-b132-4241-8451-72a0e50f9e8b None admin] RBAC: Authorizing `identity:get_user(user_id=c9ff9d9bb82e4e0c921c833115ae81b4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:58.611359 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d8d82-b132-4241-8451-72a0e50f9e8b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:58.612934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 573/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:58:58 2022] GET /identity/v3/users/c9ff9d9bb82e4e0c921c833115ae81b4 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:58.619212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0e7e2-2466-41d1-a39f-32ac91f52843 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:58.632195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:58.738922 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0e7e2-2466-41d1-a39f-32ac91f52843 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:58.773857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56b85-7425-4bde-8fc9-aea3f33b9176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:58.774416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56b85-7425-4bde-8fc9-aea3f33b9176 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:58.774733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56b85-7425-4bde-8fc9-aea3f33b9176 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:58.775001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56b85-7425-4bde-8fc9-aea3f33b9176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:58.845189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c56b85-7425-4bde-8fc9-aea3f33b9176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:58.846660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c56b85-7425-4bde-8fc9-aea3f33b9176 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:58.856736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:58.959802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 586/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:58:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:58:58.966779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d8d82-b132-4241-8451-72a0e50f9e8b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:59.081015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d8d82-b132-4241-8451-72a0e50f9e8b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:59.121465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507d9be-e1c6-49c6-807a-6c562b46c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:59.122112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507d9be-e1c6-49c6-807a-6c562b46c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:59.122385 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507d9be-e1c6-49c6-807a-6c562b46c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:59.122653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507d9be-e1c6-49c6-807a-6c562b46c5f7 None admin] PATH_INFO: `/v3/projects/311df0c164f14cd8b83e796f703c119a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:59.123782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507d9be-e1c6-49c6-807a-6c562b46c5f7 None admin] RBAC: Authorizing `identity:get_project(project_id=311df0c164f14cd8b83e796f703c119a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:59.125209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507d9be-e1c6-49c6-807a-6c562b46c5f7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:59.126885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 574/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:58:58 2022] GET /identity/v3/projects/311df0c164f14cd8b83e796f703c119a => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:58:59.133512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56b85-7425-4bde-8fc9-aea3f33b9176 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:58:59.245237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56b85-7425-4bde-8fc9-aea3f33b9176 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:58:59.254603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:58:59.282362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f47083-ab5b-4dd0-a7d5-077b90bbf504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:58:59.282957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f47083-ab5b-4dd0-a7d5-077b90bbf504 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:58:59.283232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f47083-ab5b-4dd0-a7d5-077b90bbf504 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:58:59.283500 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f47083-ab5b-4dd0-a7d5-077b90bbf504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:58:59.284221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f47083-ab5b-4dd0-a7d5-077b90bbf504 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=311df0c164f14cd8b83e796f703c119a, user.id=c9ff9d9bb82e4e0c921c833115ae81b4) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:58:59.284531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f47083-ab5b-4dd0-a7d5-077b90bbf504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:58:59.285976 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f47083-ab5b-4dd0-a7d5-077b90bbf504 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:58:59.291730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 587/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:58:59 2022] GET /identity/v3/role_assignments?user.id=c9ff9d9bb82e4e0c921c833115ae81b4&scope.project.id=311df0c164f14cd8b83e796f703c119a&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:01.437239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802bc9-fa76-45ca-aad7-5aa284b95dbd None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:01.438217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802bc9-fa76-45ca-aad7-5aa284b95dbd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:01.438217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802bc9-fa76-45ca-aad7-5aa284b95dbd None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:01.440237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 575/1162] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:59:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:59:01.446570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea1210-11f8-4602-89d9-7d77561c694e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:01.447308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea1210-11f8-4602-89d9-7d77561c694e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:01.447452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea1210-11f8-4602-89d9-7d77561c694e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:01.473183 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-adea1210-11f8-4602-89d9-7d77561c694e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:59:01.474405 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-adea1210-11f8-4602-89d9-7d77561c694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:59:01.546136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 588/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:59:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:59:01.810511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15802bc9-fa76-45ca-aad7-5aa284b95dbd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:01.838639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:01.943895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15802bc9-fa76-45ca-aad7-5aa284b95dbd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:01.979985 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd12e60-4cbd-458d-9f37-5f74a85da309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:01.980573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd12e60-4cbd-458d-9f37-5f74a85da309 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:01.980844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd12e60-4cbd-458d-9f37-5f74a85da309 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:01.981103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd12e60-4cbd-458d-9f37-5f74a85da309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:02.048432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd12e60-4cbd-458d-9f37-5f74a85da309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:02.049880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd12e60-4cbd-458d-9f37-5f74a85da309 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:02.070362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:02.151448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 576/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:59:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:59:02.157675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea1210-11f8-4602-89d9-7d77561c694e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:02.264267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea1210-11f8-4602-89d9-7d77561c694e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:02.265910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:02.300649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e476e42-ec70-4b69-8a89-b721802b0a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:02.301273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476e42-ec70-4b69-8a89-b721802b0a26 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:02.301513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476e42-ec70-4b69-8a89-b721802b0a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:02.301802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476e42-ec70-4b69-8a89-b721802b0a26 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:02.308712 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e476e42-ec70-4b69-8a89-b721802b0a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:02.310185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e476e42-ec70-4b69-8a89-b721802b0a26 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3e476e42-ec70-4b69-8a89-b721802b0a26 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:59:02.321595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:59:02.323115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:59:02.324069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 589/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 22 21:59:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 21:59:02.331079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd12e60-4cbd-458d-9f37-5f74a85da309 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:02.440491 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd12e60-4cbd-458d-9f37-5f74a85da309 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:02.459696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:02.481005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc6df8-2efc-4b23-b3fb-c4bc67338999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:02.481600 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc6df8-2efc-4b23-b3fb-c4bc67338999 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:02.481871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc6df8-2efc-4b23-b3fb-c4bc67338999 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:02.482164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc6df8-2efc-4b23-b3fb-c4bc67338999 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:02.482804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc6df8-2efc-4b23-b3fb-c4bc67338999 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:59:02.483102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc6df8-2efc-4b23-b3fb-c4bc67338999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:02.484446 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc6df8-2efc-4b23-b3fb-c4bc67338999 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:02.491579 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 577/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 22 21:59:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:04.611089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae92d8-c5ee-4587-8b4b-a70159dcc453 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:04.611684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae92d8-c5ee-4587-8b4b-a70159dcc453 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:04.611684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae92d8-c5ee-4587-8b4b-a70159dcc453 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:04.612966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 590/1167] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:59:04.619497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9312d52-38b0-47d3-80a3-2a427378f134 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:04.620154 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9312d52-38b0-47d3-80a3-2a427378f134 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:04.620307 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9312d52-38b0-47d3-80a3-2a427378f134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:04.645024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d9312d52-38b0-47d3-80a3-2a427378f134 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:59:04.646261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d9312d52-38b0-47d3-80a3-2a427378f134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:59:04.723632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 578/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:59:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:59:05.023081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae92d8-c5ee-4587-8b4b-a70159dcc453 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:05.160322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae92d8-c5ee-4587-8b4b-a70159dcc453 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:05.207389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100cf3a-e2f4-4e46-962e-326efcba4694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:05.208224 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100cf3a-e2f4-4e46-962e-326efcba4694 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:05.208610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100cf3a-e2f4-4e46-962e-326efcba4694 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:05.208989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100cf3a-e2f4-4e46-962e-326efcba4694 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:05.210054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100cf3a-e2f4-4e46-962e-326efcba4694 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:05.212660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100cf3a-e2f4-4e46-962e-326efcba4694 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:05.238009 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 591/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Thu Sep 22 21:59:05 2022] POST /identity/v3/domains => generated 267 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:59:07.434162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2a540-b249-4f13-b529-c0cc00ff864c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:07.434760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2a540-b249-4f13-b529-c0cc00ff864c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:07.434760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2a540-b249-4f13-b529-c0cc00ff864c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:07.436037 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 579/1170] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:59:07.442408 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512ba14-f065-4785-a20d-b1a753ffb001 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:07.443099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512ba14-f065-4785-a20d-b1a753ffb001 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:07.443254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512ba14-f065-4785-a20d-b1a753ffb001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:07.470526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9512ba14-f065-4785-a20d-b1a753ffb001 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:59:07.471715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9512ba14-f065-4785-a20d-b1a753ffb001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:59:07.489012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:07.540241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 592/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:59:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:59:07.805744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2a540-b249-4f13-b529-c0cc00ff864c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:07.925623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2a540-b249-4f13-b529-c0cc00ff864c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:07.940583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:07.970778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361a922-3140-4e4c-9896-2b64a71d6f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:07.971319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361a922-3140-4e4c-9896-2b64a71d6f2b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:07.971587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361a922-3140-4e4c-9896-2b64a71d6f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:07.971846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361a922-3140-4e4c-9896-2b64a71d6f2b None admin] PATH_INFO: `/v3/domains/43c2c32bbad44cf582152e5844660188` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:07.983796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361a922-3140-4e4c-9896-2b64a71d6f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=43c2c32bbad44cf582152e5844660188)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:07.985233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361a922-3140-4e4c-9896-2b64a71d6f2b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:07.986822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 580/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Sep 22 21:59:07 2022] GET /identity/v3/domains/43c2c32bbad44cf582152e5844660188 => generated 267 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:07.993648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512ba14-f065-4785-a20d-b1a753ffb001 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:08.102833 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512ba14-f065-4785-a20d-b1a753ffb001 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:08.138582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66300a-2545-4483-9820-7b7949e1e160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:08.139165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66300a-2545-4483-9820-7b7949e1e160 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:08.139438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66300a-2545-4483-9820-7b7949e1e160 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:08.139699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66300a-2545-4483-9820-7b7949e1e160 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:08.140338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66300a-2545-4483-9820-7b7949e1e160 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:08.141749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66300a-2545-4483-9820-7b7949e1e160 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:08.171484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 593/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 21:59:07 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:59:10.318972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefcb1c-f86d-4797-a567-f28ed33fee73 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:10.319574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefcb1c-f86d-4797-a567-f28ed33fee73 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:10.319574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefcb1c-f86d-4797-a567-f28ed33fee73 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:10.320851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 581/1174] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:59:10.327446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba6b04-3df6-42a1-a07b-c79374b3e31b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:10.328230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba6b04-3df6-42a1-a07b-c79374b3e31b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:10.328383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba6b04-3df6-42a1-a07b-c79374b3e31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:10.340594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:10.354144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d9ba6b04-3df6-42a1-a07b-c79374b3e31b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:59:10.355381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d9ba6b04-3df6-42a1-a07b-c79374b3e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:59:10.432057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 594/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:59:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:59:10.716345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefcb1c-f86d-4797-a567-f28ed33fee73 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:10.843425 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefcb1c-f86d-4797-a567-f28ed33fee73 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:10.878794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dd0b0-73a2-43c0-a3ae-248218fab818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:10.879398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd0b0-73a2-43c0-a3ae-248218fab818 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:10.879666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd0b0-73a2-43c0-a3ae-248218fab818 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:10.879925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd0b0-73a2-43c0-a3ae-248218fab818 None admin] PATH_INFO: `/v3/domains/43c2c32bbad44cf582152e5844660188` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:10.881144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dd0b0-73a2-43c0-a3ae-248218fab818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=43c2c32bbad44cf582152e5844660188)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:10.882573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dd0b0-73a2-43c0-a3ae-248218fab818 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:10.884149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 582/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Sep 22 21:59:10 2022] GET /identity/v3/domains/43c2c32bbad44cf582152e5844660188 => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:10.890273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba6b04-3df6-42a1-a07b-c79374b3e31b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:10.994579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba6b04-3df6-42a1-a07b-c79374b3e31b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:11.034925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd5e7d-fa12-446e-8c4f-43f6d9ac965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:11.035528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5e7d-fa12-446e-8c4f-43f6d9ac965e None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:11.035807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5e7d-fa12-446e-8c4f-43f6d9ac965e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:11.036073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5e7d-fa12-446e-8c4f-43f6d9ac965e None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:11.036726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd5e7d-fa12-446e-8c4f-43f6d9ac965e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:11.038184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd5e7d-fa12-446e-8c4f-43f6d9ac965e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:11.046374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:11.061524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 595/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 21:59:10 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 21:59:13.248001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf878d1-517b-4716-b21a-06e9ced8da73 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:13.248863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf878d1-517b-4716-b21a-06e9ced8da73 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:13.248863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf878d1-517b-4716-b21a-06e9ced8da73 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:13.250965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 583/1178] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:59:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:59:13.257370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c670-e31f-44a6-8896-9c96af59cb49 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:13.257866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c670-e31f-44a6-8896-9c96af59cb49 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:13.257975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c670-e31f-44a6-8896-9c96af59cb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:13.283811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bda3c670-e31f-44a6-8896-9c96af59cb49 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:59:13.285015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bda3c670-e31f-44a6-8896-9c96af59cb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:59:13.358749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 596/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:59:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:59:13.624681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf878d1-517b-4716-b21a-06e9ced8da73 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:13.675791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:13.746616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf878d1-517b-4716-b21a-06e9ced8da73 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:13.784025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb944f-dc31-420a-bd6e-ed575c7c99c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:13.784640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb944f-dc31-420a-bd6e-ed575c7c99c1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:13.784912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb944f-dc31-420a-bd6e-ed575c7c99c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:13.785183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb944f-dc31-420a-bd6e-ed575c7c99c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:13.798432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb944f-dc31-420a-bd6e-ed575c7c99c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-17cb944f-dc31-420a-bd6e-ed575c7c99c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:59:13.803176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:59:13.804280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:59:13.805539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 584/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:59:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:59:13.810617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3c670-e31f-44a6-8896-9c96af59cb49 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:13.914856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3c670-e31f-44a6-8896-9c96af59cb49 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:13.935186 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:13.955311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcef38-fdfa-4433-aaaa-9d820625358b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:13.955917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcef38-fdfa-4433-aaaa-9d820625358b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:13.956195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcef38-fdfa-4433-aaaa-9d820625358b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:13.956465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcef38-fdfa-4433-aaaa-9d820625358b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:13.957130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcef38-fdfa-4433-aaaa-9d820625358b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:59:13.957434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcef38-fdfa-4433-aaaa-9d820625358b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:13.958852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcef38-fdfa-4433-aaaa-9d820625358b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:13.967505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 597/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:59:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:13.973679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb944f-dc31-420a-bd6e-ed575c7c99c1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:14.074123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:14.077171 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb944f-dc31-420a-bd6e-ed575c7c99c1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:14.112882 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f282a1-8517-45a1-8805-b3a753abb596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:14.113489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f282a1-8517-45a1-8805-b3a753abb596 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:14.113758 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f282a1-8517-45a1-8805-b3a753abb596 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:14.114057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f282a1-8517-45a1-8805-b3a753abb596 None admin] PATH_INFO: `/v3/users/fe46659990e442c18c801f25fdf1ebb4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:14.127490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f282a1-8517-45a1-8805-b3a753abb596 None admin] RBAC: Authorizing `identity:get_user(user_id=fe46659990e442c18c801f25fdf1ebb4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:14.128914 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f282a1-8517-45a1-8805-b3a753abb596 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:14.130524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 585/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:59:13 2022] GET /identity/v3/users/fe46659990e442c18c801f25fdf1ebb4 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:14.136704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcef38-fdfa-4433-aaaa-9d820625358b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:14.240085 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcef38-fdfa-4433-aaaa-9d820625358b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:14.277456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290d95f-cc91-4740-93e2-5081ec35bc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:14.278129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290d95f-cc91-4740-93e2-5081ec35bc5a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:14.278330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290d95f-cc91-4740-93e2-5081ec35bc5a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:14.278596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290d95f-cc91-4740-93e2-5081ec35bc5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:14.327652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:14.349000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290d95f-cc91-4740-93e2-5081ec35bc5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:14.350486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290d95f-cc91-4740-93e2-5081ec35bc5a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:14.450359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 598/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:59:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:59:14.459803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f282a1-8517-45a1-8805-b3a753abb596 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:14.569515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f282a1-8517-45a1-8805-b3a753abb596 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:14.608127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0dfe2-a3a4-420c-b012-92b44f384dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:14.608741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0dfe2-a3a4-420c-b012-92b44f384dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:14.609012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0dfe2-a3a4-420c-b012-92b44f384dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:14.609273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0dfe2-a3a4-420c-b012-92b44f384dd3 None admin] PATH_INFO: `/v3/projects/17b3699a898d49e29e4e828d2d60b77e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:14.610445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0dfe2-a3a4-420c-b012-92b44f384dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=17b3699a898d49e29e4e828d2d60b77e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:14.611865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0dfe2-a3a4-420c-b012-92b44f384dd3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:14.613475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 586/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:59:14 2022] GET /identity/v3/projects/17b3699a898d49e29e4e828d2d60b77e => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:14.620604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290d95f-cc91-4740-93e2-5081ec35bc5a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:14.707649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:14.730376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290d95f-cc91-4740-93e2-5081ec35bc5a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:14.767014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b066d-fd21-48bc-a173-76e8e38675ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:14.767612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b066d-fd21-48bc-a173-76e8e38675ee None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:14.767883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b066d-fd21-48bc-a173-76e8e38675ee None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:14.768142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b066d-fd21-48bc-a173-76e8e38675ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:14.768867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b066d-fd21-48bc-a173-76e8e38675ee None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=17b3699a898d49e29e4e828d2d60b77e, user.id=fe46659990e442c18c801f25fdf1ebb4) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:59:14.769169 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b066d-fd21-48bc-a173-76e8e38675ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:14.770621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b066d-fd21-48bc-a173-76e8e38675ee None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:14.776392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 599/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:59:14 2022] GET /identity/v3/role_assignments?user.id=fe46659990e442c18c801f25fdf1ebb4&scope.project.id=17b3699a898d49e29e4e828d2d60b77e&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:16.880926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d02d-7fce-456c-afb2-b2705b448701 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:16.881862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d02d-7fce-456c-afb2-b2705b448701 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:16.881862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d02d-7fce-456c-afb2-b2705b448701 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:16.883933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 587/1186] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:59:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:59:16.890597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ec369-240d-4cb0-9df1-e2b123e7cb7c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:16.891030 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ec369-240d-4cb0-9df1-e2b123e7cb7c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:16.891162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ec369-240d-4cb0-9df1-e2b123e7cb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:16.919204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cc5ec369-240d-4cb0-9df1-e2b123e7cb7c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:59:16.920411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cc5ec369-240d-4cb0-9df1-e2b123e7cb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:59:16.990918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 600/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:59:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:59:17.270429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17d02d-7fce-456c-afb2-b2705b448701 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:17.302734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:17.388809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17d02d-7fce-456c-afb2-b2705b448701 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:17.424072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4d5ea-5449-4182-bf1f-184e392219d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:17.424697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d5ea-5449-4182-bf1f-184e392219d4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:17.424976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d5ea-5449-4182-bf1f-184e392219d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:17.425244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d5ea-5449-4182-bf1f-184e392219d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:17.436299 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4d5ea-5449-4182-bf1f-184e392219d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b7c4d5ea-5449-4182-bf1f-184e392219d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:59:17.441084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:59:17.442427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 21:59:17.443526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 588/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:59:17.448822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ec369-240d-4cb0-9df1-e2b123e7cb7c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:17.536082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:17.562750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ec369-240d-4cb0-9df1-e2b123e7cb7c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:17.610359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe51ab-96ef-44bb-8bad-2446bb97f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:17.610957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe51ab-96ef-44bb-8bad-2446bb97f6ec None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:17.611230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe51ab-96ef-44bb-8bad-2446bb97f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:17.611494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe51ab-96ef-44bb-8bad-2446bb97f6ec None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:17.612151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe51ab-96ef-44bb-8bad-2446bb97f6ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:59:17.612449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe51ab-96ef-44bb-8bad-2446bb97f6ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:17.613801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe51ab-96ef-44bb-8bad-2446bb97f6ec None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:17.621989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 601/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:59:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:17.631486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4d5ea-5449-4182-bf1f-184e392219d4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:17.726963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:17.742926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4d5ea-5449-4182-bf1f-184e392219d4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:17.777890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603e4f0-1c0b-4a33-9504-5c0f9b6cbe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:17.778516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e4f0-1c0b-4a33-9504-5c0f9b6cbe6e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:17.778792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e4f0-1c0b-4a33-9504-5c0f9b6cbe6e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:17.779056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e4f0-1c0b-4a33-9504-5c0f9b6cbe6e None admin] PATH_INFO: `/v3/users/fe46659990e442c18c801f25fdf1ebb4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:17.780224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603e4f0-1c0b-4a33-9504-5c0f9b6cbe6e None admin] RBAC: Authorizing `identity:get_user(user_id=fe46659990e442c18c801f25fdf1ebb4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:17.781686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603e4f0-1c0b-4a33-9504-5c0f9b6cbe6e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:17.783306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 589/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:59:17 2022] GET /identity/v3/users/fe46659990e442c18c801f25fdf1ebb4 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:17.790133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe51ab-96ef-44bb-8bad-2446bb97f6ec None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:17.899569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe51ab-96ef-44bb-8bad-2446bb97f6ec None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:17.935671 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fea288-91d1-4f49-8f54-39f0e3583666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:17.936295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea288-91d1-4f49-8f54-39f0e3583666 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:17.936570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea288-91d1-4f49-8f54-39f0e3583666 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:17.936839 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea288-91d1-4f49-8f54-39f0e3583666 None admin] PATH_INFO: `/v3/projects/17b3699a898d49e29e4e828d2d60b77e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:17.938108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fea288-91d1-4f49-8f54-39f0e3583666 None admin] RBAC: Authorizing `identity:get_project(project_id=17b3699a898d49e29e4e828d2d60b77e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:17.939543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fea288-91d1-4f49-8f54-39f0e3583666 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:17.941182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 602/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:59:17 2022] GET /identity/v3/projects/17b3699a898d49e29e4e828d2d60b77e => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:17.947852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603e4f0-1c0b-4a33-9504-5c0f9b6cbe6e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:18.058656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603e4f0-1c0b-4a33-9504-5c0f9b6cbe6e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:18.097291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d39649-9416-4fdd-be95-ad79c9aab256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:18.097958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d39649-9416-4fdd-be95-ad79c9aab256 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:18.098234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d39649-9416-4fdd-be95-ad79c9aab256 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:18.098497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d39649-9416-4fdd-be95-ad79c9aab256 None admin] PATH_INFO: `/v3/projects/17b3699a898d49e29e4e828d2d60b77e/users/fe46659990e442c18c801f25fdf1ebb4/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:18.100650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d39649-9416-4fdd-be95-ad79c9aab256 None admin] RBAC: Authorizing `identity:create_grant(project_id=17b3699a898d49e29e4e828d2d60b77e, user_id=fe46659990e442c18c801f25fdf1ebb4, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:18.102111 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d39649-9416-4fdd-be95-ad79c9aab256 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:18.120771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 590/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 21:59:17 2022] PUT /identity/v3/projects/17b3699a898d49e29e4e828d2d60b77e/users/fe46659990e442c18c801f25fdf1ebb4/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 21:59:20.245513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91effc6d-7ba2-4064-af88-6396479625cf None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:20.246492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91effc6d-7ba2-4064-af88-6396479625cf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:20.246492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91effc6d-7ba2-4064-af88-6396479625cf None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:20.248514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 603/1193] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 21:59:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 21:59:20.256287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50c3a-db46-4a10-9bed-e184400c42db None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:20.256683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50c3a-db46-4a10-9bed-e184400c42db None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:20.256826 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50c3a-db46-4a10-9bed-e184400c42db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:20.277556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-85a50c3a-db46-4a10-9bed-e184400c42db None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 21:59:20.278781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-85a50c3a-db46-4a10-9bed-e184400c42db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 21:59:20.291604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:20.353089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 591/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 21:59:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 21:59:20.626197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91effc6d-7ba2-4064-af88-6396479625cf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:20.642557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:20.749014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91effc6d-7ba2-4064-af88-6396479625cf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:20.783809 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452169b9-1894-4a2c-9f38-cc936bcdb5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:20.784434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452169b9-1894-4a2c-9f38-cc936bcdb5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:20.784713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452169b9-1894-4a2c-9f38-cc936bcdb5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:20.784987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452169b9-1894-4a2c-9f38-cc936bcdb5a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:20.797214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452169b9-1894-4a2c-9f38-cc936bcdb5a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-452169b9-1894-4a2c-9f38-cc936bcdb5a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 21:59:20.802170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 21:59:20.803232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 21:59:20.804206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 604/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 21:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 21:59:20.809709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a50c3a-db46-4a10-9bed-e184400c42db None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:20.914188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a50c3a-db46-4a10-9bed-e184400c42db None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:20.948993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c68d0f-31bd-434e-99aa-ec2a6d9addad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:20.949585 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68d0f-31bd-434e-99aa-ec2a6d9addad None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:20.949878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68d0f-31bd-434e-99aa-ec2a6d9addad None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:20.950136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68d0f-31bd-434e-99aa-ec2a6d9addad None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:20.950786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c68d0f-31bd-434e-99aa-ec2a6d9addad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:59:20.951077 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c68d0f-31bd-434e-99aa-ec2a6d9addad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:20.952438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c68d0f-31bd-434e-99aa-ec2a6d9addad None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:20.961380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 592/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 21:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:20.971575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452169b9-1894-4a2c-9f38-cc936bcdb5a8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:21.041700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:21.089086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452169b9-1894-4a2c-9f38-cc936bcdb5a8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:21.123243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fbc58-176c-4d93-ab13-877fa739fa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:21.123853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fbc58-176c-4d93-ab13-877fa739fa5c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:21.124122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fbc58-176c-4d93-ab13-877fa739fa5c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:21.124382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fbc58-176c-4d93-ab13-877fa739fa5c None admin] PATH_INFO: `/v3/users/fe46659990e442c18c801f25fdf1ebb4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:21.125634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fbc58-176c-4d93-ab13-877fa739fa5c None admin] RBAC: Authorizing `identity:get_user(user_id=fe46659990e442c18c801f25fdf1ebb4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:21.127106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fbc58-176c-4d93-ab13-877fa739fa5c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:21.128658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 605/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 22 21:59:20 2022] GET /identity/v3/users/fe46659990e442c18c801f25fdf1ebb4 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:21.138230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c68d0f-31bd-434e-99aa-ec2a6d9addad None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:21.152421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:21.251176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c68d0f-31bd-434e-99aa-ec2a6d9addad None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:21.288430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43249f-4051-41db-9d19-0bea586c4022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:21.289024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43249f-4051-41db-9d19-0bea586c4022 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:21.289279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43249f-4051-41db-9d19-0bea586c4022 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:21.289550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43249f-4051-41db-9d19-0bea586c4022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:21.365735 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43249f-4051-41db-9d19-0bea586c4022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:21.367213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43249f-4051-41db-9d19-0bea586c4022 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:21.376219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:21.475779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 593/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 21:59:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 21:59:21.483061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fbc58-176c-4d93-ab13-877fa739fa5c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:21.608612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fbc58-176c-4d93-ab13-877fa739fa5c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:21.642969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d4389-35b6-48ba-94f1-09d8a72593c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:21.643590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d4389-35b6-48ba-94f1-09d8a72593c2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:21.643860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d4389-35b6-48ba-94f1-09d8a72593c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:21.644121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d4389-35b6-48ba-94f1-09d8a72593c2 None admin] PATH_INFO: `/v3/projects/17b3699a898d49e29e4e828d2d60b77e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:21.645271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d4389-35b6-48ba-94f1-09d8a72593c2 None admin] RBAC: Authorizing `identity:get_project(project_id=17b3699a898d49e29e4e828d2d60b77e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:21.646738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d4389-35b6-48ba-94f1-09d8a72593c2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:21.648349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 606/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 22 21:59:21 2022] GET /identity/v3/projects/17b3699a898d49e29e4e828d2d60b77e => generated 361 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:21.654938 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43249f-4051-41db-9d19-0bea586c4022 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 21:59:21.757998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43249f-4051-41db-9d19-0bea586c4022 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 21:59:21.765404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:21.795240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d9940-0dd3-4854-afaa-f9ddf8b26338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 21:59:21.795839 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9940-0dd3-4854-afaa-f9ddf8b26338 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 21:59:21.796117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9940-0dd3-4854-afaa-f9ddf8b26338 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 21:59:21.796387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9940-0dd3-4854-afaa-f9ddf8b26338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 21:59:21.797108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d9940-0dd3-4854-afaa-f9ddf8b26338 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=17b3699a898d49e29e4e828d2d60b77e, user.id=fe46659990e442c18c801f25fdf1ebb4) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 21:59:21.797417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d9940-0dd3-4854-afaa-f9ddf8b26338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 21:59:21.798883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d9940-0dd3-4854-afaa-f9ddf8b26338 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 21:59:21.805112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 594/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 21:59:21 2022] GET /identity/v3/role_assignments?user.id=fe46659990e442c18c801f25fdf1ebb4&scope.project.id=17b3699a898d49e29e4e828d2d60b77e&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 21:59:31.638309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 21:59:31.802415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=15 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:18.127398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f99de-80a8-40ce-aa1c-302f51f1df9e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:18.128071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f99de-80a8-40ce-aa1c-302f51f1df9e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:18.128071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f99de-80a8-40ce-aa1c-302f51f1df9e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:18.129503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 607/1201] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:00:18.135432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a519-533a-4cbd-af9d-19319bdeb815 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:18.136050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a519-533a-4cbd-af9d-19319bdeb815 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:18.136162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a519-533a-4cbd-af9d-19319bdeb815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:18.159502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6ea5a519-533a-4cbd-af9d-19319bdeb815 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:00:18.160761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6ea5a519-533a-4cbd-af9d-19319bdeb815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:00:18.244960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 595/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:00:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 22:00:18.539216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f99de-80a8-40ce-aa1c-302f51f1df9e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:18.660722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f99de-80a8-40ce-aa1c-302f51f1df9e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:18.706234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f28c82-6762-4ddf-9523-41d4f588b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:18.706880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f28c82-6762-4ddf-9523-41d4f588b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:18.707182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f28c82-6762-4ddf-9523-41d4f588b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:18.707456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f28c82-6762-4ddf-9523-41d4f588b5f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:18.721583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f28c82-6762-4ddf-9523-41d4f588b5f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:18.723090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f28c82-6762-4ddf-9523-41d4f588b5f6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-51f28c82-6762-4ddf-9523-41d4f588b5f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:18.738789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:18.740010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:18.741057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:18.741057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:18.741057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:18.741057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 608/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:18.748494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5a519-533a-4cbd-af9d-19319bdeb815 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:18.878699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5a519-533a-4cbd-af9d-19319bdeb815 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:18.923330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:18.929799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13944ac4-4574-428b-aaa5-f5da68ff8f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:18.930732 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13944ac4-4574-428b-aaa5-f5da68ff8f3b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:18.931214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13944ac4-4574-428b-aaa5-f5da68ff8f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:18.931647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13944ac4-4574-428b-aaa5-f5da68ff8f3b None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:18.932607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13944ac4-4574-428b-aaa5-f5da68ff8f3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:18.932960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13944ac4-4574-428b-aaa5-f5da68ff8f3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:18.934428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13944ac4-4574-428b-aaa5-f5da68ff8f3b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:18.953266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 596/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:18.960021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f28c82-6762-4ddf-9523-41d4f588b5f6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:19.026921 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:19.084580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f28c82-6762-4ddf-9523-41d4f588b5f6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:19.124377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb00b4-af44-423c-a63a-f20a0badc02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:19.125165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb00b4-af44-423c-a63a-f20a0badc02f None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:19.125539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb00b4-af44-423c-a63a-f20a0badc02f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:19.125814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb00b4-af44-423c-a63a-f20a0badc02f None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:19.126679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb00b4-af44-423c-a63a-f20a0badc02f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:19.127987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb00b4-af44-423c-a63a-f20a0badc02f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:19.150881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 609/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 22 22:00:18 2022] POST /identity/v3/users => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:00:21.642511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d67fe-1e25-435e-835a-e85935c8091d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:21.644823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d67fe-1e25-435e-835a-e85935c8091d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:21.644823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d67fe-1e25-435e-835a-e85935c8091d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:21.644823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 597/1206] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:00:21.651146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf1d7-70a1-4fcc-b1ac-f4a6bd40738b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:21.651761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf1d7-70a1-4fcc-b1ac-f4a6bd40738b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:21.652064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf1d7-70a1-4fcc-b1ac-f4a6bd40738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:21.674662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0eebf1d7-70a1-4fcc-b1ac-f4a6bd40738b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:00:21.675856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0eebf1d7-70a1-4fcc-b1ac-f4a6bd40738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:00:21.760055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 610/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:00:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 22:00:22.038462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d67fe-1e25-435e-835a-e85935c8091d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:22.152041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d67fe-1e25-435e-835a-e85935c8091d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:22.192309 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8799ecc-088d-41e9-a91d-b246451f5629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:22.192991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799ecc-088d-41e9-a91d-b246451f5629 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:22.194340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799ecc-088d-41e9-a91d-b246451f5629 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:22.194340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799ecc-088d-41e9-a91d-b246451f5629 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:22.204884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8799ecc-088d-41e9-a91d-b246451f5629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b8799ecc-088d-41e9-a91d-b246451f5629 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 22:00:22.210103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:22.211134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:22.215127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 598/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 22:00:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:22.218410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebf1d7-70a1-4fcc-b1ac-f4a6bd40738b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:22.266625 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:22.340852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebf1d7-70a1-4fcc-b1ac-f4a6bd40738b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:22.380828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd5a49-98f8-43f9-ac09-c806a5dd1fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:22.381553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5a49-98f8-43f9-ac09-c806a5dd1fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:22.381845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5a49-98f8-43f9-ac09-c806a5dd1fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:22.382155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5a49-98f8-43f9-ac09-c806a5dd1fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:22.382968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd5a49-98f8-43f9-ac09-c806a5dd1fc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:22.383273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd5a49-98f8-43f9-ac09-c806a5dd1fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:22.384808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd5a49-98f8-43f9-ac09-c806a5dd1fc4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:22.394889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 611/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 22:00:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:00:22.401966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8799ecc-088d-41e9-a91d-b246451f5629 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:22.460017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:22.517568 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8799ecc-088d-41e9-a91d-b246451f5629 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:22.556374 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ceebb-26af-4a84-a151-987d0b0ad56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:22.557018 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ceebb-26af-4a84-a151-987d0b0ad56c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:22.557364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ceebb-26af-4a84-a151-987d0b0ad56c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:22.557642 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ceebb-26af-4a84-a151-987d0b0ad56c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:22.568738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ceebb-26af-4a84-a151-987d0b0ad56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:22.570389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ceebb-26af-4a84-a151-987d0b0ad56c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ed0ceebb-26af-4a84-a151-987d0b0ad56c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:22.588030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:22.593950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:22.594957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:22.594957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:22.594957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:22.594957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 599/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 22:00:22.596567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd5a49-98f8-43f9-ac09-c806a5dd1fc4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:22.707749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:22.711624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd5a49-98f8-43f9-ac09-c806a5dd1fc4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:22.754054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483ed6e-0ed6-4dc6-b41b-4b13891b0c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:22.754999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483ed6e-0ed6-4dc6-b41b-4b13891b0c18 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:22.755315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483ed6e-0ed6-4dc6-b41b-4b13891b0c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:22.755616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483ed6e-0ed6-4dc6-b41b-4b13891b0c18 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:22.756295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483ed6e-0ed6-4dc6-b41b-4b13891b0c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:22.756599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483ed6e-0ed6-4dc6-b41b-4b13891b0c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:22.758106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483ed6e-0ed6-4dc6-b41b-4b13891b0c18 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:22.774352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 612/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:22.780791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ceebb-26af-4a84-a151-987d0b0ad56c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:22.898467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ceebb-26af-4a84-a151-987d0b0ad56c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:22.900117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:22.937212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50370331-9efa-4500-9e7a-73b36cdfca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:22.937897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50370331-9efa-4500-9e7a-73b36cdfca5f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:22.939303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50370331-9efa-4500-9e7a-73b36cdfca5f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:22.939303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50370331-9efa-4500-9e7a-73b36cdfca5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:22.946883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50370331-9efa-4500-9e7a-73b36cdfca5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:22.948591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50370331-9efa-4500-9e7a-73b36cdfca5f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-50370331-9efa-4500-9e7a-73b36cdfca5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 22:00:22.960451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:22.961483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:22.962503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:22.962503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:22.962503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 22:00:22.962503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 22:00:22.962503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 22:00:22.962503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 22:00:22.962503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 22:00:22.962503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 22:00:22.962503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:22.962503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:22.965683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 600/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:22.971182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483ed6e-0ed6-4dc6-b41b-4b13891b0c18 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:23.083940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483ed6e-0ed6-4dc6-b41b-4b13891b0c18 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:23.128589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd010c97-ea5a-4ec5-8342-6685e58cc402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:23.129170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd010c97-ea5a-4ec5-8342-6685e58cc402 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:23.129816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd010c97-ea5a-4ec5-8342-6685e58cc402 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:23.129816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd010c97-ea5a-4ec5-8342-6685e58cc402 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:23.130473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd010c97-ea5a-4ec5-8342-6685e58cc402 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:23.130814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd010c97-ea5a-4ec5-8342-6685e58cc402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:23.132216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd010c97-ea5a-4ec5-8342-6685e58cc402 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:23.153393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 613/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 22 22:00:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:00:23.161494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50370331-9efa-4500-9e7a-73b36cdfca5f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:23.280412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50370331-9efa-4500-9e7a-73b36cdfca5f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:23.320435 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b411d-4905-4226-ad94-b7066b7c4bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:23.321122 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b411d-4905-4226-ad94-b7066b7c4bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:23.321515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b411d-4905-4226-ad94-b7066b7c4bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:23.321746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b411d-4905-4226-ad94-b7066b7c4bd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:23.369003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:23.418431 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b411d-4905-4226-ad94-b7066b7c4bd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:23.420090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b411d-4905-4226-ad94-b7066b7c4bd9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:23.535658 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 601/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 22:00:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 22:00:23.541781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd010c97-ea5a-4ec5-8342-6685e58cc402 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:23.562924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:23.655238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd010c97-ea5a-4ec5-8342-6685e58cc402 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:23.699230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3ae37-5f2e-4e60-a070-64cbb3ef7546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:23.702269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3ae37-5f2e-4e60-a070-64cbb3ef7546 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:23.702269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3ae37-5f2e-4e60-a070-64cbb3ef7546 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:23.702269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3ae37-5f2e-4e60-a070-64cbb3ef7546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:23.722103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3ae37-5f2e-4e60-a070-64cbb3ef7546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:23.723765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3ae37-5f2e-4e60-a070-64cbb3ef7546 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b1c3ae37-5f2e-4e60-a070-64cbb3ef7546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:23.741729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:23.743072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:23.744194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:23.744194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:23.744194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:23.750784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 614/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:23.752808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b411d-4905-4226-ad94-b7066b7c4bd9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:23.831646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:23.877796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b411d-4905-4226-ad94-b7066b7c4bd9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:23.914638 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba92686-e90e-4684-854d-245ae77d572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:23.915311 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba92686-e90e-4684-854d-245ae77d572f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:23.915662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba92686-e90e-4684-854d-245ae77d572f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:23.915943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba92686-e90e-4684-854d-245ae77d572f None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:23.916756 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba92686-e90e-4684-854d-245ae77d572f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:23.917179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba92686-e90e-4684-854d-245ae77d572f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:23.918755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba92686-e90e-4684-854d-245ae77d572f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:23.932841 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 602/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:23.938865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3ae37-5f2e-4e60-a070-64cbb3ef7546 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:24.009583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:24.042934 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3ae37-5f2e-4e60-a070-64cbb3ef7546 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:24.075438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f05816-0bde-4157-a036-68fa820efce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:24.076064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f05816-0bde-4157-a036-68fa820efce4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:24.076334 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f05816-0bde-4157-a036-68fa820efce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:24.076597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f05816-0bde-4157-a036-68fa820efce4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:24.083957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f05816-0bde-4157-a036-68fa820efce4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:24.085499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f05816-0bde-4157-a036-68fa820efce4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e6f05816-0bde-4157-a036-68fa820efce4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 22:00:24.099252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:24.100406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:24.101292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 22:00:24.101292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 22:00:24.101292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 22:00:24.101292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 22:00:24.101292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 22:00:24.101292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 22:00:24.101292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:24.101292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:24.101292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 615/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 22:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:24.107309 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba92686-e90e-4684-854d-245ae77d572f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:24.222099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba92686-e90e-4684-854d-245ae77d572f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:24.247311 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:24.260058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2345a-7c85-4b9b-a905-265eeb1f3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:24.260666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2345a-7c85-4b9b-a905-265eeb1f3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:24.261035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2345a-7c85-4b9b-a905-265eeb1f3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:24.261221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2345a-7c85-4b9b-a905-265eeb1f3dd2 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:24.261930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2345a-7c85-4b9b-a905-265eeb1f3dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:24.262232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2345a-7c85-4b9b-a905-265eeb1f3dd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:24.263660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2345a-7c85-4b9b-a905-265eeb1f3dd2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:24.275901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 603/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 22:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:24.282660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f05816-0bde-4157-a036-68fa820efce4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:24.394584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f05816-0bde-4157-a036-68fa820efce4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:24.424036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:24.430785 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827695a-1b71-483b-ae95-e2f81aa96042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:24.431470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827695a-1b71-483b-ae95-e2f81aa96042 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:24.431775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827695a-1b71-483b-ae95-e2f81aa96042 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:24.432046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827695a-1b71-483b-ae95-e2f81aa96042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:24.433419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827695a-1b71-483b-ae95-e2f81aa96042 None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=2c7f2566918b4c719486d1ce285724e2) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:24.433733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827695a-1b71-483b-ae95-e2f81aa96042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:24.435293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827695a-1b71-483b-ae95-e2f81aa96042 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:24.441194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 616/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 22:00:24 2022] GET /identity/v3/role_assignments?user.id=2c7f2566918b4c719486d1ce285724e2&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:26.724966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3bdb9-2ccc-4213-8a04-64488fed98e3 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:26.725446 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3bdb9-2ccc-4213-8a04-64488fed98e3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:26.725538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3bdb9-2ccc-4213-8a04-64488fed98e3 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:26.726896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 604/1220] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:00:26.732600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8212c2-710b-4c7a-8c80-dbd804e245f9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:26.733055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8212c2-710b-4c7a-8c80-dbd804e245f9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:26.733219 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8212c2-710b-4c7a-8c80-dbd804e245f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:26.753781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-af8212c2-710b-4c7a-8c80-dbd804e245f9 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:00:26.755159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-af8212c2-710b-4c7a-8c80-dbd804e245f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:00:26.829399 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 617/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:00:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 22:00:27.098245 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3bdb9-2ccc-4213-8a04-64488fed98e3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:27.205218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3bdb9-2ccc-4213-8a04-64488fed98e3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:27.247383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120acced-e2c7-40c8-a4d2-c1e8ded66042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:27.248019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120acced-e2c7-40c8-a4d2-c1e8ded66042 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:27.248297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120acced-e2c7-40c8-a4d2-c1e8ded66042 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:27.248566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120acced-e2c7-40c8-a4d2-c1e8ded66042 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:27.258848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120acced-e2c7-40c8-a4d2-c1e8ded66042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-120acced-e2c7-40c8-a4d2-c1e8ded66042 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 22:00:27.263731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:27.264852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:27.265949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 605/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 22:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:27.273574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8212c2-710b-4c7a-8c80-dbd804e245f9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:27.381737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8212c2-710b-4c7a-8c80-dbd804e245f9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:27.407634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:27.420656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4db1d-e6a4-4d58-918a-f49124f52177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:27.421416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4db1d-e6a4-4d58-918a-f49124f52177 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:27.421794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4db1d-e6a4-4d58-918a-f49124f52177 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:27.422218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4db1d-e6a4-4d58-918a-f49124f52177 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:27.422961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4db1d-e6a4-4d58-918a-f49124f52177 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:27.423337 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4db1d-e6a4-4d58-918a-f49124f52177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:27.424799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4db1d-e6a4-4d58-918a-f49124f52177 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:27.433010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 618/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 22:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:27.439200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120acced-e2c7-40c8-a4d2-c1e8ded66042 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:27.483686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:27.554759 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120acced-e2c7-40c8-a4d2-c1e8ded66042 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:27.592439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c8f31-8382-49d2-a75b-6a213679d789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:27.593269 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8f31-8382-49d2-a75b-6a213679d789 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:27.593617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8f31-8382-49d2-a75b-6a213679d789 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:27.594188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8f31-8382-49d2-a75b-6a213679d789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:27.607778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c8f31-8382-49d2-a75b-6a213679d789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:27.609340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c8f31-8382-49d2-a75b-6a213679d789 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-789c8f31-8382-49d2-a75b-6a213679d789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:27.625140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:27.631294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:27.632526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:27.632526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:27.632526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:27.632526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 606/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:27.633949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4db1d-e6a4-4d58-918a-f49124f52177 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:27.745604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4db1d-e6a4-4d58-918a-f49124f52177 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:27.780710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2063ae-6911-4be8-8834-30be5c83f35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:27.782590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2063ae-6911-4be8-8834-30be5c83f35e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:27.782590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2063ae-6911-4be8-8834-30be5c83f35e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:27.782590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2063ae-6911-4be8-8834-30be5c83f35e None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:27.782590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2063ae-6911-4be8-8834-30be5c83f35e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:27.782940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2063ae-6911-4be8-8834-30be5c83f35e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:27.784349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2063ae-6911-4be8-8834-30be5c83f35e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:27.798321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 619/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:27.806223 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c8f31-8382-49d2-a75b-6a213679d789 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:27.918199 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:27.928325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c8f31-8382-49d2-a75b-6a213679d789 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:27.965604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffb099-03f1-4c1c-b60e-260802cd1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:27.966281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffb099-03f1-4c1c-b60e-260802cd1d94 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:27.966542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffb099-03f1-4c1c-b60e-260802cd1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:27.966807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffb099-03f1-4c1c-b60e-260802cd1d94 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:27.974780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffb099-03f1-4c1c-b60e-260802cd1d94 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:27.976323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffb099-03f1-4c1c-b60e-260802cd1d94 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b7ffb099-03f1-4c1c-b60e-260802cd1d94 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 22:00:27.988460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:27.989720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:27.990787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:27.990787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:27.990787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 22:00:27.990787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 22:00:27.990787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 22:00:27.990787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 22:00:27.990787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 22:00:27.990787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 22:00:27.990787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:27.990787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:27.990787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 607/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:27.996055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2063ae-6911-4be8-8834-30be5c83f35e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:28.051704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:28.109985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2063ae-6911-4be8-8834-30be5c83f35e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:28.157170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc6bd0-60e1-4596-8471-1fb1d600b698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:28.157804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc6bd0-60e1-4596-8471-1fb1d600b698 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:28.158107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc6bd0-60e1-4596-8471-1fb1d600b698 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:28.158371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc6bd0-60e1-4596-8471-1fb1d600b698 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:28.159122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc6bd0-60e1-4596-8471-1fb1d600b698 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:28.159466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc6bd0-60e1-4596-8471-1fb1d600b698 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:28.161859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc6bd0-60e1-4596-8471-1fb1d600b698 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:28.184130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 620/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 22 22:00:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:28.190314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffb099-03f1-4c1c-b60e-260802cd1d94 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:28.298045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffb099-03f1-4c1c-b60e-260802cd1d94 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:28.333621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd712-5295-4487-baf1-cd717288d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:28.334286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd712-5295-4487-baf1-cd717288d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:28.334563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd712-5295-4487-baf1-cd717288d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:28.334831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd712-5295-4487-baf1-cd717288d6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:28.346354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd712-5295-4487-baf1-cd717288d6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:28.347936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd712-5295-4487-baf1-cd717288d6b3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-45edd712-5295-4487-baf1-cd717288d6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:28.365857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:28.371956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:28.373092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:28.373092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:28.373092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:28.373092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 608/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:28.373392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc6bd0-60e1-4596-8471-1fb1d600b698 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:28.480063 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc6bd0-60e1-4596-8471-1fb1d600b698 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:28.482471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:28.516720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826322a-aa40-4379-8637-41cb220a2bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:28.517332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826322a-aa40-4379-8637-41cb220a2bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:28.517649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826322a-aa40-4379-8637-41cb220a2bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:28.517955 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826322a-aa40-4379-8637-41cb220a2bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:28.518606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826322a-aa40-4379-8637-41cb220a2bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:28.518934 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826322a-aa40-4379-8637-41cb220a2bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:28.520335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826322a-aa40-4379-8637-41cb220a2bf3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:28.533132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 621/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:28.539031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd712-5295-4487-baf1-cd717288d6b3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:28.550487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:28.652041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd712-5295-4487-baf1-cd717288d6b3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:28.688285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310e700-e123-41dc-995f-1c2573605668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:28.688912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310e700-e123-41dc-995f-1c2573605668 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:28.689185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310e700-e123-41dc-995f-1c2573605668 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:28.689450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310e700-e123-41dc-995f-1c2573605668 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:28.698299 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310e700-e123-41dc-995f-1c2573605668 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:28.699915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310e700-e123-41dc-995f-1c2573605668 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d310e700-e123-41dc-995f-1c2573605668 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 22:00:28.712480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:28.715923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:28.717423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 22:00:28.717423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 22:00:28.717423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 22:00:28.717423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 22:00:28.717423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 22:00:28.717423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 22:00:28.717423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:28.717423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:28.717423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 609/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 22:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:28.720863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826322a-aa40-4379-8637-41cb220a2bf3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:28.830207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826322a-aa40-4379-8637-41cb220a2bf3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:28.866449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6dde3-bb1f-4ca4-b38c-ad8491a66853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:28.867097 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6dde3-bb1f-4ca4-b38c-ad8491a66853 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:28.867432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6dde3-bb1f-4ca4-b38c-ad8491a66853 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:28.867808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6dde3-bb1f-4ca4-b38c-ad8491a66853 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:28.868500 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6dde3-bb1f-4ca4-b38c-ad8491a66853 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:28.868854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6dde3-bb1f-4ca4-b38c-ad8491a66853 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:28.870723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6dde3-bb1f-4ca4-b38c-ad8491a66853 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:28.883894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 622/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 22:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:00:28.890897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310e700-e123-41dc-995f-1c2573605668 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:28.969209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:29.012991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310e700-e123-41dc-995f-1c2573605668 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:29.051997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0c3b5-216e-4053-ad9d-26157ab5e2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:29.051997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c3b5-216e-4053-ad9d-26157ab5e2c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:29.051997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c3b5-216e-4053-ad9d-26157ab5e2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:29.053729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c3b5-216e-4053-ad9d-26157ab5e2c9 None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/2c7f2566918b4c719486d1ce285724e2/roles/82675c8ebc84464cbf87641d4ced0f72` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:29.069709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0c3b5-216e-4053-ad9d-26157ab5e2c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=2c7f2566918b4c719486d1ce285724e2, role_id=82675c8ebc84464cbf87641d4ced0f72)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:29.071438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0c3b5-216e-4053-ad9d-26157ab5e2c9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:29.086362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 610/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 22:00:28 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/2c7f2566918b4c719486d1ce285724e2/roles/82675c8ebc84464cbf87641d4ced0f72 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:00:31.275059 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8a7e-ac2d-480d-9e74-0befbc8e29cb None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:31.275672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8a7e-ac2d-480d-9e74-0befbc8e29cb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:31.275672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8a7e-ac2d-480d-9e74-0befbc8e29cb None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:31.276941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 623/1233] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:00:31.283080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ccf2c-def4-4519-b19a-d8abb8450d8c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:31.283866 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ccf2c-def4-4519-b19a-d8abb8450d8c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:31.284003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ccf2c-def4-4519-b19a-d8abb8450d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:31.303836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-438ccf2c-def4-4519-b19a-d8abb8450d8c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:00:31.305032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-438ccf2c-def4-4519-b19a-d8abb8450d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:00:31.383148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 611/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:00:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 22:00:31.650971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a8a7e-ac2d-480d-9e74-0befbc8e29cb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:31.679195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:31.771136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a8a7e-ac2d-480d-9e74-0befbc8e29cb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:31.806987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946520a8-f33c-4ee7-b504-331b597d10ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:31.807882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946520a8-f33c-4ee7-b504-331b597d10ec None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:31.808151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946520a8-f33c-4ee7-b504-331b597d10ec None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:31.808457 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946520a8-f33c-4ee7-b504-331b597d10ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:31.819382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946520a8-f33c-4ee7-b504-331b597d10ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-946520a8-f33c-4ee7-b504-331b597d10ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 22:00:31.824458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:31.825597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:31.826495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 624/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 22 22:00:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:31.832043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ccf2c-def4-4519-b19a-d8abb8450d8c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:31.878469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:31.935132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ccf2c-def4-4519-b19a-d8abb8450d8c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:31.970400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee468-e1c4-4cbf-a040-0ce8ceda32b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:31.971064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee468-e1c4-4cbf-a040-0ce8ceda32b9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:31.971342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee468-e1c4-4cbf-a040-0ce8ceda32b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:31.971654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee468-e1c4-4cbf-a040-0ce8ceda32b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:31.972318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eee468-e1c4-4cbf-a040-0ce8ceda32b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:31.972620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eee468-e1c4-4cbf-a040-0ce8ceda32b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:31.974044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eee468-e1c4-4cbf-a040-0ce8ceda32b9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:31.982777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 612/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 22 22:00:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:00:31.988809 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946520a8-f33c-4ee7-b504-331b597d10ec None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:32.083488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:32.101997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946520a8-f33c-4ee7-b504-331b597d10ec None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:32.138296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c08236-4de7-4bd6-aeca-3e5ca29a5f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:32.138983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08236-4de7-4bd6-aeca-3e5ca29a5f2d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:32.139255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08236-4de7-4bd6-aeca-3e5ca29a5f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:32.139522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08236-4de7-4bd6-aeca-3e5ca29a5f2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:32.150506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c08236-4de7-4bd6-aeca-3e5ca29a5f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:32.152243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c08236-4de7-4bd6-aeca-3e5ca29a5f2d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-77c08236-4de7-4bd6-aeca-3e5ca29a5f2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:32.168073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:32.169099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:32.170057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:32.170057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:32.170057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:32.170057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 625/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:32.175890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee468-e1c4-4cbf-a040-0ce8ceda32b9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:32.284920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee468-e1c4-4cbf-a040-0ce8ceda32b9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:32.294703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:32.322918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66208d-978b-4a36-a33f-7b92023e617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:32.323685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66208d-978b-4a36-a33f-7b92023e617d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:32.323962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66208d-978b-4a36-a33f-7b92023e617d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:32.324224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66208d-978b-4a36-a33f-7b92023e617d None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:32.324864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66208d-978b-4a36-a33f-7b92023e617d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:32.325161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66208d-978b-4a36-a33f-7b92023e617d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:32.326652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66208d-978b-4a36-a33f-7b92023e617d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:32.339526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 613/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:32.346141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c08236-4de7-4bd6-aeca-3e5ca29a5f2d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:32.459585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c08236-4de7-4bd6-aeca-3e5ca29a5f2d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:32.494547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb55b3-1ac1-45ae-b8c2-ab41327ecc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:32.495441 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb55b3-1ac1-45ae-b8c2-ab41327ecc91 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:32.495721 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb55b3-1ac1-45ae-b8c2-ab41327ecc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:32.495991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb55b3-1ac1-45ae-b8c2-ab41327ecc91 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:32.498907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:32.505158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb55b3-1ac1-45ae-b8c2-ab41327ecc91 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:32.506733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb55b3-1ac1-45ae-b8c2-ab41327ecc91 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-9bdb55b3-1ac1-45ae-b8c2-ab41327ecc91 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 22:00:32.520355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:32.521488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:32.522727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:32.522727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:32.522727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 22:00:32.522727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 22:00:32.522727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 22:00:32.522727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 22:00:32.522727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 22:00:32.522727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 22:00:32.522727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:32.522727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:32.522727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 626/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:32.528405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66208d-978b-4a36-a33f-7b92023e617d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:32.638867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66208d-978b-4a36-a33f-7b92023e617d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:32.675815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda45b1d-7380-42a9-ad95-736087560293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:32.676449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45b1d-7380-42a9-ad95-736087560293 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:32.676702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45b1d-7380-42a9-ad95-736087560293 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:32.676959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45b1d-7380-42a9-ad95-736087560293 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:32.677712 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda45b1d-7380-42a9-ad95-736087560293 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:32.678134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda45b1d-7380-42a9-ad95-736087560293 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:32.679843 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda45b1d-7380-42a9-ad95-736087560293 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:32.699444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 614/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 22 22:00:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:32.705574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb55b3-1ac1-45ae-b8c2-ab41327ecc91 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:32.816840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb55b3-1ac1-45ae-b8c2-ab41327ecc91 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:32.852857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08422a7-3dac-4b9a-ab9e-021dda07396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:32.853509 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08422a7-3dac-4b9a-ab9e-021dda07396c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:32.853777 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08422a7-3dac-4b9a-ab9e-021dda07396c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:32.854331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08422a7-3dac-4b9a-ab9e-021dda07396c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:32.922375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:32.929761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08422a7-3dac-4b9a-ab9e-021dda07396c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:32.931647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08422a7-3dac-4b9a-ab9e-021dda07396c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:33.039645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 627/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 22:00:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 22:00:33.045786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda45b1d-7380-42a9-ad95-736087560293 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:33.075174 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:33.153700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda45b1d-7380-42a9-ad95-736087560293 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:33.191629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3887991-75ed-4e2c-9f52-28877a31a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:33.192259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3887991-75ed-4e2c-9f52-28877a31a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:33.192533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3887991-75ed-4e2c-9f52-28877a31a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:33.192809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3887991-75ed-4e2c-9f52-28877a31a7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:33.203277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3887991-75ed-4e2c-9f52-28877a31a7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:33.204859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3887991-75ed-4e2c-9f52-28877a31a7b6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c3887991-75ed-4e2c-9f52-28877a31a7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:33.220969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:33.222290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:33.223505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:33.223505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:33.223505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:33.223505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 615/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:33.228517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08422a7-3dac-4b9a-ab9e-021dda07396c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:33.328559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:33.335218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08422a7-3dac-4b9a-ab9e-021dda07396c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:33.374144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147446e2-1bfd-444c-87b9-93e3111b4d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:33.374960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147446e2-1bfd-444c-87b9-93e3111b4d79 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:33.375093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147446e2-1bfd-444c-87b9-93e3111b4d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:33.375354 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147446e2-1bfd-444c-87b9-93e3111b4d79 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:33.376002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147446e2-1bfd-444c-87b9-93e3111b4d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:33.376302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147446e2-1bfd-444c-87b9-93e3111b4d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:33.377697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147446e2-1bfd-444c-87b9-93e3111b4d79 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:33.389898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 628/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:33.395831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3887991-75ed-4e2c-9f52-28877a31a7b6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:33.481689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:33.503880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3887991-75ed-4e2c-9f52-28877a31a7b6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:33.543745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94900c-29b4-4408-8ce3-828b6ad3e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:33.544567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94900c-29b4-4408-8ce3-828b6ad3e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:33.544936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94900c-29b4-4408-8ce3-828b6ad3e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:33.545203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94900c-29b4-4408-8ce3-828b6ad3e4f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:33.552485 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94900c-29b4-4408-8ce3-828b6ad3e4f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:33.553965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94900c-29b4-4408-8ce3-828b6ad3e4f4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-1c94900c-29b4-4408-8ce3-828b6ad3e4f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 22:00:33.565243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:33.566384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:33.567476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 22:00:33.567476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 22:00:33.567476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 22:00:33.567476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 22:00:33.567476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 22:00:33.567476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 22:00:33.567476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:33.567476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:33.571450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 616/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 22:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:33.572407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147446e2-1bfd-444c-87b9-93e3111b4d79 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:33.677930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147446e2-1bfd-444c-87b9-93e3111b4d79 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:33.713294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01011b9b-dca0-4a68-bb25-21472b255455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:33.714309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011b9b-dca0-4a68-bb25-21472b255455 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:33.714605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011b9b-dca0-4a68-bb25-21472b255455 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:33.714850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011b9b-dca0-4a68-bb25-21472b255455 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:33.715584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01011b9b-dca0-4a68-bb25-21472b255455 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:33.715843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01011b9b-dca0-4a68-bb25-21472b255455 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:33.717284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01011b9b-dca0-4a68-bb25-21472b255455 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:33.733292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 629/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 22:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:00:33.739547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94900c-29b4-4408-8ce3-828b6ad3e4f4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:33.854502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94900c-29b4-4408-8ce3-828b6ad3e4f4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:33.890226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680184d-6cbd-491a-a26f-718d948f0e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:33.890946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680184d-6cbd-491a-a26f-718d948f0e2d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:33.891288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680184d-6cbd-491a-a26f-718d948f0e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:33.891590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680184d-6cbd-491a-a26f-718d948f0e2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:33.892358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680184d-6cbd-491a-a26f-718d948f0e2d None admin] RBAC: Adding query filter params (role.id=82675c8ebc84464cbf87641d4ced0f72, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=2c7f2566918b4c719486d1ce285724e2) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:33.892662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680184d-6cbd-491a-a26f-718d948f0e2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:33.894185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680184d-6cbd-491a-a26f-718d948f0e2d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:33.900550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 617/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 22:00:33 2022] GET /identity/v3/role_assignments?user.id=2c7f2566918b4c719486d1ce285724e2&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=82675c8ebc84464cbf87641d4ced0f72 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:36.085380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75fa1-3246-4c9e-8fbd-d8d3f1a7927f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:36.085964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75fa1-3246-4c9e-8fbd-d8d3f1a7927f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:36.085964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75fa1-3246-4c9e-8fbd-d8d3f1a7927f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:36.087318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 630/1247] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:00:36.096533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f923d2-07b4-4995-8c0c-8dd10490b7ee None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:36.097042 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f923d2-07b4-4995-8c0c-8dd10490b7ee None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:36.097042 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f923d2-07b4-4995-8c0c-8dd10490b7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:36.110700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:36.127535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-93f923d2-07b4-4995-8c0c-8dd10490b7ee None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:00:36.128781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-93f923d2-07b4-4995-8c0c-8dd10490b7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:00:36.206656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 618/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:00:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 22:00:36.512794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f75fa1-3246-4c9e-8fbd-d8d3f1a7927f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:36.533871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:36.627181 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f75fa1-3246-4c9e-8fbd-d8d3f1a7927f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:36.664532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc4fe6-75c3-445f-98f1-330881b60d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:36.665215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc4fe6-75c3-445f-98f1-330881b60d30 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:36.665493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc4fe6-75c3-445f-98f1-330881b60d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:36.665789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc4fe6-75c3-445f-98f1-330881b60d30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:36.677009 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc4fe6-75c3-445f-98f1-330881b60d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-83bc4fe6-75c3-445f-98f1-330881b60d30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 22:00:36.682012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:36.683437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:36.684769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 631/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 22:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:36.689886 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f923d2-07b4-4995-8c0c-8dd10490b7ee None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:36.799192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f923d2-07b4-4995-8c0c-8dd10490b7ee None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:36.829984 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:36.835045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0419fb-18df-4c38-890a-dfb4539a0904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:36.835648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0419fb-18df-4c38-890a-dfb4539a0904 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:36.835959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0419fb-18df-4c38-890a-dfb4539a0904 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:36.836181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0419fb-18df-4c38-890a-dfb4539a0904 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:36.836860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0419fb-18df-4c38-890a-dfb4539a0904 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:36.837142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0419fb-18df-4c38-890a-dfb4539a0904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:36.839111 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0419fb-18df-4c38-890a-dfb4539a0904 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:36.847911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 619/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 22:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:36.854647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc4fe6-75c3-445f-98f1-330881b60d30 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:36.941903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:36.973172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc4fe6-75c3-445f-98f1-330881b60d30 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:37.010238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477df218-3e48-45f4-a776-bac362f83b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:37.010969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477df218-3e48-45f4-a776-bac362f83b49 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:37.011291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477df218-3e48-45f4-a776-bac362f83b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:37.011539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477df218-3e48-45f4-a776-bac362f83b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:37.022569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477df218-3e48-45f4-a776-bac362f83b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:37.024021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477df218-3e48-45f4-a776-bac362f83b49 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-477df218-3e48-45f4-a776-bac362f83b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:37.039397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:37.045936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:37.046872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:37.046872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:37.046872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:37.046872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 632/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:37.047113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0419fb-18df-4c38-890a-dfb4539a0904 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:37.156174 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0419fb-18df-4c38-890a-dfb4539a0904 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:37.198560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2d3c8-1a0b-4b9f-a251-39ea2998c95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:37.199343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2d3c8-1a0b-4b9f-a251-39ea2998c95e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:37.199620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2d3c8-1a0b-4b9f-a251-39ea2998c95e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:37.199948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2d3c8-1a0b-4b9f-a251-39ea2998c95e None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:37.200632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2d3c8-1a0b-4b9f-a251-39ea2998c95e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:37.200936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2d3c8-1a0b-4b9f-a251-39ea2998c95e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:37.202436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2d3c8-1a0b-4b9f-a251-39ea2998c95e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:37.215859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 620/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:37.222439 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477df218-3e48-45f4-a776-bac362f83b49 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:37.330731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477df218-3e48-45f4-a776-bac362f83b49 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:37.358135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:37.366615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937b6f-dadf-433f-8d22-cd99b296415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:37.367248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937b6f-dadf-433f-8d22-cd99b296415d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:37.367518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937b6f-dadf-433f-8d22-cd99b296415d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:37.367975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937b6f-dadf-433f-8d22-cd99b296415d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:37.376744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937b6f-dadf-433f-8d22-cd99b296415d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:37.378453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937b6f-dadf-433f-8d22-cd99b296415d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ab937b6f-dadf-433f-8d22-cd99b296415d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 22:00:37.391531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:37.393054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:37.394463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:37.394463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:37.394463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 22:00:37.394463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 22:00:37.394463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 22:00:37.394463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 22:00:37.394463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 22:00:37.394463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 22:00:37.394463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:37.394463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:37.394463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 633/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:37.399522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2d3c8-1a0b-4b9f-a251-39ea2998c95e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:37.463050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:37.508780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2d3c8-1a0b-4b9f-a251-39ea2998c95e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:37.547113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd95540-8cd1-418b-a9cf-2beaa12fef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:37.547716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd95540-8cd1-418b-a9cf-2beaa12fef99 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:37.547984 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd95540-8cd1-418b-a9cf-2beaa12fef99 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:37.548247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd95540-8cd1-418b-a9cf-2beaa12fef99 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:37.548973 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd95540-8cd1-418b-a9cf-2beaa12fef99 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:37.549265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd95540-8cd1-418b-a9cf-2beaa12fef99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:37.550731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd95540-8cd1-418b-a9cf-2beaa12fef99 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:37.569175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 621/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 22 22:00:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:37.575464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937b6f-dadf-433f-8d22-cd99b296415d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:37.688446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937b6f-dadf-433f-8d22-cd99b296415d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:37.734231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0016e-0a37-443d-ab95-d52d63719c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:37.734852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0016e-0a37-443d-ab95-d52d63719c29 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:37.735125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0016e-0a37-443d-ab95-d52d63719c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:37.735387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0016e-0a37-443d-ab95-d52d63719c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:37.792675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:37.805584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0016e-0a37-443d-ab95-d52d63719c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:37.807093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0016e-0a37-443d-ab95-d52d63719c29 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:37.921513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 634/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 22:00:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 22:00:37.927721 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd95540-8cd1-418b-a9cf-2beaa12fef99 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:38.038583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd95540-8cd1-418b-a9cf-2beaa12fef99 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:38.052671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:38.078136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bfb82-7d49-4725-9e3c-70ed4d94ccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:38.078907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bfb82-7d49-4725-9e3c-70ed4d94ccac None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:38.079251 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bfb82-7d49-4725-9e3c-70ed4d94ccac None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:38.079591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bfb82-7d49-4725-9e3c-70ed4d94ccac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:38.092072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bfb82-7d49-4725-9e3c-70ed4d94ccac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:38.093536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bfb82-7d49-4725-9e3c-70ed4d94ccac None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ae4bfb82-7d49-4725-9e3c-70ed4d94ccac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:38.108327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:38.109623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:38.110771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:38.110771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:38.110771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:38.110771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 622/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 22:00:38.115830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0016e-0a37-443d-ab95-d52d63719c29 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:38.222344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:38.232909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0016e-0a37-443d-ab95-d52d63719c29 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:38.270550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd50ec-4668-449a-96ec-bdeb65c28e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:38.271163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd50ec-4668-449a-96ec-bdeb65c28e8c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:38.271428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd50ec-4668-449a-96ec-bdeb65c28e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:38.271774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd50ec-4668-449a-96ec-bdeb65c28e8c None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:38.272429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd50ec-4668-449a-96ec-bdeb65c28e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:38.272806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd50ec-4668-449a-96ec-bdeb65c28e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:38.274340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd50ec-4668-449a-96ec-bdeb65c28e8c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:38.286480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 635/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:38.293227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bfb82-7d49-4725-9e3c-70ed4d94ccac None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:38.406083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bfb82-7d49-4725-9e3c-70ed4d94ccac None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:38.442209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927aaa3-6aed-4741-93c0-5b3d666c4e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:38.443006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927aaa3-6aed-4741-93c0-5b3d666c4e46 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:38.443372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927aaa3-6aed-4741-93c0-5b3d666c4e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:38.443739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927aaa3-6aed-4741-93c0-5b3d666c4e46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:38.451127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927aaa3-6aed-4741-93c0-5b3d666c4e46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:38.452569 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927aaa3-6aed-4741-93c0-5b3d666c4e46 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2927aaa3-6aed-4741-93c0-5b3d666c4e46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 22:00:38.465318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:38.466590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:38.467706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 22:00:38.467706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 22:00:38.467706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 22:00:38.467706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 22:00:38.467706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 22:00:38.467706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 22:00:38.467706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:38.467706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:38.471416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 623/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 22:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:38.472574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd50ec-4668-449a-96ec-bdeb65c28e8c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:38.587084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd50ec-4668-449a-96ec-bdeb65c28e8c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:38.624691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d1cd8-5961-4187-9eab-e3b7b778c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:38.625305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d1cd8-5961-4187-9eab-e3b7b778c881 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:38.625637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d1cd8-5961-4187-9eab-e3b7b778c881 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:38.625946 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d1cd8-5961-4187-9eab-e3b7b778c881 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:38.626713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d1cd8-5961-4187-9eab-e3b7b778c881 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:38.627123 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d1cd8-5961-4187-9eab-e3b7b778c881 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:38.628751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d1cd8-5961-4187-9eab-e3b7b778c881 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:38.642422 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 636/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 22:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:38.648863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927aaa3-6aed-4741-93c0-5b3d666c4e46 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:38.677599 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:38.765729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927aaa3-6aed-4741-93c0-5b3d666c4e46 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:38.802931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba08af-c951-41bb-a29a-334b620b1b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:38.803625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba08af-c951-41bb-a29a-334b620b1b2e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:38.803952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba08af-c951-41bb-a29a-334b620b1b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:38.804221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba08af-c951-41bb-a29a-334b620b1b2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:38.805056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba08af-c951-41bb-a29a-334b620b1b2e None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=2c7f2566918b4c719486d1ce285724e2) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:38.805354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba08af-c951-41bb-a29a-334b620b1b2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:38.806905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba08af-c951-41bb-a29a-334b620b1b2e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:38.813244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 624/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 22:00:38 2022] GET /identity/v3/role_assignments?user.id=2c7f2566918b4c719486d1ce285724e2&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:00:40.949880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2ce6-36b0-410c-9777-af5079442d3d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:40.950440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2ce6-36b0-410c-9777-af5079442d3d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:40.950440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2ce6-36b0-410c-9777-af5079442d3d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:40.951799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 637/1261] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:00:40.958069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389aa8-1d48-432a-b66f-9930320b426a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:40.958846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389aa8-1d48-432a-b66f-9930320b426a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:40.958994 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389aa8-1d48-432a-b66f-9930320b426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:40.981294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4d389aa8-1d48-432a-b66f-9930320b426a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:00:40.982503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4d389aa8-1d48-432a-b66f-9930320b426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:00:41.066825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 625/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:00:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 22:00:41.334326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d2ce6-36b0-410c-9777-af5079442d3d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:41.349498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:41.470019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d2ce6-36b0-410c-9777-af5079442d3d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:41.506559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f014607-5901-4468-b268-0a99dd228144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:41.507195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014607-5901-4468-b268-0a99dd228144 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:41.507469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014607-5901-4468-b268-0a99dd228144 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:41.507736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014607-5901-4468-b268-0a99dd228144 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:41.518712 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f014607-5901-4468-b268-0a99dd228144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4f014607-5901-4468-b268-0a99dd228144 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 22:00:41.523521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:41.524699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:41.525890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 638/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 22:00:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:41.531544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d389aa8-1d48-432a-b66f-9930320b426a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:41.551693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:41.636018 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d389aa8-1d48-432a-b66f-9930320b426a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:41.671009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96d0b0-b1ad-44ac-a97b-700b17535417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:41.671618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d0b0-b1ad-44ac-a97b-700b17535417 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:41.671881 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d0b0-b1ad-44ac-a97b-700b17535417 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:41.672143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d0b0-b1ad-44ac-a97b-700b17535417 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:41.672800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d0b0-b1ad-44ac-a97b-700b17535417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:41.673075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d0b0-b1ad-44ac-a97b-700b17535417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:41.674509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d0b0-b1ad-44ac-a97b-700b17535417 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:41.682683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 626/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 22:00:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:41.689415 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f014607-5901-4468-b268-0a99dd228144 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:41.776403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:41.819694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f014607-5901-4468-b268-0a99dd228144 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:41.855850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172518d-5e20-428e-995e-04ccd5c5860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:41.856480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172518d-5e20-428e-995e-04ccd5c5860f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:41.856757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172518d-5e20-428e-995e-04ccd5c5860f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:41.857022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172518d-5e20-428e-995e-04ccd5c5860f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:41.867372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172518d-5e20-428e-995e-04ccd5c5860f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:41.868816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172518d-5e20-428e-995e-04ccd5c5860f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5172518d-5e20-428e-995e-04ccd5c5860f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:41.884429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:41.885569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:41.886864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:41.886864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:41.886864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:41.886864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 639/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:41.893615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96d0b0-b1ad-44ac-a97b-700b17535417 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:41.980208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:42.000943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96d0b0-b1ad-44ac-a97b-700b17535417 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:42.036686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaf731-ee8b-497c-a7ed-4f503b278450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:42.037281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaf731-ee8b-497c-a7ed-4f503b278450 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:42.037557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaf731-ee8b-497c-a7ed-4f503b278450 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:42.037826 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaf731-ee8b-497c-a7ed-4f503b278450 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:42.038497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaf731-ee8b-497c-a7ed-4f503b278450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:42.038794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaf731-ee8b-497c-a7ed-4f503b278450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:42.040162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaf731-ee8b-497c-a7ed-4f503b278450 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:42.051984 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 627/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:42.060947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172518d-5e20-428e-995e-04ccd5c5860f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:42.173517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172518d-5e20-428e-995e-04ccd5c5860f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:42.192842 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:42.207191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531973-12e3-465b-95c8-b980e10ba83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:42.207828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531973-12e3-465b-95c8-b980e10ba83d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:42.208098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531973-12e3-465b-95c8-b980e10ba83d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:42.208363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531973-12e3-465b-95c8-b980e10ba83d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:42.216106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78531973-12e3-465b-95c8-b980e10ba83d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:42.217534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78531973-12e3-465b-95c8-b980e10ba83d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-78531973-12e3-465b-95c8-b980e10ba83d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 22:00:42.228400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:42.229430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:42.230515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:42.230515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:42.230515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 22:00:42.230515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 22:00:42.230515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 22:00:42.230515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 22:00:42.230515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 22:00:42.230515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 22:00:42.230515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:42.230515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:42.230515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 640/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:42.237396 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaf731-ee8b-497c-a7ed-4f503b278450 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:42.343017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaf731-ee8b-497c-a7ed-4f503b278450 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:42.384483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7a086-0b95-4afd-b11d-43ed6c268066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:42.385088 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a086-0b95-4afd-b11d-43ed6c268066 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:42.385541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a086-0b95-4afd-b11d-43ed6c268066 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:42.385672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a086-0b95-4afd-b11d-43ed6c268066 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:42.386454 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7a086-0b95-4afd-b11d-43ed6c268066 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:42.386747 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7a086-0b95-4afd-b11d-43ed6c268066 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:42.388170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7a086-0b95-4afd-b11d-43ed6c268066 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:42.399639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:42.408513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 628/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 22 22:00:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:42.414600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531973-12e3-465b-95c8-b980e10ba83d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:42.521853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531973-12e3-465b-95c8-b980e10ba83d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:42.560802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d97d0-add8-4385-a8d1-7ee10844fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:42.561414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d97d0-add8-4385-a8d1-7ee10844fe47 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:42.561689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d97d0-add8-4385-a8d1-7ee10844fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:42.561988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d97d0-add8-4385-a8d1-7ee10844fe47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:42.572382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d97d0-add8-4385-a8d1-7ee10844fe47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:42.574018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d97d0-add8-4385-a8d1-7ee10844fe47 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ef3d97d0-add8-4385-a8d1-7ee10844fe47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:42.593092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:42.594200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:42.595181 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:42.595181 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:42.595181 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:42.595181 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 641/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:42.602507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7a086-0b95-4afd-b11d-43ed6c268066 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:42.711983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7a086-0b95-4afd-b11d-43ed6c268066 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:42.747842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596bd0f-a2f6-437f-a5d1-a60680ccfb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:42.748442 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596bd0f-a2f6-437f-a5d1-a60680ccfb1f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:42.748714 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596bd0f-a2f6-437f-a5d1-a60680ccfb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:42.748984 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596bd0f-a2f6-437f-a5d1-a60680ccfb1f None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:42.749628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596bd0f-a2f6-437f-a5d1-a60680ccfb1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:42.749957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596bd0f-a2f6-437f-a5d1-a60680ccfb1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:42.751334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596bd0f-a2f6-437f-a5d1-a60680ccfb1f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:42.762533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 629/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:42.771540 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d97d0-add8-4385-a8d1-7ee10844fe47 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:42.824021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:42.898745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d97d0-add8-4385-a8d1-7ee10844fe47 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:42.941112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da6d07-4d9d-4a24-8e1c-a9a4ca398028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:42.941994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da6d07-4d9d-4a24-8e1c-a9a4ca398028 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:42.942349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da6d07-4d9d-4a24-8e1c-a9a4ca398028 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:42.942719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da6d07-4d9d-4a24-8e1c-a9a4ca398028 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:42.951163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da6d07-4d9d-4a24-8e1c-a9a4ca398028 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:42.952607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da6d07-4d9d-4a24-8e1c-a9a4ca398028 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-67da6d07-4d9d-4a24-8e1c-a9a4ca398028 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 22:00:42.964872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:42.971453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:42.973485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 22:00:42.973485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 22:00:42.973485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 22:00:42.973485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 22:00:42.973485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 22:00:42.973485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 22:00:42.973485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:42.973485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:42.973485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 642/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 22:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:42.974861 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596bd0f-a2f6-437f-a5d1-a60680ccfb1f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:43.037504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:43.091356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596bd0f-a2f6-437f-a5d1-a60680ccfb1f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:43.125757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efab156-dedd-4a4f-bc3a-98b12eb47379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:43.126381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab156-dedd-4a4f-bc3a-98b12eb47379 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:43.126648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab156-dedd-4a4f-bc3a-98b12eb47379 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:43.126911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab156-dedd-4a4f-bc3a-98b12eb47379 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:43.127587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efab156-dedd-4a4f-bc3a-98b12eb47379 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:43.127878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efab156-dedd-4a4f-bc3a-98b12eb47379 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:43.129304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efab156-dedd-4a4f-bc3a-98b12eb47379 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:43.141376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 630/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 22:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:43.147742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da6d07-4d9d-4a24-8e1c-a9a4ca398028 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:43.251006 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:43.261306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da6d07-4d9d-4a24-8e1c-a9a4ca398028 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:43.297463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716d4ad-e5c2-4ad3-ad31-4e1872020dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:43.298147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716d4ad-e5c2-4ad3-ad31-4e1872020dc4 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:43.298419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716d4ad-e5c2-4ad3-ad31-4e1872020dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:43.298689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716d4ad-e5c2-4ad3-ad31-4e1872020dc4 None admin] PATH_INFO: `/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/2c7f2566918b4c719486d1ce285724e2/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:43.300783 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716d4ad-e5c2-4ad3-ad31-4e1872020dc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a83f1ce24f41099c068f186df634b8, user_id=2c7f2566918b4c719486d1ce285724e2, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:43.302280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716d4ad-e5c2-4ad3-ad31-4e1872020dc4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:43.319066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 643/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 22 22:00:43 2022] PUT /identity/v3/projects/b1a83f1ce24f41099c068f186df634b8/users/2c7f2566918b4c719486d1ce285724e2/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:00:45.424284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed8398-1ff7-4dbc-ad9f-57b10b1f672d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:45.424849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed8398-1ff7-4dbc-ad9f-57b10b1f672d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:45.424849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed8398-1ff7-4dbc-ad9f-57b10b1f672d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:45.426204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 631/1274] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:00:45.431421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34931f-cf69-467c-9b13-1654255a1ae9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:45.431839 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34931f-cf69-467c-9b13-1654255a1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:45.431955 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34931f-cf69-467c-9b13-1654255a1ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:45.450676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2e34931f-cf69-467c-9b13-1654255a1ae9 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:00:45.451848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2e34931f-cf69-467c-9b13-1654255a1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:00:45.520286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 644/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:00:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 22:00:45.783978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed8398-1ff7-4dbc-ad9f-57b10b1f672d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:45.896232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed8398-1ff7-4dbc-ad9f-57b10b1f672d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:45.914046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:45.939413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b0d11-d2ca-4e35-9829-f73316e33a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:45.940031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b0d11-d2ca-4e35-9829-f73316e33a6f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:45.940301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b0d11-d2ca-4e35-9829-f73316e33a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:45.940565 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b0d11-d2ca-4e35-9829-f73316e33a6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:45.951344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b0d11-d2ca-4e35-9829-f73316e33a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c15b0d11-d2ca-4e35-9829-f73316e33a6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 22:00:45.956153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:45.957164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:45.958191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 632/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 22 22:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:45.963436 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34931f-cf69-467c-9b13-1654255a1ae9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:46.049636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:46.069966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34931f-cf69-467c-9b13-1654255a1ae9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:46.107051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8f4a0-2e17-47a7-9491-02bb1e017f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:46.107647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8f4a0-2e17-47a7-9491-02bb1e017f8d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:46.107920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8f4a0-2e17-47a7-9491-02bb1e017f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:46.108184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8f4a0-2e17-47a7-9491-02bb1e017f8d None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:46.108838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8f4a0-2e17-47a7-9491-02bb1e017f8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:46.109135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8f4a0-2e17-47a7-9491-02bb1e017f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:46.110521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8f4a0-2e17-47a7-9491-02bb1e017f8d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:46.119306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 645/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 22 22:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:46.125392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b0d11-d2ca-4e35-9829-f73316e33a6f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:46.231718 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b0d11-d2ca-4e35-9829-f73316e33a6f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:46.266719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344af4ea-2db1-4a62-a2ee-e0dca7507e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:46.267326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344af4ea-2db1-4a62-a2ee-e0dca7507e65 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:46.267592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344af4ea-2db1-4a62-a2ee-e0dca7507e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:46.267856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344af4ea-2db1-4a62-a2ee-e0dca7507e65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:46.278637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344af4ea-2db1-4a62-a2ee-e0dca7507e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:46.280071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344af4ea-2db1-4a62-a2ee-e0dca7507e65 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-344af4ea-2db1-4a62-a2ee-e0dca7507e65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:46.294749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:46.295908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:46.297136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:46.297136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:46.297136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:46.297136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 633/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:46.304445 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8f4a0-2e17-47a7-9491-02bb1e017f8d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:46.424853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8f4a0-2e17-47a7-9491-02bb1e017f8d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:46.461029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f4f10-07fa-42b5-b488-ac6bf6ff4000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:46.461655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f4f10-07fa-42b5-b488-ac6bf6ff4000 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:46.461913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f4f10-07fa-42b5-b488-ac6bf6ff4000 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:46.462178 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f4f10-07fa-42b5-b488-ac6bf6ff4000 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:46.462818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f4f10-07fa-42b5-b488-ac6bf6ff4000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:46.463113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f4f10-07fa-42b5-b488-ac6bf6ff4000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:46.465050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f4f10-07fa-42b5-b488-ac6bf6ff4000 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:46.477115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 646/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:46.483384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344af4ea-2db1-4a62-a2ee-e0dca7507e65 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:46.515123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:46.585396 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344af4ea-2db1-4a62-a2ee-e0dca7507e65 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:46.621698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277a4b1-6adc-4908-ac85-34497deb6f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:46.622344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a4b1-6adc-4908-ac85-34497deb6f9f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:46.622620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a4b1-6adc-4908-ac85-34497deb6f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:46.622889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a4b1-6adc-4908-ac85-34497deb6f9f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:46.630546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277a4b1-6adc-4908-ac85-34497deb6f9f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:46.631990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277a4b1-6adc-4908-ac85-34497deb6f9f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4277a4b1-6adc-4908-ac85-34497deb6f9f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 22:00:46.643303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:46.644357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:46.645451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:46.645451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:46.645451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 22:00:46.645451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 22:00:46.645451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 22:00:46.645451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 22:00:46.645451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 22:00:46.645451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 22:00:46.645451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 22:00:46.645451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:46.645451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 634/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:46.652317 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f4f10-07fa-42b5-b488-ac6bf6ff4000 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:46.656587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:46.764901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f4f10-07fa-42b5-b488-ac6bf6ff4000 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:46.806828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d532-ba52-47ac-9944-1097a7840270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:46.807658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d532-ba52-47ac-9944-1097a7840270 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:46.807927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d532-ba52-47ac-9944-1097a7840270 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:46.808189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d532-ba52-47ac-9944-1097a7840270 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:46.808917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9d532-ba52-47ac-9944-1097a7840270 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:46.809212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9d532-ba52-47ac-9944-1097a7840270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:46.810654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9d532-ba52-47ac-9944-1097a7840270 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:46.828984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 647/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 22 22:00:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:46.835214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277a4b1-6adc-4908-ac85-34497deb6f9f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:46.933929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:46.950796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277a4b1-6adc-4908-ac85-34497deb6f9f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:46.992897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e2987-c77f-4f50-88ad-bcdf511475e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:46.993489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e2987-c77f-4f50-88ad-bcdf511475e6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:46.993761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e2987-c77f-4f50-88ad-bcdf511475e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:46.994059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e2987-c77f-4f50-88ad-bcdf511475e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:47.064549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e2987-c77f-4f50-88ad-bcdf511475e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:47.066036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e2987-c77f-4f50-88ad-bcdf511475e6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:47.160543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:47.172724 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 635/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 22 22:00:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 22:00:47.178998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d532-ba52-47ac-9944-1097a7840270 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:47.246690 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:47.289701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d532-ba52-47ac-9944-1097a7840270 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:47.329656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27da47b-3ef4-4a29-aa38-feba078de960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:47.330305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27da47b-3ef4-4a29-aa38-feba078de960 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:47.330577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27da47b-3ef4-4a29-aa38-feba078de960 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:47.330843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27da47b-3ef4-4a29-aa38-feba078de960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:47.342075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27da47b-3ef4-4a29-aa38-feba078de960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:47.343512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27da47b-3ef4-4a29-aa38-feba078de960 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c27da47b-3ef4-4a29-aa38-feba078de960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 22:00:47.359347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:47.360431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 22:00:47.361372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 22:00:47.361372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 22:00:47.361372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:47.361372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 648/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:47.366522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e2987-c77f-4f50-88ad-bcdf511475e6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:47.465942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e2987-c77f-4f50-88ad-bcdf511475e6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:47.501144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34241d-a0bb-47ca-a776-d9283c1503b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:47.501745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34241d-a0bb-47ca-a776-d9283c1503b7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:47.501913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34241d-a0bb-47ca-a776-d9283c1503b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:47.502215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34241d-a0bb-47ca-a776-d9283c1503b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:47.502832 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34241d-a0bb-47ca-a776-d9283c1503b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:47.503123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34241d-a0bb-47ca-a776-d9283c1503b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:47.504474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34241d-a0bb-47ca-a776-d9283c1503b7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:47.515871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 636/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 22 22:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:47.524547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27da47b-3ef4-4a29-aa38-feba078de960 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:47.638853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27da47b-3ef4-4a29-aa38-feba078de960 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:47.653420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:47.682745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed5c5-a036-4f27-97fe-f821e0b0195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:47.683698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed5c5-a036-4f27-97fe-f821e0b0195f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:47.683971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed5c5-a036-4f27-97fe-f821e0b0195f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:47.684240 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed5c5-a036-4f27-97fe-f821e0b0195f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:47.691262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ed5c5-a036-4f27-97fe-f821e0b0195f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:47.692694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ed5c5-a036-4f27-97fe-f821e0b0195f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f18ed5c5-a036-4f27-97fe-f821e0b0195f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 22:00:47.704567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:47.705607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:47.706912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 22:00:47.706912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 22:00:47.706912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 22:00:47.706912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 22:00:47.706912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 22:00:47.706912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 22:00:47.706912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 22:00:47.706912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Sep 22 22:00:47.706912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 649/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 22 22:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:47.714918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34241d-a0bb-47ca-a776-d9283c1503b7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:47.774234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:47.829325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34241d-a0bb-47ca-a776-d9283c1503b7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:47.866724 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77946e0-e07b-4622-94b0-629aa725efa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:47.867320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77946e0-e07b-4622-94b0-629aa725efa0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:47.867589 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77946e0-e07b-4622-94b0-629aa725efa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:47.867851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77946e0-e07b-4622-94b0-629aa725efa0 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:47.868531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77946e0-e07b-4622-94b0-629aa725efa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:47.868838 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77946e0-e07b-4622-94b0-629aa725efa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:47.870822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77946e0-e07b-4622-94b0-629aa725efa0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:47.883803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 637/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 22 22:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:47.890668 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed5c5-a036-4f27-97fe-f821e0b0195f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:47.994767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed5c5-a036-4f27-97fe-f821e0b0195f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:48.032385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c11264-223f-423d-a55d-0eab3e3c4a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:48.032933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c11264-223f-423d-a55d-0eab3e3c4a15 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:48.033208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c11264-223f-423d-a55d-0eab3e3c4a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:48.033476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c11264-223f-423d-a55d-0eab3e3c4a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:48.034232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c11264-223f-423d-a55d-0eab3e3c4a15 None admin] RBAC: Adding query filter params (role.id=3eaaa9f7ef504bb1a19bd39eb5232f97, scope.project.id=b1a83f1ce24f41099c068f186df634b8, user.id=2c7f2566918b4c719486d1ce285724e2) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:48.034534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c11264-223f-423d-a55d-0eab3e3c4a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:48.035950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c11264-223f-423d-a55d-0eab3e3c4a15 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:48.042075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 650/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 22 22:00:47 2022] GET /identity/v3/role_assignments?user.id=2c7f2566918b4c719486d1ce285724e2&scope.project.id=b1a83f1ce24f41099c068f186df634b8&role.id=3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:50.195816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623773-b6ff-4398-a097-cab03b684801 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:50.196386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623773-b6ff-4398-a097-cab03b684801 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:50.196386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623773-b6ff-4398-a097-cab03b684801 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:50.197685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 638/1288] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:00:50.204430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dd00e-d176-4407-8b6e-f040f5b35d53 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:50.205193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dd00e-d176-4407-8b6e-f040f5b35d53 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:50.205340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dd00e-d176-4407-8b6e-f040f5b35d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:50.234676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-644dd00e-d176-4407-8b6e-f040f5b35d53 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:00:50.235876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-644dd00e-d176-4407-8b6e-f040f5b35d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:00:50.268150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:50.318168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 651/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:00:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 22:00:50.601064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623773-b6ff-4398-a097-cab03b684801 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:50.728524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623773-b6ff-4398-a097-cab03b684801 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:50.741645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:50.776004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0d2c3-9df8-4a25-b02d-b591d148fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:50.776736 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d2c3-9df8-4a25-b02d-b591d148fde1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:50.777011 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d2c3-9df8-4a25-b02d-b591d148fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:50.777277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d2c3-9df8-4a25-b02d-b591d148fde1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:50.777876 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0d2c3-9df8-4a25-b02d-b591d148fde1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:50.779259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0d2c3-9df8-4a25-b02d-b591d148fde1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b8e0d2c3-9df8-4a25-b02d-b591d148fde1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:50.788410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:50.789573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:50.790462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 639/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 22 22:00:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:50.796054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644dd00e-d176-4407-8b6e-f040f5b35d53 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:50.897131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644dd00e-d176-4407-8b6e-f040f5b35d53 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:50.932404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d799eb7-f659-469b-ac29-a00402667396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:50.933006 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799eb7-f659-469b-ac29-a00402667396 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:50.933284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799eb7-f659-469b-ac29-a00402667396 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:50.933579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799eb7-f659-469b-ac29-a00402667396 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:50.934250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d799eb7-f659-469b-ac29-a00402667396 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:50.934558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d799eb7-f659-469b-ac29-a00402667396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:50.935920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d799eb7-f659-469b-ac29-a00402667396 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:50.940815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 652/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Sep 22 22:00:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:50.949501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0d2c3-9df8-4a25-b02d-b591d148fde1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:51.068151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0d2c3-9df8-4a25-b02d-b591d148fde1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:51.106392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e8c77-b85b-41b1-917a-f42a5a17330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:51.106976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e8c77-b85b-41b1-917a-f42a5a17330c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:51.107244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e8c77-b85b-41b1-917a-f42a5a17330c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:51.107509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e8c77-b85b-41b1-917a-f42a5a17330c None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:51.108124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e8c77-b85b-41b1-917a-f42a5a17330c None admin] RBAC: Adding query filter params (type=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:51.108416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e8c77-b85b-41b1-917a-f42a5a17330c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:51.109777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e8c77-b85b-41b1-917a-f42a5a17330c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:51.114555 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 640/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Sep 22 22:00:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:53.231896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc88c86-7cde-45fe-b0ff-f12b2d565561 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:53.232802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc88c86-7cde-45fe-b0ff-f12b2d565561 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:53.232802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc88c86-7cde-45fe-b0ff-f12b2d565561 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:53.234904 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 653/1293] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:00:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:00:53.241119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40b9d5-4c92-4ed7-b48e-2909cd459e50 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:53.241557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40b9d5-4c92-4ed7-b48e-2909cd459e50 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:53.241680 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40b9d5-4c92-4ed7-b48e-2909cd459e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:53.268458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0f40b9d5-4c92-4ed7-b48e-2909cd459e50 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:00:53.269656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0f40b9d5-4c92-4ed7-b48e-2909cd459e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:00:53.301716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:53.347342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 641/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:00:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 22:00:53.635571 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc88c86-7cde-45fe-b0ff-f12b2d565561 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:53.677164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:53.760289 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc88c86-7cde-45fe-b0ff-f12b2d565561 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:53.796981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041ef5a-407f-42b8-9d14-d5ea6b99095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:53.797887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041ef5a-407f-42b8-9d14-d5ea6b99095c None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:53.798250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041ef5a-407f-42b8-9d14-d5ea6b99095c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:53.798584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041ef5a-407f-42b8-9d14-d5ea6b99095c None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:53.799595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041ef5a-407f-42b8-9d14-d5ea6b99095c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:53.801724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041ef5a-407f-42b8-9d14-d5ea6b99095c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:53.823042 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 654/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 22 22:00:53 2022] POST /identity/v3/services => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:00:55.975473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c9ce1-b46f-4898-8f5d-5d88c4b77a04 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:55.976289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c9ce1-b46f-4898-8f5d-5d88c4b77a04 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:55.976289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c9ce1-b46f-4898-8f5d-5d88c4b77a04 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:55.978404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 642/1296] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:00:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:00:55.984588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe25b-fbe8-42e2-b5a9-17239c076c92 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:55.985057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe25b-fbe8-42e2-b5a9-17239c076c92 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:55.985151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe25b-fbe8-42e2-b5a9-17239c076c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:56.004268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ba3fe25b-fbe8-42e2-b5a9-17239c076c92 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:00:56.005437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ba3fe25b-fbe8-42e2-b5a9-17239c076c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:00:56.080373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 655/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:00:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 22:00:56.346623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c9ce1-b46f-4898-8f5d-5d88c4b77a04 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:56.488658 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c9ce1-b46f-4898-8f5d-5d88c4b77a04 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:56.523516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7d615-ce35-4bb6-a9f6-6d3bdd21d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:56.524132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7d615-ce35-4bb6-a9f6-6d3bdd21d571 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:56.524400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7d615-ce35-4bb6-a9f6-6d3bdd21d571 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:56.524665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7d615-ce35-4bb6-a9f6-6d3bdd21d571 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:56.525241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7d615-ce35-4bb6-a9f6-6d3bdd21d571 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:56.526631 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7d615-ce35-4bb6-a9f6-6d3bdd21d571 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-06b7d615-ce35-4bb6-a9f6-6d3bdd21d571 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:56.535830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:56.536931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:56.537863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 643/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 22 22:00:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:56.546689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fe25b-fbe8-42e2-b5a9-17239c076c92 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:56.570768 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:56.661462 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fe25b-fbe8-42e2-b5a9-17239c076c92 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:56.696988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a8996-676f-4c27-8a85-94a9df0e6ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:56.697596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a8996-676f-4c27-8a85-94a9df0e6ddf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:56.697903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a8996-676f-4c27-8a85-94a9df0e6ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:56.698218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a8996-676f-4c27-8a85-94a9df0e6ddf None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:56.698995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a8996-676f-4c27-8a85-94a9df0e6ddf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:56.699288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a8996-676f-4c27-8a85-94a9df0e6ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:56.700670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a8996-676f-4c27-8a85-94a9df0e6ddf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:56.706081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 656/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Sep 22 22:00:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:56.713688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7d615-ce35-4bb6-a9f6-6d3bdd21d571 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:56.751962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:56.823556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7d615-ce35-4bb6-a9f6-6d3bdd21d571 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:56.858980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135d60f-a085-40ec-bc64-a2e658a70bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:56.859565 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135d60f-a085-40ec-bc64-a2e658a70bfc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:56.859834 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135d60f-a085-40ec-bc64-a2e658a70bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:56.860101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135d60f-a085-40ec-bc64-a2e658a70bfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:56.860772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135d60f-a085-40ec-bc64-a2e658a70bfc None admin] RBAC: Adding query filter params (interface=public, service_id=b8c3dd584dbf4ea8837ed017ddafcdc9, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:56.861068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135d60f-a085-40ec-bc64-a2e658a70bfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:56.862458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135d60f-a085-40ec-bc64-a2e658a70bfc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:56.867449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 644/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 22 22:00:56 2022] GET /identity/v3/endpoints?service_id=b8c3dd584dbf4ea8837ed017ddafcdc9&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:56.876383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a8996-676f-4c27-8a85-94a9df0e6ddf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:56.959681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:56.978823 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a8996-676f-4c27-8a85-94a9df0e6ddf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:57.014470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f4533-b462-4966-aee6-99776dfe2038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:57.015078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f4533-b462-4966-aee6-99776dfe2038 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:57.015333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f4533-b462-4966-aee6-99776dfe2038 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:57.015604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f4533-b462-4966-aee6-99776dfe2038 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:57.016206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f4533-b462-4966-aee6-99776dfe2038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:57.017573 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f4533-b462-4966-aee6-99776dfe2038 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:57.024427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 657/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 22 22:00:56 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:00:59.136880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4e00-a9d3-458d-b092-3dbf5926c17a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:59.137527 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4e00-a9d3-458d-b092-3dbf5926c17a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:59.137527 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4e00-a9d3-458d-b092-3dbf5926c17a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:59.138788 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 645/1302] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:00:59.144160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71fbe5-56fe-46bd-81be-8c5eb2e675fa None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:59.144634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71fbe5-56fe-46bd-81be-8c5eb2e675fa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:59.144740 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71fbe5-56fe-46bd-81be-8c5eb2e675fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:59.168208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9a71fbe5-56fe-46bd-81be-8c5eb2e675fa None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:00:59.169398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9a71fbe5-56fe-46bd-81be-8c5eb2e675fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:00:59.241418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 658/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:00:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 22:00:59.516856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d4e00-a9d3-458d-b092-3dbf5926c17a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:59.623282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:59.630994 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d4e00-a9d3-458d-b092-3dbf5926c17a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:59.666977 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036a8d4-f3e6-4d6e-a8d8-aa1c21c20e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:59.667767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036a8d4-f3e6-4d6e-a8d8-aa1c21c20e26 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:59.668163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036a8d4-f3e6-4d6e-a8d8-aa1c21c20e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:59.668434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036a8d4-f3e6-4d6e-a8d8-aa1c21c20e26 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:59.669007 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036a8d4-f3e6-4d6e-a8d8-aa1c21c20e26 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:59.670401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036a8d4-f3e6-4d6e-a8d8-aa1c21c20e26 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0036a8d4-f3e6-4d6e-a8d8-aa1c21c20e26 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 22:00:59.678995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 22:00:59.680148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Sep 22 22:00:59.681232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 646/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 22 22:00:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 22:00:59.686582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71fbe5-56fe-46bd-81be-8c5eb2e675fa None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:59.765113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:00:59.789197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71fbe5-56fe-46bd-81be-8c5eb2e675fa None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:59.824097 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e338bc2-e217-4e75-8c4a-5fb013b2dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:59.824713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e338bc2-e217-4e75-8c4a-5fb013b2dea0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:59.824990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e338bc2-e217-4e75-8c4a-5fb013b2dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:59.825256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e338bc2-e217-4e75-8c4a-5fb013b2dea0 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:59.825918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e338bc2-e217-4e75-8c4a-5fb013b2dea0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:00:59.826221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e338bc2-e217-4e75-8c4a-5fb013b2dea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:59.827586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e338bc2-e217-4e75-8c4a-5fb013b2dea0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:00:59.832764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 659/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Sep 22 22:00:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:00:59.839774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036a8d4-f3e6-4d6e-a8d8-aa1c21c20e26 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:00:59.954967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036a8d4-f3e6-4d6e-a8d8-aa1c21c20e26 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:00:59.989282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830de3f-c541-4caa-aa69-642ff3996db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:00:59.989887 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830de3f-c541-4caa-aa69-642ff3996db5 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:00:59.990172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830de3f-c541-4caa-aa69-642ff3996db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:00:59.990453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830de3f-c541-4caa-aa69-642ff3996db5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:00:59.991117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830de3f-c541-4caa-aa69-642ff3996db5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:00:59.992484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830de3f-c541-4caa-aa69-642ff3996db5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:01:00.015921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 647/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:00:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:01:09.829607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=30 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:01:10.011284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:04.645333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09485f-60bc-4dba-967c-0ee16bd94500 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:04.645333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09485f-60bc-4dba-967c-0ee16bd94500 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:04.645913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09485f-60bc-4dba-967c-0ee16bd94500 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:04.648178 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 660/1307] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:04.653626 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2155fd-60a2-4b83-927c-22c551f351f7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:04.654103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2155fd-60a2-4b83-927c-22c551f351f7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:04.654103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2155fd-60a2-4b83-927c-22c551f351f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:04.803121 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8b2155fd-60a2-4b83-927c-22c551f351f7 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:04.804814 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8b2155fd-60a2-4b83-927c-22c551f351f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:04.935487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 648/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:05.283836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c6fa1-66f3-4ecc-87f8-51b4ec618a37 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:05.284113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c6fa1-66f3-4ecc-87f8-51b4ec618a37 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:05.284380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c6fa1-66f3-4ecc-87f8-51b4ec618a37 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:05.285728 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 661/1309] 10.222.0.20 () {54 vars in 964 bytes} [Thu Sep 22 22:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:05.292137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9d1d4-c51c-4fac-a85b-ee42b410e8d4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:05.292576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9d1d4-c51c-4fac-a85b-ee42b410e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:05.292917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9d1d4-c51c-4fac-a85b-ee42b410e8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:05.391064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5eb9d1d4-c51c-4fac-a85b-ee42b410e8d4 None None] MFA Rules not processed for user `d512b60a42ed456a82dff11d17b77c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:05.392281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5eb9d1d4-c51c-4fac-a85b-ee42b410e8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:05.416920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:05.483504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 649/1310] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Sep 22 22:02:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:05.492401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c6fa1-66f3-4ecc-87f8-51b4ec618a37 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:05.494203 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-255c6fa1-66f3-4ecc-87f8-51b4ec618a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:05.627991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c6fa1-66f3-4ecc-87f8-51b4ec618a37 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:05.728961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b717c-f476-4c99-91fd-a0d86f58c499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:05.729944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b717c-f476-4c99-91fd-a0d86f58c499 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:05.730477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b717c-f476-4c99-91fd-a0d86f58c499 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:05.730839 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b717c-f476-4c99-91fd-a0d86f58c499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:05.732489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-553b717c-f476-4c99-91fd-a0d86f58c499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:05.795998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:05.864029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b717c-f476-4c99-91fd-a0d86f58c499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:05.865503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b717c-f476-4c99-91fd-a0d86f58c499 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:05.889790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 662/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:08.324420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e48c-d6f9-448b-a2d0-603025d4583e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:08.324976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e48c-d6f9-448b-a2d0-603025d4583e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:08.324976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e48c-d6f9-448b-a2d0-603025d4583e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:08.326428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 650/1312] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:08.331930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5863e7-3ce9-401c-9a85-084b46625d00 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:08.332423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5863e7-3ce9-401c-9a85-084b46625d00 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:08.332423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5863e7-3ce9-401c-9a85-084b46625d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:08.416023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7e5863e7-3ce9-401c-9a85-084b46625d00 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:08.417233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7e5863e7-3ce9-401c-9a85-084b46625d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:08.518081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 663/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:08.797872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4e48c-d6f9-448b-a2d0-603025d4583e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:08.799514 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-75f4e48c-d6f9-448b-a2d0-603025d4583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:08.912603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4e48c-d6f9-448b-a2d0-603025d4583e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:08.991108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:08.993521 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e326ff-0635-4503-b2e7-2953bad7f1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:08.994250 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e326ff-0635-4503-b2e7-2953bad7f1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:08.994510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e326ff-0635-4503-b2e7-2953bad7f1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:08.994817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e326ff-0635-4503-b2e7-2953bad7f1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:08.997303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-28e326ff-0635-4503-b2e7-2953bad7f1c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:09.114793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e326ff-0635-4503-b2e7-2953bad7f1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:09.117502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e326ff-0635-4503-b2e7-2953bad7f1c8 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:09.142360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 651/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:11.604803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7dbb1-4787-4a56-8e13-dfd860e70a7d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:11.605537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7dbb1-4787-4a56-8e13-dfd860e70a7d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:11.605537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7dbb1-4787-4a56-8e13-dfd860e70a7d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:11.607847 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 664/1315] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:11.616317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0951ba-3e88-432b-a391-5e0249a3b216 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:11.616764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0951ba-3e88-432b-a391-5e0249a3b216 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:11.616865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0951ba-3e88-432b-a391-5e0249a3b216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:11.689868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bb0951ba-3e88-432b-a391-5e0249a3b216 None None] MFA Rules not processed for user `79d620cf4a14435fa08f46effb6890ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:11.691134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bb0951ba-3e88-432b-a391-5e0249a3b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:11.748425 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:11.799704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 652/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:12.093323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7dbb1-4787-4a56-8e13-dfd860e70a7d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:12.095809 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1ee7dbb1-4787-4a56-8e13-dfd860e70a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:12.111277 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:12.224361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7dbb1-4787-4a56-8e13-dfd860e70a7d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:12.303007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cf12d-cd54-4e7b-a2a2-6c2e8ab8829b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:12.303538 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf12d-cd54-4e7b-a2a2-6c2e8ab8829b service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:12.303818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf12d-cd54-4e7b-a2a2-6c2e8ab8829b service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:12.304073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf12d-cd54-4e7b-a2a2-6c2e8ab8829b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:12.305657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cc4cf12d-cd54-4e7b-a2a2-6c2e8ab8829b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:12.370877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:12.417340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cf12d-cd54-4e7b-a2a2-6c2e8ab8829b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:12.418860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cf12d-cd54-4e7b-a2a2-6c2e8ab8829b service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:12.437057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 665/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:15.151345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7962-5cb9-4411-9299-2e4dc19973b7 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:15.152043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7962-5cb9-4411-9299-2e4dc19973b7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:15.152043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7962-5cb9-4411-9299-2e4dc19973b7 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:15.153398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 653/1318] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:15.159076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609b620-c84e-4c0a-a250-d54af3b2f09f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:15.159552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609b620-c84e-4c0a-a250-d54af3b2f09f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:15.159646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609b620-c84e-4c0a-a250-d54af3b2f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:15.228809 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1609b620-c84e-4c0a-a250-d54af3b2f09f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:15.230102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1609b620-c84e-4c0a-a250-d54af3b2f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:15.331131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 666/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:02:15.612960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a7962-5cb9-4411-9299-2e4dc19973b7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:15.615522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-af7a7962-5cb9-4411-9299-2e4dc19973b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:15.745104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a7962-5cb9-4411-9299-2e4dc19973b7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:15.829282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5233f3-7e90-421d-a6d6-3d75dfa0cf0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:15.829871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5233f3-7e90-421d-a6d6-3d75dfa0cf0b service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:15.830176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5233f3-7e90-421d-a6d6-3d75dfa0cf0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:15.830438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5233f3-7e90-421d-a6d6-3d75dfa0cf0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:15.832044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ca5233f3-7e90-421d-a6d6-3d75dfa0cf0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:15.839659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:15.958614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5233f3-7e90-421d-a6d6-3d75dfa0cf0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:15.959976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5233f3-7e90-421d-a6d6-3d75dfa0cf0b service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:15.981243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 654/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:18.781764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7c200-25cb-4625-a2ab-4696ba96ce0c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:18.782343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7c200-25cb-4625-a2ab-4696ba96ce0c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:18.782507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7c200-25cb-4625-a2ab-4696ba96ce0c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:18.783833 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 667/1321] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:18.789126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414767b0-c927-4978-b41a-c9e83ad13fec None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:18.789578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414767b0-c927-4978-b41a-c9e83ad13fec None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:18.789670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414767b0-c927-4978-b41a-c9e83ad13fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:18.865613 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-414767b0-c927-4978-b41a-c9e83ad13fec None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:18.866905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-414767b0-c927-4978-b41a-c9e83ad13fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:18.935210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:18.978904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 655/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:19.256201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7c200-25cb-4625-a2ab-4696ba96ce0c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:19.257778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-54a7c200-25cb-4625-a2ab-4696ba96ce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:19.278743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:19.368624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7c200-25cb-4625-a2ab-4696ba96ce0c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:19.448847 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818a015-b1c1-466d-a0af-3ce3eecd198d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:19.449573 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818a015-b1c1-466d-a0af-3ce3eecd198d service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:19.449678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818a015-b1c1-466d-a0af-3ce3eecd198d service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:19.450013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818a015-b1c1-466d-a0af-3ce3eecd198d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:19.451622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0818a015-b1c1-466d-a0af-3ce3eecd198d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:19.525641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:19.566334 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818a015-b1c1-466d-a0af-3ce3eecd198d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:19.567784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818a015-b1c1-466d-a0af-3ce3eecd198d service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:19.586541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 668/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:21.781151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b48a-8710-40c3-85db-def8a89cbf37 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:21.781715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b48a-8710-40c3-85db-def8a89cbf37 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:21.781715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b48a-8710-40c3-85db-def8a89cbf37 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:21.783091 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 656/1324] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:21.788428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb2095-3c89-476e-96a8-91ae6184d4bc None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:21.788878 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb2095-3c89-476e-96a8-91ae6184d4bc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:21.788999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb2095-3c89-476e-96a8-91ae6184d4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:21.859171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-24bb2095-3c89-476e-96a8-91ae6184d4bc None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:21.860386 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-24bb2095-3c89-476e-96a8-91ae6184d4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:21.969765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 669/1325] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:22.251203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862b48a-8710-40c3-85db-def8a89cbf37 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:22.252742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4862b48a-8710-40c3-85db-def8a89cbf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:22.362992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862b48a-8710-40c3-85db-def8a89cbf37 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:22.440508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8861f-bdcc-49b0-842e-be6d9278b3c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:22.441127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8861f-bdcc-49b0-842e-be6d9278b3c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:22.441401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8861f-bdcc-49b0-842e-be6d9278b3c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:22.441670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8861f-bdcc-49b0-842e-be6d9278b3c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:22.443337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9cd8861f-bdcc-49b0-842e-be6d9278b3c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:22.462667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:22.557814 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8861f-bdcc-49b0-842e-be6d9278b3c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:22.559268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8861f-bdcc-49b0-842e-be6d9278b3c2 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:22.577686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 657/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:24.801178 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e3a87-8d3c-413f-9804-2edf5507ca7b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:24.801751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e3a87-8d3c-413f-9804-2edf5507ca7b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:24.801751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e3a87-8d3c-413f-9804-2edf5507ca7b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:24.803103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 670/1327] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:24.809364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704b7ad-91c1-4ebe-819e-362762231add None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:24.809805 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704b7ad-91c1-4ebe-819e-362762231add None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:24.809916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704b7ad-91c1-4ebe-819e-362762231add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:24.882259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0704b7ad-91c1-4ebe-819e-362762231add None None] MFA Rules not processed for user `79d620cf4a14435fa08f46effb6890ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:24.883474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0704b7ad-91c1-4ebe-819e-362762231add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:24.951072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:24.984247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 658/1328] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:25.268277 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e3a87-8d3c-413f-9804-2edf5507ca7b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:25.269917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7d5e3a87-8d3c-413f-9804-2edf5507ca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:25.304486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:25.381147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e3a87-8d3c-413f-9804-2edf5507ca7b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:25.461541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fee018-7afe-4147-b61d-b414d4b90f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:25.462197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fee018-7afe-4147-b61d-b414d4b90f45 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:25.462478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fee018-7afe-4147-b61d-b414d4b90f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:25.462750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fee018-7afe-4147-b61d-b414d4b90f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:25.464396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-87fee018-7afe-4147-b61d-b414d4b90f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:25.543385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:25.576592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fee018-7afe-4147-b61d-b414d4b90f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:25.578103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fee018-7afe-4147-b61d-b414d4b90f45 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:25.597005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 671/1329] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:25 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:28.022093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15968e97-027f-4f71-b784-40e2a7d41bf7 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:28.022521 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15968e97-027f-4f71-b784-40e2a7d41bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:28.022521 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15968e97-027f-4f71-b784-40e2a7d41bf7 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:28.024490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 659/1330] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:28.030100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bfde2-4721-4fcb-883c-b1f18963447e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:28.030539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bfde2-4721-4fcb-883c-b1f18963447e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:28.030804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bfde2-4721-4fcb-883c-b1f18963447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:28.097711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9e9bfde2-4721-4fcb-883c-b1f18963447e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:28.099034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9e9bfde2-4721-4fcb-883c-b1f18963447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:28.196863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 672/1331] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:28.501663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15968e97-027f-4f71-b784-40e2a7d41bf7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:28.504189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-15968e97-027f-4f71-b784-40e2a7d41bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:28.623145 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15968e97-027f-4f71-b784-40e2a7d41bf7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:28.701985 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab502a83-87c2-42ef-9c6a-fd94dd31b049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:28.702595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab502a83-87c2-42ef-9c6a-fd94dd31b049 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:28.702871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab502a83-87c2-42ef-9c6a-fd94dd31b049 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:28.703140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab502a83-87c2-42ef-9c6a-fd94dd31b049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:28.704757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ab502a83-87c2-42ef-9c6a-fd94dd31b049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:28.733776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:28.832303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab502a83-87c2-42ef-9c6a-fd94dd31b049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:28.833676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab502a83-87c2-42ef-9c6a-fd94dd31b049 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:28.852350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 660/1332] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:31.084651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59ff0-91dd-492f-81a1-367ee1f354fd None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:31.085304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59ff0-91dd-492f-81a1-367ee1f354fd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:31.085304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59ff0-91dd-492f-81a1-367ee1f354fd None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:31.086566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 673/1333] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:31.093526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c783736-b0d1-4d33-8063-cfa75db7a95e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:31.094303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c783736-b0d1-4d33-8063-cfa75db7a95e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:31.094463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c783736-b0d1-4d33-8063-cfa75db7a95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:31.176286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6c783736-b0d1-4d33-8063-cfa75db7a95e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:31.177505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6c783736-b0d1-4d33-8063-cfa75db7a95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:31.259342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:31.287310 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 661/1334] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:31.592071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab59ff0-91dd-492f-81a1-367ee1f354fd None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:31.593621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fab59ff0-91dd-492f-81a1-367ee1f354fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:31.639397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:31.723100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab59ff0-91dd-492f-81a1-367ee1f354fd None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:31.815488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a9f45-438b-46c6-b606-1f1ba3d46153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:31.816104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a9f45-438b-46c6-b606-1f1ba3d46153 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:31.816377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a9f45-438b-46c6-b606-1f1ba3d46153 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:31.816643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a9f45-438b-46c6-b606-1f1ba3d46153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:31.818285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1b4a9f45-438b-46c6-b606-1f1ba3d46153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:31.907288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:31.934434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a9f45-438b-46c6-b606-1f1ba3d46153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:31.935869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a9f45-438b-46c6-b606-1f1ba3d46153 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:31.954348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 674/1335] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:02:34.406919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff79eb5-8894-46d5-b04f-739e2a0f0764 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:34.407469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff79eb5-8894-46d5-b04f-739e2a0f0764 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:34.407469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff79eb5-8894-46d5-b04f-739e2a0f0764 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:34.408709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 662/1336] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:34.415024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d62d9-3e57-45ae-a839-79a62730d81d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:34.415501 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d62d9-3e57-45ae-a839-79a62730d81d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:34.415605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d62d9-3e57-45ae-a839-79a62730d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:34.487243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d31d62d9-3e57-45ae-a839-79a62730d81d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:34.488451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d31d62d9-3e57-45ae-a839-79a62730d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:34.587850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 675/1337] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:34.884252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2049ad-9900-4398-b521-f8e9dc542018 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:34.884509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2049ad-9900-4398-b521-f8e9dc542018 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:34.884805 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2049ad-9900-4398-b521-f8e9dc542018 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:34.886232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 663/1338] 10.222.0.20 () {54 vars in 964 bytes} [Thu Sep 22 22:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:34.895510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fbbb-3a73-469a-bf1d-0a7118a6174f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:34.895891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fbbb-3a73-469a-bf1d-0a7118a6174f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:34.896372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fbbb-3a73-469a-bf1d-0a7118a6174f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:34.957469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:34.990568 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8d72fbbb-3a73-469a-bf1d-0a7118a6174f None None] MFA Rules not processed for user `d512b60a42ed456a82dff11d17b77c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:34.991827 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8d72fbbb-3a73-469a-bf1d-0a7118a6174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:35.071305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 676/1339] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Sep 22 22:02:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:35.081219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2049ad-9900-4398-b521-f8e9dc542018 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:35.083649 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8b2049ad-9900-4398-b521-f8e9dc542018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:35.206458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2049ad-9900-4398-b521-f8e9dc542018 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:35.284332 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533a225-57c9-4a71-88ff-0a1bb987ebe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:35.284852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a225-57c9-4a71-88ff-0a1bb987ebe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:35.285116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a225-57c9-4a71-88ff-0a1bb987ebe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:35.285373 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a225-57c9-4a71-88ff-0a1bb987ebe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:35.287141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2533a225-57c9-4a71-88ff-0a1bb987ebe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:35.330674 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:35.405785 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533a225-57c9-4a71-88ff-0a1bb987ebe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:35.407240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533a225-57c9-4a71-88ff-0a1bb987ebe0 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:35.425455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 664/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:40.173518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61fee-b598-4240-8f37-48c2d6853ae5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:40.174031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61fee-b598-4240-8f37-48c2d6853ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:40.174257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61fee-b598-4240-8f37-48c2d6853ae5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:40.175737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 677/1341] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:40.181263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca036937-6e56-4cdd-a731-02239608b4ad None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:40.181688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca036937-6e56-4cdd-a731-02239608b4ad None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:40.181807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca036937-6e56-4cdd-a731-02239608b4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:40.253413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ca036937-6e56-4cdd-a731-02239608b4ad None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:40.255141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ca036937-6e56-4cdd-a731-02239608b4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:40.349253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:40.361073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 665/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:40.644595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be61fee-b598-4240-8f37-48c2d6853ae5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:40.646257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0be61fee-b598-4240-8f37-48c2d6853ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:40.761503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be61fee-b598-4240-8f37-48c2d6853ae5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:40.799971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:40.837694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1a5c3-6827-4149-bc3c-f4a9911638b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:40.838392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1a5c3-6827-4149-bc3c-f4a9911638b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:40.838667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1a5c3-6827-4149-bc3c-f4a9911638b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:40.838936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1a5c3-6827-4149-bc3c-f4a9911638b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:40.840574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-21f1a5c3-6827-4149-bc3c-f4a9911638b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:40.954223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1a5c3-6827-4149-bc3c-f4a9911638b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:40.955571 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1a5c3-6827-4149-bc3c-f4a9911638b5 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:40.974581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 678/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:43.778669 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb56ca-fe89-4436-99d3-301e470faef0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:43.779275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb56ca-fe89-4436-99d3-301e470faef0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:43.779275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb56ca-fe89-4436-99d3-301e470faef0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:43.780426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 666/1344] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:43.786024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797ba05-1c43-4301-8244-c8d0a8066952 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:43.786474 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797ba05-1c43-4301-8244-c8d0a8066952 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:43.786584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797ba05-1c43-4301-8244-c8d0a8066952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:43.857251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4797ba05-1c43-4301-8244-c8d0a8066952 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:43.858513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4797ba05-1c43-4301-8244-c8d0a8066952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:43.877722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:43.968254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 679/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:44.252868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb56ca-fe89-4436-99d3-301e470faef0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:44.254596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7fcb56ca-fe89-4436-99d3-301e470faef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:44.375303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb56ca-fe89-4436-99d3-301e470faef0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:44.451134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5707917-8e4e-44c4-9b3b-fc3835d6060e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:44.451741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5707917-8e4e-44c4-9b3b-fc3835d6060e service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:44.452013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5707917-8e4e-44c4-9b3b-fc3835d6060e service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:44.452273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5707917-8e4e-44c4-9b3b-fc3835d6060e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:44.453866 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e5707917-8e4e-44c4-9b3b-fc3835d6060e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:44.501124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:44.573647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5707917-8e4e-44c4-9b3b-fc3835d6060e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:44.575196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5707917-8e4e-44c4-9b3b-fc3835d6060e service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:44.595130 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 667/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:49.057414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3108-5013-413d-b5ad-41c8038b65dd None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:49.057925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3108-5013-413d-b5ad-41c8038b65dd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:49.058018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3108-5013-413d-b5ad-41c8038b65dd None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:49.059870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 680/1347] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:49.065405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab9655-7f0d-4e01-96c8-924aee5e360e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:49.065896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab9655-7f0d-4e01-96c8-924aee5e360e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:49.065987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab9655-7f0d-4e01-96c8-924aee5e360e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:49.136728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-51ab9655-7f0d-4e01-96c8-924aee5e360e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:49.137985 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-51ab9655-7f0d-4e01-96c8-924aee5e360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:49.241451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:49.243881 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 668/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:49.523332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a3108-5013-413d-b5ad-41c8038b65dd None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:02:49.524907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-795a3108-5013-413d-b5ad-41c8038b65dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:49.641916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a3108-5013-413d-b5ad-41c8038b65dd None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:02:49.692169 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:49.721607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065a7c8-8e3f-497a-907c-ddefd586327e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:02:49.722261 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065a7c8-8e3f-497a-907c-ddefd586327e service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:49.722535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065a7c8-8e3f-497a-907c-ddefd586327e service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:49.722803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065a7c8-8e3f-497a-907c-ddefd586327e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:49.724402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a065a7c8-8e3f-497a-907c-ddefd586327e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:49.842234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065a7c8-8e3f-497a-907c-ddefd586327e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:02:49.843614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065a7c8-8e3f-497a-907c-ddefd586327e service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:02:49.868309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 681/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:02:54.773085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98f883-58bc-4105-a152-7fed5c478d09 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:54.773541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98f883-58bc-4105-a152-7fed5c478d09 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:54.774030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98f883-58bc-4105-a152-7fed5c478d09 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:54.775715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 669/1350] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:54.782256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b41253-7afc-4a64-a410-e56d06f35791 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:54.783147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b41253-7afc-4a64-a410-e56d06f35791 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:54.783567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b41253-7afc-4a64-a410-e56d06f35791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:54.901932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-66b41253-7afc-4a64-a410-e56d06f35791 None None] MFA Rules not processed for user `2c7f2566918b4c719486d1ce285724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:54.903501 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-66b41253-7afc-4a64-a410-e56d06f35791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:54.927139 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:55.065873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 682/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:02:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:02:59.139053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baa484-3de3-43ca-863a-ef670058f54a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:59.139529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baa484-3de3-43ca-863a-ef670058f54a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:59.139608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baa484-3de3-43ca-863a-ef670058f54a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:59.141170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 670/1352] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:02:59.146195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72d19-f078-4d18-ac94-a05b48f1ca27 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:02:59.146612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72d19-f078-4d18-ac94-a05b48f1ca27 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:02:59.146813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72d19-f078-4d18-ac94-a05b48f1ca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:02:59.230407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-66a72d19-f078-4d18-ac94-a05b48f1ca27 None None] MFA Rules not processed for user `2c7f2566918b4c719486d1ce285724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:02:59.231603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-66a72d19-f078-4d18-ac94-a05b48f1ca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:02:59.307586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:59.344863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 683/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:02:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:00.611772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f033e8-a1a5-4cbe-aa46-0cc3d908f5ae None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:00.612354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f033e8-a1a5-4cbe-aa46-0cc3d908f5ae None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:00.612451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f033e8-a1a5-4cbe-aa46-0cc3d908f5ae None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:00.613914 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 671/1354] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:00.619150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70858a91-19e9-47d2-aa15-2139cbee9c5f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:00.619565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70858a91-19e9-47d2-aa15-2139cbee9c5f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:00.619912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70858a91-19e9-47d2-aa15-2139cbee9c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:00.703279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-70858a91-19e9-47d2-aa15-2139cbee9c5f None None] MFA Rules not processed for user `2c7f2566918b4c719486d1ce285724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:00.704556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-70858a91-19e9-47d2-aa15-2139cbee9c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:00.818222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 684/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:03:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:04.557528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ffdfc-ddde-4464-bc63-f406a9c956dd None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:04.558196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ffdfc-ddde-4464-bc63-f406a9c956dd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:04.558307 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ffdfc-ddde-4464-bc63-f406a9c956dd None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:04.559748 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 672/1356] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:04.566060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c92aa-dc9c-4e3e-97bc-49242c8429a6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:04.566894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c92aa-dc9c-4e3e-97bc-49242c8429a6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:04.567142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c92aa-dc9c-4e3e-97bc-49242c8429a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:04.607887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:04.648053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5e8c92aa-dc9c-4e3e-97bc-49242c8429a6 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:04.649454 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5e8c92aa-dc9c-4e3e-97bc-49242c8429a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:04.774061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 685/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:05.082600 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a814259-30ca-4320-9af3-2f5645209b57 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:05.083146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a814259-30ca-4320-9af3-2f5645209b57 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:05.084020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a814259-30ca-4320-9af3-2f5645209b57 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:05.086288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 673/1358] 10.222.0.20 () {54 vars in 961 bytes} [Thu Sep 22 22:03:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:05.102359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c22a-ce83-4700-bf55-80f76cefe237 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:05.103130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c22a-ce83-4700-bf55-80f76cefe237 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:05.104421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c22a-ce83-4700-bf55-80f76cefe237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:05.190101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0576c22a-ce83-4700-bf55-80f76cefe237 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:05.191509 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0576c22a-ce83-4700-bf55-80f76cefe237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:05.245175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:05.329165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 686/1359] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Sep 22 22:03:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:05.337081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a814259-30ca-4320-9af3-2f5645209b57 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:05.338896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4a814259-30ca-4320-9af3-2f5645209b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:05.491687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a814259-30ca-4320-9af3-2f5645209b57 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:05.574225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:05.618745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b26d2-6783-4451-bd17-55005da5cefc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:05.619349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b26d2-6783-4451-bd17-55005da5cefc service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:05.619690 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b26d2-6783-4451-bd17-55005da5cefc service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:05.620022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b26d2-6783-4451-bd17-55005da5cefc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:05.621717 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-800b26d2-6783-4451-bd17-55005da5cefc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:05.726575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b26d2-6783-4451-bd17-55005da5cefc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:05.728263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b26d2-6783-4451-bd17-55005da5cefc service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:05.747606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 674/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:08.172565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35defa97-0440-43a5-a0b9-0dddcfc79726 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:08.173105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35defa97-0440-43a5-a0b9-0dddcfc79726 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:08.173105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35defa97-0440-43a5-a0b9-0dddcfc79726 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:08.174556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 687/1361] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:08.180021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a71d3-ca1a-4239-931a-9afb02d3e08b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:08.180502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a71d3-ca1a-4239-931a-9afb02d3e08b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:08.180597 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a71d3-ca1a-4239-931a-9afb02d3e08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:08.251256 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-364a71d3-ca1a-4239-931a-9afb02d3e08b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:08.252496 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-364a71d3-ca1a-4239-931a-9afb02d3e08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:08.294022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:08.365880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 675/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:08.662104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35defa97-0440-43a5-a0b9-0dddcfc79726 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:08.663733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-35defa97-0440-43a5-a0b9-0dddcfc79726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:08.845118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35defa97-0440-43a5-a0b9-0dddcfc79726 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:08.854263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:08.960711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627ca38-fd5a-453a-ac33-9bef06ee48d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:08.961248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627ca38-fd5a-453a-ac33-9bef06ee48d1 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:08.961523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627ca38-fd5a-453a-ac33-9bef06ee48d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:08.961815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627ca38-fd5a-453a-ac33-9bef06ee48d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:08.963469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b627ca38-fd5a-453a-ac33-9bef06ee48d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:09.058652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627ca38-fd5a-453a-ac33-9bef06ee48d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:09.060547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627ca38-fd5a-453a-ac33-9bef06ee48d1 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:09.078922 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 688/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:11.579100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bfa15-7cc4-45e2-a45c-4f692dd4467a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:11.579681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bfa15-7cc4-45e2-a45c-4f692dd4467a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:11.579681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bfa15-7cc4-45e2-a45c-4f692dd4467a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:11.581162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 676/1364] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:11.586594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5591d-0599-4acf-a538-9ca597d087ea None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:11.587071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5591d-0599-4acf-a538-9ca597d087ea None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:11.587162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5591d-0599-4acf-a538-9ca597d087ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:11.604478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:11.662133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1ab5591d-0599-4acf-a538-9ca597d087ea None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:11.663374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1ab5591d-0599-4acf-a538-9ca597d087ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:11.776085 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 689/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:12.061353 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e537-3f0d-4e02-b49c-c936c9298038 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:12.061659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e537-3f0d-4e02-b49c-c936c9298038 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:12.061892 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e537-3f0d-4e02-b49c-c936c9298038 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:12.063460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 677/1366] 10.222.0.20 () {54 vars in 961 bytes} [Thu Sep 22 22:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:12.068797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c804-0c38-4bd3-bf6d-dd6f16570231 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:12.069063 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c804-0c38-4bd3-bf6d-dd6f16570231 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:12.069349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c804-0c38-4bd3-bf6d-dd6f16570231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:12.152253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e442c804-0c38-4bd3-bf6d-dd6f16570231 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:12.153476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e442c804-0c38-4bd3-bf6d-dd6f16570231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:12.190585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:12.278497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 690/1367] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Sep 22 22:03:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:12.286528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4e537-3f0d-4e02-b49c-c936c9298038 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:12.288085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-99b4e537-3f0d-4e02-b49c-c936c9298038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:12.447219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4e537-3f0d-4e02-b49c-c936c9298038 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:12.475225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:12.566899 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed751e-beb1-47e7-9e22-b033eccd8c56 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:12.567096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed751e-beb1-47e7-9e22-b033eccd8c56 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:12.567330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed751e-beb1-47e7-9e22-b033eccd8c56 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:12.568813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 691/1368] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 22:03:12.573603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703d49-f488-4184-bf44-fe9b003427e2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:12.573901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703d49-f488-4184-bf44-fe9b003427e2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:12.574192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703d49-f488-4184-bf44-fe9b003427e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:12.580297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69340e-43fc-4113-ad5a-a770282da3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:12.581045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69340e-43fc-4113-ad5a-a770282da3d2 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:12.581425 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69340e-43fc-4113-ad5a-a770282da3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:12.581801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69340e-43fc-4113-ad5a-a770282da3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:12.583458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3c69340e-43fc-4113-ad5a-a770282da3d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:12.646192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3c703d49-f488-4184-bf44-fe9b003427e2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:12.647401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3c703d49-f488-4184-bf44-fe9b003427e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:12.687585 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69340e-43fc-4113-ad5a-a770282da3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:12.689327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69340e-43fc-4113-ad5a-a770282da3d2 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:12.719434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 678/1369] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:12.751944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:12.760626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 692/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:03:13.055342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f3b9-cc3a-4d0c-9f6f-d834b3ea7760 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:13.055631 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f3b9-cc3a-4d0c-9f6f-d834b3ea7760 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:13.055891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f3b9-cc3a-4d0c-9f6f-d834b3ea7760 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:13.057403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 679/1371] 10.222.0.20 () {54 vars in 963 bytes} [Thu Sep 22 22:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:13.062437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71f024-92d7-44a1-b598-f50c79260da8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:13.062719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71f024-92d7-44a1-b598-f50c79260da8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:13.062988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71f024-92d7-44a1-b598-f50c79260da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:13.143000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bf71f024-92d7-44a1-b598-f50c79260da8 None None] MFA Rules not processed for user `2c639dece626449b9153943b388e52c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:13.144120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bf71f024-92d7-44a1-b598-f50c79260da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:13.224458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 693/1372] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Sep 22 22:03:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:13.232141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f3b9-cc3a-4d0c-9f6f-d834b3ea7760 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:13.233676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-10e6f3b9-cc3a-4d0c-9f6f-d834b3ea7760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:13.271022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:13.356484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f3b9-cc3a-4d0c-9f6f-d834b3ea7760 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:13.433743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb87c1-a72d-4ccd-891a-f452681671d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:13.434294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb87c1-a72d-4ccd-891a-f452681671d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:13.434598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb87c1-a72d-4ccd-891a-f452681671d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:13.434812 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb87c1-a72d-4ccd-891a-f452681671d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:13.436476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-99cb87c1-a72d-4ccd-891a-f452681671d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:13.527910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:13.570303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb87c1-a72d-4ccd-891a-f452681671d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:13.571942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb87c1-a72d-4ccd-891a-f452681671d8 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:13.598119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 680/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:14.952110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec08b1-a436-4068-95db-6d3c76561fd3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:14.952678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec08b1-a436-4068-95db-6d3c76561fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:14.952678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec08b1-a436-4068-95db-6d3c76561fd3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:14.954044 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 694/1374] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:14.959752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc1fc-eebb-4843-aa0f-34482662d751 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:14.960169 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc1fc-eebb-4843-aa0f-34482662d751 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:14.960296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc1fc-eebb-4843-aa0f-34482662d751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:15.031576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-20dcc1fc-eebb-4843-aa0f-34482662d751 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:15.032807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-20dcc1fc-eebb-4843-aa0f-34482662d751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:15.138750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 681/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:15.427296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec08b1-a436-4068-95db-6d3c76561fd3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:15.428831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6fec08b1-a436-4068-95db-6d3c76561fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:15.519846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:15.586318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec08b1-a436-4068-95db-6d3c76561fd3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:15.709693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b9567-892c-4285-9edd-866e519a2470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:15.710357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9567-892c-4285-9edd-866e519a2470 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:15.710646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9567-892c-4285-9edd-866e519a2470 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:15.710920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9567-892c-4285-9edd-866e519a2470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:15.712545 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ba4b9567-892c-4285-9edd-866e519a2470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:15.765443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:15.812072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b9567-892c-4285-9edd-866e519a2470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:15.813497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b9567-892c-4285-9edd-866e519a2470 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:15.832185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 695/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:18.040740 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dadbd6-01b2-451a-ac84-188590647a40 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:18.042459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dadbd6-01b2-451a-ac84-188590647a40 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:18.042966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dadbd6-01b2-451a-ac84-188590647a40 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:18.044575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 682/1377] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:18.050198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6c5ea-c5ae-42ee-bb40-74f9bf2e2699 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:18.050636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6c5ea-c5ae-42ee-bb40-74f9bf2e2699 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:18.050931 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6c5ea-c5ae-42ee-bb40-74f9bf2e2699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:18.121210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-47f6c5ea-c5ae-42ee-bb40-74f9bf2e2699 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:18.122727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-47f6c5ea-c5ae-42ee-bb40-74f9bf2e2699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:18.225682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 696/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:18.509027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dadbd6-01b2-451a-ac84-188590647a40 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:18.510738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-64dadbd6-01b2-451a-ac84-188590647a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:18.553535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:18.670821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dadbd6-01b2-451a-ac84-188590647a40 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:18.797893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:18.804035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc81b-04b8-40af-a425-242a0903119e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:18.804654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc81b-04b8-40af-a425-242a0903119e service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:18.804916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc81b-04b8-40af-a425-242a0903119e service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:18.806268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc81b-04b8-40af-a425-242a0903119e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:18.808441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3c7cc81b-04b8-40af-a425-242a0903119e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:18.908367 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cc81b-04b8-40af-a425-242a0903119e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:18.910340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cc81b-04b8-40af-a425-242a0903119e service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:18.932499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 683/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:21.124493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64ac51-3819-4add-b32a-ea6f209359b9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:21.124493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64ac51-3819-4add-b32a-ea6f209359b9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:21.124493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64ac51-3819-4add-b32a-ea6f209359b9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:21.125510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 697/1380] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:21.131694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d40468-3067-41a4-86ed-e73cc9e19ae0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:21.131694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d40468-3067-41a4-86ed-e73cc9e19ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:21.132477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d40468-3067-41a4-86ed-e73cc9e19ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:21.207523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-36d40468-3067-41a4-86ed-e73cc9e19ae0 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:21.208829 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-36d40468-3067-41a4-86ed-e73cc9e19ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:21.279617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:21.314567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 684/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:03:21.648085 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64ac51-3819-4add-b32a-ea6f209359b9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:21.649741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7e64ac51-3819-4add-b32a-ea6f209359b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:21.683993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:21.825424 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64ac51-3819-4add-b32a-ea6f209359b9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:21.937756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:21.958419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94544ad-469f-42de-9ecb-5e77407a7837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:21.959150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94544ad-469f-42de-9ecb-5e77407a7837 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:21.959496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94544ad-469f-42de-9ecb-5e77407a7837 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:21.959857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94544ad-469f-42de-9ecb-5e77407a7837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:21.961883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b94544ad-469f-42de-9ecb-5e77407a7837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:22.068626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94544ad-469f-42de-9ecb-5e77407a7837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:22.070732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94544ad-469f-42de-9ecb-5e77407a7837 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:22.093610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 698/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:24.356256 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f0c8-298e-44b7-812b-c4bea9a528b1 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:24.356847 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f0c8-298e-44b7-812b-c4bea9a528b1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:24.356847 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f0c8-298e-44b7-812b-c4bea9a528b1 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:24.358776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 685/1383] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:24.367310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d31d3-3413-4186-a3f4-36c7637329ba None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:24.367868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d31d3-3413-4186-a3f4-36c7637329ba None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:24.367868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d31d3-3413-4186-a3f4-36c7637329ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:24.441858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-492d31d3-3413-4186-a3f4-36c7637329ba None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:24.443131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-492d31d3-3413-4186-a3f4-36c7637329ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:24.522252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:24.566884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 699/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:24.849652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0f0c8-298e-44b7-812b-c4bea9a528b1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:24.851228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-56f0f0c8-298e-44b7-812b-c4bea9a528b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:25.041101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0f0c8-298e-44b7-812b-c4bea9a528b1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:25.097462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:25.173405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c830931-61a3-466e-9f11-9c31d3e8bcff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:25.174073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c830931-61a3-466e-9f11-9c31d3e8bcff service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:25.174365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c830931-61a3-466e-9f11-9c31d3e8bcff service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:25.174648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c830931-61a3-466e-9f11-9c31d3e8bcff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:25.176332 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6c830931-61a3-466e-9f11-9c31d3e8bcff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:25.277888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c830931-61a3-466e-9f11-9c31d3e8bcff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:25.280319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c830931-61a3-466e-9f11-9c31d3e8bcff service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:25.302951 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 686/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:27.726876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330bba7-195d-411e-8cf0-5fccc45fc211 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:27.727392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330bba7-195d-411e-8cf0-5fccc45fc211 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:27.727491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330bba7-195d-411e-8cf0-5fccc45fc211 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:27.728840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 700/1386] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:27.734714 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cbfc9-d46a-41c3-acc6-88ca00cc2513 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:27.735151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cbfc9-d46a-41c3-acc6-88ca00cc2513 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:27.735394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cbfc9-d46a-41c3-acc6-88ca00cc2513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:27.804562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-283cbfc9-d46a-41c3-acc6-88ca00cc2513 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:27.805777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-283cbfc9-d46a-41c3-acc6-88ca00cc2513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:27.814634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:27.907133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 687/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:28.208066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330bba7-195d-411e-8cf0-5fccc45fc211 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:28.210021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5330bba7-195d-411e-8cf0-5fccc45fc211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:28.371398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330bba7-195d-411e-8cf0-5fccc45fc211 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:28.432610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:28.502097 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de96499-17c8-46e4-8da5-4b0dff3f843a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:28.502725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de96499-17c8-46e4-8da5-4b0dff3f843a service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:28.502999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de96499-17c8-46e4-8da5-4b0dff3f843a service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:28.503263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de96499-17c8-46e4-8da5-4b0dff3f843a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:28.505095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6de96499-17c8-46e4-8da5-4b0dff3f843a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:28.597986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de96499-17c8-46e4-8da5-4b0dff3f843a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:28.599612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de96499-17c8-46e4-8da5-4b0dff3f843a service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:28.617703 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 701/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:28.852353 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d01746-92c3-4a44-8e2d-80cdda64c104 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:28.852903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d01746-92c3-4a44-8e2d-80cdda64c104 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:28.852903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d01746-92c3-4a44-8e2d-80cdda64c104 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:28.854402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 688/1389] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:28.861246 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb5b4-c9a7-4247-99d1-b572f5a6b687 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:28.861790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb5b4-c9a7-4247-99d1-b572f5a6b687 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:28.861790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb5b4-c9a7-4247-99d1-b572f5a6b687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:28.926764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:28.929986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7cceb5b4-c9a7-4247-99d1-b572f5a6b687 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:28.931929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7cceb5b4-c9a7-4247-99d1-b572f5a6b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:29.030380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 702/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:29.325238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de761-681e-4a0e-8248-d1281510f8fe None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:29.325517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de761-681e-4a0e-8248-d1281510f8fe None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:29.325783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de761-681e-4a0e-8248-d1281510f8fe None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:29.327150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 689/1391] 10.222.0.20 () {54 vars in 962 bytes} [Thu Sep 22 22:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:29.332527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c17ee-d696-4c27-88bb-99d81701563f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:29.332787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c17ee-d696-4c27-88bb-99d81701563f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:29.333078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c17ee-d696-4c27-88bb-99d81701563f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:29.413829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-104c17ee-d696-4c27-88bb-99d81701563f None None] MFA Rules not processed for user `d22e60fc95af4a0a94b15f9ed9e3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:29.415044 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-104c17ee-d696-4c27-88bb-99d81701563f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:29.488274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:29.494753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 703/1392] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Sep 22 22:03:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:03:29.503384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de761-681e-4a0e-8248-d1281510f8fe None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:29.504908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-371de761-681e-4a0e-8248-d1281510f8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:29.612542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de761-681e-4a0e-8248-d1281510f8fe None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:29.650415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:29.687982 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a170e8e-653b-486a-a465-d9164ba7623f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22e60fc95af4a0a94b15f9ed9e3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:29.688583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170e8e-653b-486a-a465-d9164ba7623f service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:29.688851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170e8e-653b-486a-a465-d9164ba7623f service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:29.689114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170e8e-653b-486a-a465-d9164ba7623f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:29.690743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7a170e8e-653b-486a-a465-d9164ba7623f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:29.812608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a170e8e-653b-486a-a465-d9164ba7623f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:29.814097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a170e8e-653b-486a-a465-d9164ba7623f service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:29.833398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 690/1393] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:30.632382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca9d2-7e55-4989-9c8a-2811e864f9ab None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:30.632964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca9d2-7e55-4989-9c8a-2811e864f9ab None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:30.632964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca9d2-7e55-4989-9c8a-2811e864f9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:30.710988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0dcca9d2-7e55-4989-9c8a-2811e864f9ab None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:30.712329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0dcca9d2-7e55-4989-9c8a-2811e864f9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:30.808752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 704/1394] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:03:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:30.821791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c610c5c-e924-4a37-9dc6-03210648011a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:30.822653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c610c5c-e924-4a37-9dc6-03210648011a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:30.823123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c610c5c-e924-4a37-9dc6-03210648011a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:30.824898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 691/1395] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:30.830968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583826-c0ce-48b0-ac25-ee3528290524 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:30.831054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583826-c0ce-48b0-ac25-ee3528290524 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:30.831419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583826-c0ce-48b0-ac25-ee3528290524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:30.856986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014cf0-ba6c-4e98-b83c-ce4990d5e657 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:30.857278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014cf0-ba6c-4e98-b83c-ce4990d5e657 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:30.857517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014cf0-ba6c-4e98-b83c-ce4990d5e657 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:30.859454 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 692/1396] 10.222.0.20 () {54 vars in 943 bytes} [Thu Sep 22 22:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 22:03:30.866227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e528204-069d-4f7b-aa62-c7c2a4ee78b2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:30.866502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e528204-069d-4f7b-aa62-c7c2a4ee78b2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:30.866769 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e528204-069d-4f7b-aa62-c7c2a4ee78b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:30.910465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f5583826-c0ce-48b0-ac25-ee3528290524 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:30.912184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f5583826-c0ce-48b0-ac25-ee3528290524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:30.946177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4e528204-069d-4f7b-aa62-c7c2a4ee78b2 None None] MFA Rules not processed for user `f9967ef46a464ff2b5f7e4c459f8abd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:30.947399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4e528204-069d-4f7b-aa62-c7c2a4ee78b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:30.948748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:30.956360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:31.013141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 705/1397] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:31.059062 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 693/1398] 10.222.0.20 () {58 vars in 1040 bytes} [Thu Sep 22 22:03:30 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:03:31.068677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5583826-c0ce-48b0-ac25-ee3528290524 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:31.069995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f5583826-c0ce-48b0-ac25-ee3528290524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:31.175548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5583826-c0ce-48b0-ac25-ee3528290524 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:31.237471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:31.281960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9710e-869a-4b4c-a630-ab77aad0b613 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:31.282575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9710e-869a-4b4c-a630-ab77aad0b613 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:31.282842 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9710e-869a-4b4c-a630-ab77aad0b613 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:31.283106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9710e-869a-4b4c-a630-ab77aad0b613 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:31.284720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-75f9710e-869a-4b4c-a630-ab77aad0b613 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:31.303038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e528204-069d-4f7b-aa62-c7c2a4ee78b2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:31.304294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4e528204-069d-4f7b-aa62-c7c2a4ee78b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:31.376544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9710e-869a-4b4c-a630-ab77aad0b613 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:31.378109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9710e-869a-4b4c-a630-ab77aad0b613 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:31.389284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 706/1399] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:03:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:03:31.411455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e528204-069d-4f7b-aa62-c7c2a4ee78b2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:31.446793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:31.572067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa6f57-61e4-47fb-87bd-7761f0f12a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:31.573031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa6f57-61e4-47fb-87bd-7761f0f12a15 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:31.573467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa6f57-61e4-47fb-87bd-7761f0f12a15 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:31.573728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa6f57-61e4-47fb-87bd-7761f0f12a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:31.575650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ebfa6f57-61e4-47fb-87bd-7761f0f12a15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:31.674981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa6f57-61e4-47fb-87bd-7761f0f12a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:31.676993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa6f57-61e4-47fb-87bd-7761f0f12a15 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:31.696334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 694/1400] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:33.988307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf552e-9fb6-4ba7-adb8-5a966df27ba2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:33.988917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf552e-9fb6-4ba7-adb8-5a966df27ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:33.989022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf552e-9fb6-4ba7-adb8-5a966df27ba2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:33.990785 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 707/1401] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:33.995884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4bb68-e7c6-4b44-bcdb-5beae83ce90c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:33.996397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4bb68-e7c6-4b44-bcdb-5beae83ce90c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:33.996397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4bb68-e7c6-4b44-bcdb-5beae83ce90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:34.044838 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:34.073304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-91a4bb68-e7c6-4b44-bcdb-5beae83ce90c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:34.074565 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-91a4bb68-e7c6-4b44-bcdb-5beae83ce90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:34.189996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 695/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:34.477110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf552e-9fb6-4ba7-adb8-5a966df27ba2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:34.478668 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f4cf552e-9fb6-4ba7-adb8-5a966df27ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:34.581119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:34.638591 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf552e-9fb6-4ba7-adb8-5a966df27ba2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:34.770555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372d0d0-17df-4f9a-99a5-5fe6cad942ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:34.771732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372d0d0-17df-4f9a-99a5-5fe6cad942ec service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:34.771732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372d0d0-17df-4f9a-99a5-5fe6cad942ec service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:34.771732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372d0d0-17df-4f9a-99a5-5fe6cad942ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:34.773335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5372d0d0-17df-4f9a-99a5-5fe6cad942ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:34.843393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:34.874926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372d0d0-17df-4f9a-99a5-5fe6cad942ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:34.881996 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372d0d0-17df-4f9a-99a5-5fe6cad942ec service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:34.904995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 708/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:37.115240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e809e0b-c0e2-4296-bafb-c63374350715 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:37.115854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e809e0b-c0e2-4296-bafb-c63374350715 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:37.115854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e809e0b-c0e2-4296-bafb-c63374350715 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:37.117280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 696/1404] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:37.122546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992902-ed3e-4426-b67d-c98f7aefa506 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:37.122981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992902-ed3e-4426-b67d-c98f7aefa506 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:37.123090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992902-ed3e-4426-b67d-c98f7aefa506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:37.196613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-88992902-ed3e-4426-b67d-c98f7aefa506 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:37.197890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-88992902-ed3e-4426-b67d-c98f7aefa506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:37.306061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 709/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:37.591926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e809e0b-c0e2-4296-bafb-c63374350715 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:37.594069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9e809e0b-c0e2-4296-bafb-c63374350715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:37.723516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:37.765494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e809e0b-c0e2-4296-bafb-c63374350715 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:37.893526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de33a4e-003e-46b0-90cc-cf41bdd19628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:37.894044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33a4e-003e-46b0-90cc-cf41bdd19628 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:37.894320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33a4e-003e-46b0-90cc-cf41bdd19628 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:37.894582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33a4e-003e-46b0-90cc-cf41bdd19628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:37.896232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1de33a4e-003e-46b0-90cc-cf41bdd19628 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:37.980443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:37.994876 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de33a4e-003e-46b0-90cc-cf41bdd19628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:37.996509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de33a4e-003e-46b0-90cc-cf41bdd19628 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:38.018845 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 697/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:40.219930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1313e-1733-46cb-95f8-ea7dee3230d0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:40.220519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1313e-1733-46cb-95f8-ea7dee3230d0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:40.220519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1313e-1733-46cb-95f8-ea7dee3230d0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:40.221887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 710/1407] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:40.227446 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26d1ac-4516-475d-9553-1b4687164b26 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:40.227926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26d1ac-4516-475d-9553-1b4687164b26 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:40.228036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26d1ac-4516-475d-9553-1b4687164b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:40.299015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-dd26d1ac-4516-475d-9553-1b4687164b26 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:40.300266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-dd26d1ac-4516-475d-9553-1b4687164b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:40.409927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 698/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:40.701988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1313e-1733-46cb-95f8-ea7dee3230d0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:40.702700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-98c1313e-1733-46cb-95f8-ea7dee3230d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:40.747843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:40.861235 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1313e-1733-46cb-95f8-ea7dee3230d0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:40.986081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:40.988259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f09f2e-7890-4f64-b510-44e748b4a7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:40.989045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f09f2e-7890-4f64-b510-44e748b4a7c8 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:40.989302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f09f2e-7890-4f64-b510-44e748b4a7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:40.989515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f09f2e-7890-4f64-b510-44e748b4a7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:40.991653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-60f09f2e-7890-4f64-b510-44e748b4a7c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:41.083841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f09f2e-7890-4f64-b510-44e748b4a7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:41.085446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f09f2e-7890-4f64-b510-44e748b4a7c8 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:41.104762 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 711/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:50.412169 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=76 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:51.102212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=46 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:53.863354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f089ec-0d19-41f4-9de7-7815e506ae79 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:53.863957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f089ec-0d19-41f4-9de7-7815e506ae79 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:53.863957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f089ec-0d19-41f4-9de7-7815e506ae79 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:53.865237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 699/1410] 10.222.0.20 () {54 vars in 918 bytes} [Thu Sep 22 22:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:53.870570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28093797-59f0-4050-80a8-ec2ff33345a5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:53.871074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28093797-59f0-4050-80a8-ec2ff33345a5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:53.871177 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28093797-59f0-4050-80a8-ec2ff33345a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:53.949213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-28093797-59f0-4050-80a8-ec2ff33345a5 None None] MFA Rules not processed for user `2c7f2566918b4c719486d1ce285724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:53.950475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-28093797-59f0-4050-80a8-ec2ff33345a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:54.061406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 712/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Sep 22 22:03:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:54.078308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc66b9-36d0-427a-a6ef-faa508e45989 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:54.078614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc66b9-36d0-427a-a6ef-faa508e45989 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:54.078964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc66b9-36d0-427a-a6ef-faa508e45989 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:54.081067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 700/1412] 10.222.0.20 () {54 vars in 918 bytes} [Thu Sep 22 22:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:54.087982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1f734-9449-4f07-8430-1395c55da6e8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:54.088265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1f734-9449-4f07-8430-1395c55da6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:54.088548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1f734-9449-4f07-8430-1395c55da6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:54.166252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:54.169767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d8e1f734-9449-4f07-8430-1395c55da6e8 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:54.171806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d8e1f734-9449-4f07-8430-1395c55da6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:54.305724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 713/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Sep 22 22:03:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:56.908020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea550c85-71c5-4fc0-8826-3a90db406d9c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:56.908936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea550c85-71c5-4fc0-8826-3a90db406d9c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:56.908936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea550c85-71c5-4fc0-8826-3a90db406d9c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:56.911020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:03:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:56.919988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e1e11-05ce-4c1e-89f4-46bdf7d8b7d8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:56.920431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e1e11-05ce-4c1e-89f4-46bdf7d8b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:56.920539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e1e11-05ce-4c1e-89f4-46bdf7d8b7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:56.994015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7c9e1e11-05ce-4c1e-89f4-46bdf7d8b7d8 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:56.995216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7c9e1e11-05ce-4c1e-89f4-46bdf7d8b7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:57.054760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:57.099863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:57.396228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea550c85-71c5-4fc0-8826-3a90db406d9c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:57.397935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ea550c85-71c5-4fc0-8826-3a90db406d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:57.554469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea550c85-71c5-4fc0-8826-3a90db406d9c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:57.645436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:57.685282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f8f42-9b19-4986-8830-88b9afec5858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:57.685920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8f42-9b19-4986-8830-88b9afec5858 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:57.686184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8f42-9b19-4986-8830-88b9afec5858 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:57.686441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8f42-9b19-4986-8830-88b9afec5858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:57.688069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e59f8f42-9b19-4986-8830-88b9afec5858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:57.793235 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f8f42-9b19-4986-8830-88b9afec5858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:57.794863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f8f42-9b19-4986-8830-88b9afec5858 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:57.814564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 702/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:58.982845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6d84-6f51-453c-900d-d87c0a0ba350 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:58.983702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6d84-6f51-453c-900d-d87c0a0ba350 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:58.983702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6d84-6f51-453c-900d-d87c0a0ba350 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:58.985589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:03:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:03:58.992625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68a380-7d4e-426c-9c00-b090841d3b8d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:58.993110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68a380-7d4e-426c-9c00-b090841d3b8d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:58.993110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68a380-7d4e-426c-9c00-b090841d3b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:59.071433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-aa68a380-7d4e-426c-9c00-b090841d3b8d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:03:59.072633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-aa68a380-7d4e-426c-9c00-b090841d3b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:59.107464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:59.185998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:03:59.339976 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d6d84-6f51-453c-900d-d87c0a0ba350 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:03:59.342438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-359d6d84-6f51-453c-900d-d87c0a0ba350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:59.497376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d6d84-6f51-453c-900d-d87c0a0ba350 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:03:59.540532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:59.617713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2175ef-d88a-4ec7-a3d1-e0405928a88e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:03:59.618280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2175ef-d88a-4ec7-a3d1-e0405928a88e service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:03:59.618523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2175ef-d88a-4ec7-a3d1-e0405928a88e service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:03:59.618790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2175ef-d88a-4ec7-a3d1-e0405928a88e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:03:59.620379 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7e2175ef-d88a-4ec7-a3d1-e0405928a88e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:03:59.719239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2175ef-d88a-4ec7-a3d1-e0405928a88e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:03:59.720852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2175ef-d88a-4ec7-a3d1-e0405928a88e service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:03:59.739156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 716/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:00.888434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101e19-4033-40e6-8a64-2a05c969f7ef None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:00.889035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101e19-4033-40e6-8a64-2a05c969f7ef None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:00.889035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101e19-4033-40e6-8a64-2a05c969f7ef None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:00.890316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:00.896801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c56812-7740-41e3-9220-a6145ac0d879 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:00.897294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c56812-7740-41e3-9220-a6145ac0d879 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:00.897294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c56812-7740-41e3-9220-a6145ac0d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:00.964901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:00.989244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-48c56812-7740-41e3-9220-a6145ac0d879 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:00.990493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-48c56812-7740-41e3-9220-a6145ac0d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:01.097982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:01.252132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea101e19-4033-40e6-8a64-2a05c969f7ef None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:01.254382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ea101e19-4033-40e6-8a64-2a05c969f7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:01.421566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea101e19-4033-40e6-8a64-2a05c969f7ef None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:01.433845 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:01.538731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50539a63-b6bd-472f-8f00-dfb80cf58d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:01.539254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50539a63-b6bd-472f-8f00-dfb80cf58d8c service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:01.539528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50539a63-b6bd-472f-8f00-dfb80cf58d8c service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:01.539801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50539a63-b6bd-472f-8f00-dfb80cf58d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:01.541422 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-50539a63-b6bd-472f-8f00-dfb80cf58d8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:01.637937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50539a63-b6bd-472f-8f00-dfb80cf58d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:01.639557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50539a63-b6bd-472f-8f00-dfb80cf58d8c service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:01.658763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 705/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:02.774542 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d3236-8ae8-414f-a20c-7d8a484c8196 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:02.775423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d3236-8ae8-414f-a20c-7d8a484c8196 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:02.775423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d3236-8ae8-414f-a20c-7d8a484c8196 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:02.777590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:04:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:02.784488 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abc8b2-cb06-4daf-b880-a4d97af2fd9c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:02.784973 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abc8b2-cb06-4daf-b880-a4d97af2fd9c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:02.785070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abc8b2-cb06-4daf-b880-a4d97af2fd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:02.806095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:02.879119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-35abc8b2-cb06-4daf-b880-a4d97af2fd9c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:02.880315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-35abc8b2-cb06-4daf-b880-a4d97af2fd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:02.991544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:03.145637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d3236-8ae8-414f-a20c-7d8a484c8196 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:03.148091 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-984d3236-8ae8-414f-a20c-7d8a484c8196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:03.271617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:03.309244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d3236-8ae8-414f-a20c-7d8a484c8196 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:03.430697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61405d-874d-48d5-a63d-b615b3edd838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:03.431305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61405d-874d-48d5-a63d-b615b3edd838 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:03.431577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61405d-874d-48d5-a63d-b615b3edd838 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:03.431841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61405d-874d-48d5-a63d-b615b3edd838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:03.433432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8c61405d-874d-48d5-a63d-b615b3edd838 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:03.528699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:03.544091 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61405d-874d-48d5-a63d-b615b3edd838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:03.545711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61405d-874d-48d5-a63d-b615b3edd838 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:03.565638 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 719/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:04.712872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9782f-1812-49b5-aa20-78f1dabe44f0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:04.713571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9782f-1812-49b5-aa20-78f1dabe44f0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:04.713571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9782f-1812-49b5-aa20-78f1dabe44f0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:04.714786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:04.723311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e426dd-1bc3-4dca-9d41-28efa5bb806d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:04.723825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e426dd-1bc3-4dca-9d41-28efa5bb806d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:04.723929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e426dd-1bc3-4dca-9d41-28efa5bb806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:04.808519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e0e426dd-1bc3-4dca-9d41-28efa5bb806d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:04.809731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e0e426dd-1bc3-4dca-9d41-28efa5bb806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:04.910130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:05.060919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9782f-1812-49b5-aa20-78f1dabe44f0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:05.063719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0cd9782f-1812-49b5-aa20-78f1dabe44f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:05.154074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:05.218757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9782f-1812-49b5-aa20-78f1dabe44f0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:05.341559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c37c9-d7f3-4413-b35c-1300496bbc44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:05.342120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c37c9-d7f3-4413-b35c-1300496bbc44 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:05.342371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c37c9-d7f3-4413-b35c-1300496bbc44 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:05.342662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c37c9-d7f3-4413-b35c-1300496bbc44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:05.344702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-739c37c9-d7f3-4413-b35c-1300496bbc44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:05.397593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:05.441411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c37c9-d7f3-4413-b35c-1300496bbc44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:05.443057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c37c9-d7f3-4413-b35c-1300496bbc44 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:05.461086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 708/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:06.528129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89c295-1d12-43ba-b4d3-ea253e8eeba9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:06.528730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89c295-1d12-43ba-b4d3-ea253e8eeba9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:06.528730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89c295-1d12-43ba-b4d3-ea253e8eeba9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:06.530729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:04:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:06.538603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13742539-122e-44f9-a39b-0a70802a76e7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:06.539076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13742539-122e-44f9-a39b-0a70802a76e7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:06.539185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13742539-122e-44f9-a39b-0a70802a76e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:06.626574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-13742539-122e-44f9-a39b-0a70802a76e7 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:06.627802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-13742539-122e-44f9-a39b-0a70802a76e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:06.731982 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:06.888076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89c295-1d12-43ba-b4d3-ea253e8eeba9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:06.890682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6a89c295-1d12-43ba-b4d3-ea253e8eeba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:06.948943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:07.050437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89c295-1d12-43ba-b4d3-ea253e8eeba9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:07.167211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a900828-9e93-42c3-ab84-6cc5ab08a3f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:07.167845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900828-9e93-42c3-ab84-6cc5ab08a3f2 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:07.168087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900828-9e93-42c3-ab84-6cc5ab08a3f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:07.168356 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900828-9e93-42c3-ab84-6cc5ab08a3f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:07.170002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2a900828-9e93-42c3-ab84-6cc5ab08a3f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:07.177159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:07.264412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a900828-9e93-42c3-ab84-6cc5ab08a3f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:07.266104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a900828-9e93-42c3-ab84-6cc5ab08a3f2 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:07.285410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 722/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:08.354282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ecdeb-3a9d-4153-8bda-0d73bbb0a9cf None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:08.355111 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ecdeb-3a9d-4153-8bda-0d73bbb0a9cf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:08.355111 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ecdeb-3a9d-4153-8bda-0d73bbb0a9cf None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:08.356015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:08.363331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552ca58-d53a-4101-b7e9-0bb10989c9a0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:08.364256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552ca58-d53a-4101-b7e9-0bb10989c9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:08.364256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552ca58-d53a-4101-b7e9-0bb10989c9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:08.465051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6552ca58-d53a-4101-b7e9-0bb10989c9a0 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:08.466346 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6552ca58-d53a-4101-b7e9-0bb10989c9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:08.554196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:08.587182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:08.742657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ecdeb-3a9d-4153-8bda-0d73bbb0a9cf None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:08.745002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6b6ecdeb-3a9d-4153-8bda-0d73bbb0a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:08.774167 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:08.923845 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ecdeb-3a9d-4153-8bda-0d73bbb0a9cf None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:09.023524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:09.051328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7699654-8cbb-48d2-bdaf-59c16760e237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:09.051932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7699654-8cbb-48d2-bdaf-59c16760e237 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:09.052197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7699654-8cbb-48d2-bdaf-59c16760e237 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:09.052460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7699654-8cbb-48d2-bdaf-59c16760e237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:09.054045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d7699654-8cbb-48d2-bdaf-59c16760e237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:09.147036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7699654-8cbb-48d2-bdaf-59c16760e237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:09.148617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7699654-8cbb-48d2-bdaf-59c16760e237 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:09.166614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 711/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:10.223336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae75c19-1200-44bc-84f4-c7eebaec7f08 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:10.223959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae75c19-1200-44bc-84f4-c7eebaec7f08 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:10.223959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae75c19-1200-44bc-84f4-c7eebaec7f08 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:10.225242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:10.232700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c56ce-9aeb-4f66-a648-e9b7cae62ec4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:10.233477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c56ce-9aeb-4f66-a648-e9b7cae62ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:10.233617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c56ce-9aeb-4f66-a648-e9b7cae62ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:10.329894 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-841c56ce-9aeb-4f66-a648-e9b7cae62ec4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:10.331010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-841c56ce-9aeb-4f66-a648-e9b7cae62ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:10.379055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:10.438604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:10.596128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae75c19-1200-44bc-84f4-c7eebaec7f08 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:10.598794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9ae75c19-1200-44bc-84f4-c7eebaec7f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:10.758822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae75c19-1200-44bc-84f4-c7eebaec7f08 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:10.820685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:10.887572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279a35e-6144-4972-8500-4adfa8dc44b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:10.888102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279a35e-6144-4972-8500-4adfa8dc44b1 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:10.888371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279a35e-6144-4972-8500-4adfa8dc44b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:10.888641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279a35e-6144-4972-8500-4adfa8dc44b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:10.890280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d279a35e-6144-4972-8500-4adfa8dc44b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:10.992248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279a35e-6144-4972-8500-4adfa8dc44b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:10.995068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279a35e-6144-4972-8500-4adfa8dc44b1 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:11.015977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 725/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:12.077665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9e37-a5b6-4259-a1de-1e2e651a1bfe None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:12.078154 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9e37-a5b6-4259-a1de-1e2e651a1bfe None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:12.078247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9e37-a5b6-4259-a1de-1e2e651a1bfe None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:12.079931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:12.086639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a09ed8-e146-463a-820a-5f43e9408f01 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:12.087124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a09ed8-e146-463a-820a-5f43e9408f01 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:12.087230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a09ed8-e146-463a-820a-5f43e9408f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:12.177415 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-16a09ed8-e146-463a-820a-5f43e9408f01 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:12.178671 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-16a09ed8-e146-463a-820a-5f43e9408f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:12.180654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:12.285692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:12.441011 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc9e37-a5b6-4259-a1de-1e2e651a1bfe None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:12.443418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e1bc9e37-a5b6-4259-a1de-1e2e651a1bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:12.609822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc9e37-a5b6-4259-a1de-1e2e651a1bfe None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:12.643155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:12.741109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693468fa-5ebd-4614-b86d-6a61f4a0e0ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:12.741731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693468fa-5ebd-4614-b86d-6a61f4a0e0ca service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:12.742036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693468fa-5ebd-4614-b86d-6a61f4a0e0ca service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:12.742305 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693468fa-5ebd-4614-b86d-6a61f4a0e0ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:12.743922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-693468fa-5ebd-4614-b86d-6a61f4a0e0ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:12.855307 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693468fa-5ebd-4614-b86d-6a61f4a0e0ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:12.856921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693468fa-5ebd-4614-b86d-6a61f4a0e0ca service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:12.876159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 714/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:14.977667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529077c1-f484-448b-acbc-0d1ce0ee6e2e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:14.978233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529077c1-f484-448b-acbc-0d1ce0ee6e2e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:14.978233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529077c1-f484-448b-acbc-0d1ce0ee6e2e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:14.980392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:04:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:14.989650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23444-976f-49fa-a133-aee6a0d61f22 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:14.990156 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23444-976f-49fa-a133-aee6a0d61f22 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:14.990270 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23444-976f-49fa-a133-aee6a0d61f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:15.041761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:15.069688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-97d23444-976f-49fa-a133-aee6a0d61f22 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:15.070939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-97d23444-976f-49fa-a133-aee6a0d61f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:15.177360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:15.471247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529077c1-f484-448b-acbc-0d1ce0ee6e2e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:15.473635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-529077c1-f484-448b-acbc-0d1ce0ee6e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:15.606414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529077c1-f484-448b-acbc-0d1ce0ee6e2e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:15.640800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:15.692064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db042054-c07a-4602-b5a3-f80f331abca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:15.692679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042054-c07a-4602-b5a3-f80f331abca8 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:15.692953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042054-c07a-4602-b5a3-f80f331abca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:15.693221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042054-c07a-4602-b5a3-f80f331abca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:15.694867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-db042054-c07a-4602-b5a3-f80f331abca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:15.810991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db042054-c07a-4602-b5a3-f80f331abca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:15.812422 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db042054-c07a-4602-b5a3-f80f331abca8 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:15.832852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 728/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:18.138616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301644e-9f1f-4959-a018-3498083a2e1c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:18.139179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301644e-9f1f-4959-a018-3498083a2e1c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:18.139179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301644e-9f1f-4959-a018-3498083a2e1c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:18.141146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:04:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:18.147131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc257d6-d9f4-4461-b309-a9311f88e192 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:18.147567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc257d6-d9f4-4461-b309-a9311f88e192 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:18.147677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc257d6-d9f4-4461-b309-a9311f88e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:18.228865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5bc257d6-d9f4-4461-b309-a9311f88e192 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:18.230129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5bc257d6-d9f4-4461-b309-a9311f88e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:18.243441 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:18.331014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:18.620609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301644e-9f1f-4959-a018-3498083a2e1c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:18.623157 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b301644e-9f1f-4959-a018-3498083a2e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:18.738361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301644e-9f1f-4959-a018-3498083a2e1c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:18.752516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:18.816459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6399fcf-8c2c-444a-b5fc-18c46cb7fa50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:18.817088 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6399fcf-8c2c-444a-b5fc-18c46cb7fa50 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:18.817372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6399fcf-8c2c-444a-b5fc-18c46cb7fa50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:18.817638 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6399fcf-8c2c-444a-b5fc-18c46cb7fa50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:18.819285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b6399fcf-8c2c-444a-b5fc-18c46cb7fa50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:18.951315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6399fcf-8c2c-444a-b5fc-18c46cb7fa50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:18.952667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6399fcf-8c2c-444a-b5fc-18c46cb7fa50 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:18.972152 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 717/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:21.468856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c458-a44c-437b-ac41-2d0ca46d5926 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:21.469428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c458-a44c-437b-ac41-2d0ca46d5926 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:21.469428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c458-a44c-437b-ac41-2d0ca46d5926 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:21.470848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:21.477351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bddc5-51a1-41bf-abd4-a64b6cf3b13c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:21.478104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bddc5-51a1-41bf-abd4-a64b6cf3b13c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:21.478290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bddc5-51a1-41bf-abd4-a64b6cf3b13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:21.539266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:21.557862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3b3bddc5-51a1-41bf-abd4-a64b6cf3b13c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:21.559068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3b3bddc5-51a1-41bf-abd4-a64b6cf3b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:21.670287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:21.965453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c458-a44c-437b-ac41-2d0ca46d5926 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:21.967959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8dc9c458-a44c-437b-ac41-2d0ca46d5926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:22.089157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c458-a44c-437b-ac41-2d0ca46d5926 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:22.131456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:22.167984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d3b62-c42c-4903-8be3-d855ee1f2d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:22.168597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d3b62-c42c-4903-8be3-d855ee1f2d8d service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:22.168870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d3b62-c42c-4903-8be3-d855ee1f2d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:22.169135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d3b62-c42c-4903-8be3-d855ee1f2d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:22.170766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7f8d3b62-c42c-4903-8be3-d855ee1f2d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:22.282222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d3b62-c42c-4903-8be3-d855ee1f2d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:22.283834 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d3b62-c42c-4903-8be3-d855ee1f2d8d service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:22.311062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 731/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:24.569593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed3d0a-4805-4326-9cd4-c0b5a2434f4a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:24.570230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed3d0a-4805-4326-9cd4-c0b5a2434f4a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:24.570230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed3d0a-4805-4326-9cd4-c0b5a2434f4a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:24.571518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:24.577911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3afb7-ec7e-4f88-a82a-6c592357b91a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:24.578621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3afb7-ec7e-4f88-a82a-6c592357b91a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:24.578808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3afb7-ec7e-4f88-a82a-6c592357b91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:24.793017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-73c3afb7-ec7e-4f88-a82a-6c592357b91a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:24.794297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-73c3afb7-ec7e-4f88-a82a-6c592357b91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:24.816009 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:24.903754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:25.190052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed3d0a-4805-4326-9cd4-c0b5a2434f4a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:25.192577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-caed3d0a-4805-4326-9cd4-c0b5a2434f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:25.312668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed3d0a-4805-4326-9cd4-c0b5a2434f4a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:25.333585 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:25.398190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2fa1f-cb00-43cb-9199-12323824c4ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:25.399012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2fa1f-cb00-43cb-9199-12323824c4ee service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:25.399382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2fa1f-cb00-43cb-9199-12323824c4ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:25.399699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2fa1f-cb00-43cb-9199-12323824c4ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:25.402134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6da2fa1f-cb00-43cb-9199-12323824c4ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:25.536420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2fa1f-cb00-43cb-9199-12323824c4ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:25.537877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2fa1f-cb00-43cb-9199-12323824c4ee service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:25.556725 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 720/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:27.755725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333313b1-2730-4ab7-99d1-3b8c4e69a052 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:27.756293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333313b1-2730-4ab7-99d1-3b8c4e69a052 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:27.756293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333313b1-2730-4ab7-99d1-3b8c4e69a052 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:27.757607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:27.763497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f2a9-c726-48a5-aeeb-3f38ba407195 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:27.764015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f2a9-c726-48a5-aeeb-3f38ba407195 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:27.764114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f2a9-c726-48a5-aeeb-3f38ba407195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:27.832069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:27.835453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5b15f2a9-c726-48a5-aeeb-3f38ba407195 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:27.837671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5b15f2a9-c726-48a5-aeeb-3f38ba407195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:27.942457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:28.225130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333313b1-2730-4ab7-99d1-3b8c4e69a052 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:28.226724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-333313b1-2730-4ab7-99d1-3b8c4e69a052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:28.339066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333313b1-2730-4ab7-99d1-3b8c4e69a052 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:28.393306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:28.422062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03196c5-1382-4ecf-8812-9d48e4b12134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:28.422679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03196c5-1382-4ecf-8812-9d48e4b12134 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:28.422947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03196c5-1382-4ecf-8812-9d48e4b12134 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:28.423348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03196c5-1382-4ecf-8812-9d48e4b12134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:28.425104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a03196c5-1382-4ecf-8812-9d48e4b12134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:28.544156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03196c5-1382-4ecf-8812-9d48e4b12134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:28.545594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03196c5-1382-4ecf-8812-9d48e4b12134 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:28.565047 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 734/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:30.798898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7970f04-d9ac-4dbd-a678-316ba15ff3ce None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:30.799655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7970f04-d9ac-4dbd-a678-316ba15ff3ce None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:30.799655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7970f04-d9ac-4dbd-a678-316ba15ff3ce None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:30.800998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:30.806844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e87d-f3e3-4267-80c5-7b30867e1c5b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:30.807278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e87d-f3e3-4267-80c5-7b30867e1c5b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:30.807372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e87d-f3e3-4267-80c5-7b30867e1c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:30.881242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6384e87d-f3e3-4267-80c5-7b30867e1c5b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:30.882472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6384e87d-f3e3-4267-80c5-7b30867e1c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:30.914078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:30.986516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:31.291610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7970f04-d9ac-4dbd-a678-316ba15ff3ce None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:31.293909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a7970f04-d9ac-4dbd-a678-316ba15ff3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:31.414753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7970f04-d9ac-4dbd-a678-316ba15ff3ce None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:31.444700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:31.495759 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e054976-f849-4ecc-b27f-725b8e8130d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:31.496382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e054976-f849-4ecc-b27f-725b8e8130d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:31.496632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e054976-f849-4ecc-b27f-725b8e8130d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:31.496901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e054976-f849-4ecc-b27f-725b8e8130d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:31.498544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6e054976-f849-4ecc-b27f-725b8e8130d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:31.630355 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e054976-f849-4ecc-b27f-725b8e8130d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:31.631712 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e054976-f849-4ecc-b27f-725b8e8130d8 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:31.650815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 723/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:33.909949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8b9ac-d407-4938-b92a-6a2b783af952 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:33.910521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8b9ac-d407-4938-b92a-6a2b783af952 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:33.910521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8b9ac-d407-4938-b92a-6a2b783af952 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:33.911792 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:33.918434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89887b-88eb-41e4-8fee-67a51872edd7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:33.919193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89887b-88eb-41e4-8fee-67a51872edd7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:33.919333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89887b-88eb-41e4-8fee-67a51872edd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:33.993334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ed89887b-88eb-41e4-8fee-67a51872edd7 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:33.994594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ed89887b-88eb-41e4-8fee-67a51872edd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:34.003170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:34.104507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:34.388676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8b9ac-d407-4938-b92a-6a2b783af952 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:34.391338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fee8b9ac-d407-4938-b92a-6a2b783af952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:34.510185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8b9ac-d407-4938-b92a-6a2b783af952 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:34.569117 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:34.592056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1680d-4591-4c9c-9880-c5ac8a7776db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:34.592717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1680d-4591-4c9c-9880-c5ac8a7776db service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:34.593020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1680d-4591-4c9c-9880-c5ac8a7776db service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:34.593295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1680d-4591-4c9c-9880-c5ac8a7776db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:34.595303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d1c1680d-4591-4c9c-9880-c5ac8a7776db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:34.707232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1680d-4591-4c9c-9880-c5ac8a7776db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:34.708602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1680d-4591-4c9c-9880-c5ac8a7776db service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:34.728674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 737/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:36.917871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085558f-ab64-4366-8748-282582cb65b7 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:36.918495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085558f-ab64-4366-8748-282582cb65b7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:36.918495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085558f-ab64-4366-8748-282582cb65b7 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:36.925508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:04:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:36.931267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddb83f-4b35-4825-9f9d-c618faca3a50 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:36.931737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddb83f-4b35-4825-9f9d-c618faca3a50 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:36.931850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddb83f-4b35-4825-9f9d-c618faca3a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:37.006630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b3ddb83f-4b35-4825-9f9d-c618faca3a50 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:37.007922 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b3ddb83f-4b35-4825-9f9d-c618faca3a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:37.049588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:37.125291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:37.430627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085558f-ab64-4366-8748-282582cb65b7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:37.433252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1085558f-ab64-4366-8748-282582cb65b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:37.551574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085558f-ab64-4366-8748-282582cb65b7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:37.602434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:37.639137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dcd64-e2c7-41cb-89ea-a999e9c4d73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:37.639765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dcd64-e2c7-41cb-89ea-a999e9c4d73f service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:37.640032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dcd64-e2c7-41cb-89ea-a999e9c4d73f service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:37.640299 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dcd64-e2c7-41cb-89ea-a999e9c4d73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:37.641871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-023dcd64-e2c7-41cb-89ea-a999e9c4d73f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:37.757789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dcd64-e2c7-41cb-89ea-a999e9c4d73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:37.759268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dcd64-e2c7-41cb-89ea-a999e9c4d73f service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:37.777605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 726/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:39.927648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331709-6efb-4868-98be-6b29e7b28a6b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:39.928244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331709-6efb-4868-98be-6b29e7b28a6b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:39.928244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331709-6efb-4868-98be-6b29e7b28a6b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:39.929546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:39.936134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc1a5b-e6ef-4337-95cd-24e05657ad70 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:39.936592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc1a5b-e6ef-4337-95cd-24e05657ad70 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:39.936694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc1a5b-e6ef-4337-95cd-24e05657ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:40.021305 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e7bc1a5b-e6ef-4337-95cd-24e05657ad70 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:40.022558 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e7bc1a5b-e6ef-4337-95cd-24e05657ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:40.041766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:40.122166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:40.406681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8331709-6efb-4868-98be-6b29e7b28a6b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:40.408341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e8331709-6efb-4868-98be-6b29e7b28a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:40.528828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8331709-6efb-4868-98be-6b29e7b28a6b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:40.602456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:40.609608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9cfdd-9934-4706-a815-ed5aaa313d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:40.610266 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9cfdd-9934-4706-a815-ed5aaa313d8a service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:40.610542 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9cfdd-9934-4706-a815-ed5aaa313d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:40.610807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9cfdd-9934-4706-a815-ed5aaa313d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:40.613339 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f9e9cfdd-9934-4706-a815-ed5aaa313d8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:40.726151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9cfdd-9934-4706-a815-ed5aaa313d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:40.727596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9cfdd-9934-4706-a815-ed5aaa313d8a service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:40.745371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 740/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:04:42.898247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975f7ef-0b3b-49b8-873e-f2f1f5374e23 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:42.899144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975f7ef-0b3b-49b8-873e-f2f1f5374e23 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:42.899144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975f7ef-0b3b-49b8-873e-f2f1f5374e23 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:42.901232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:04:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:04:42.910326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8864f-04a7-43e7-8058-e0031b7a155b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:42.910780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8864f-04a7-43e7-8058-e0031b7a155b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:42.910890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8864f-04a7-43e7-8058-e0031b7a155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:42.989392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2fd8864f-04a7-43e7-8058-e0031b7a155b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:04:42.990630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2fd8864f-04a7-43e7-8058-e0031b7a155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:43.052262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:43.105822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:04:43.397912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975f7ef-0b3b-49b8-873e-f2f1f5374e23 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:04:43.399960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a975f7ef-0b3b-49b8-873e-f2f1f5374e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:43.520180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975f7ef-0b3b-49b8-873e-f2f1f5374e23 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:04:43.572912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:43.599659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd8cc6-53c1-48f8-8277-fb22e2708f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:04:43.600259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd8cc6-53c1-48f8-8277-fb22e2708f04 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:04:43.600527 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd8cc6-53c1-48f8-8277-fb22e2708f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:04:43.600803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd8cc6-53c1-48f8-8277-fb22e2708f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:04:43.602428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3fdd8cc6-53c1-48f8-8277-fb22e2708f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:04:43.733625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd8cc6-53c1-48f8-8277-fb22e2708f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:04:43.735119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd8cc6-53c1-48f8-8277-fb22e2708f04 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:04:43.754465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 729/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:04:53.102770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=22 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:53.752234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=66 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:03.744592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb906dd-144a-40ee-a839-4a45e6a424d4 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:03.745161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb906dd-144a-40ee-a839-4a45e6a424d4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:03.745161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb906dd-144a-40ee-a839-4a45e6a424d4 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:03.746531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 742/1471] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:05:03.751972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1b917-7968-4b1f-aa0e-6b42ccfb4506 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:03.752426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1b917-7968-4b1f-aa0e-6b42ccfb4506 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:03.752532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1b917-7968-4b1f-aa0e-6b42ccfb4506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:03.823202 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d3b1b917-7968-4b1f-aa0e-6b42ccfb4506 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:05:03.824420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d3b1b917-7968-4b1f-aa0e-6b42ccfb4506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:03.933476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 730/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:05:04.242788 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6c887-c5ea-42e5-bc02-efddca8ec193 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:04.243276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6c887-c5ea-42e5-bc02-efddca8ec193 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:04.243805 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6c887-c5ea-42e5-bc02-efddca8ec193 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:04.246185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 743/1473] 10.222.0.20 () {54 vars in 962 bytes} [Thu Sep 22 22:05:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:05:04.253052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ef71-0fff-4fd8-8618-f3627b634784 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:04.253335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ef71-0fff-4fd8-8618-f3627b634784 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:04.253603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ef71-0fff-4fd8-8618-f3627b634784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:04.336571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c403ef71-0fff-4fd8-8618-f3627b634784 None None] MFA Rules not processed for user `d22e60fc95af4a0a94b15f9ed9e3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:05:04.337780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c403ef71-0fff-4fd8-8618-f3627b634784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:04.364730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:04.433945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 731/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Sep 22 22:05:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:05:04.442318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6c887-c5ea-42e5-bc02-efddca8ec193 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:05:04.444816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1be6c887-c5ea-42e5-bc02-efddca8ec193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:04.566715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6c887-c5ea-42e5-bc02-efddca8ec193 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:05:04.651373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e78e75-620f-42d1-9ebd-f702932638cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22e60fc95af4a0a94b15f9ed9e3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:05:04.652005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78e75-620f-42d1-9ebd-f702932638cc service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:04.652274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78e75-620f-42d1-9ebd-f702932638cc service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:04.652543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78e75-620f-42d1-9ebd-f702932638cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:04.654192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-54e78e75-620f-42d1-9ebd-f702932638cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:04.709745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:04.783069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e78e75-620f-42d1-9ebd-f702932638cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:05:04.784568 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e78e75-620f-42d1-9ebd-f702932638cc service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:05:04.805786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 744/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:05:07.045437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eca179-6d13-4f5a-8cd4-f72da986b95e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:07.046411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eca179-6d13-4f5a-8cd4-f72da986b95e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:07.046411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eca179-6d13-4f5a-8cd4-f72da986b95e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:07.048540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 732/1476] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:05:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:05:07.057462 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150264-8970-4c07-b43e-2bb6d2e1a64b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:07.057930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150264-8970-4c07-b43e-2bb6d2e1a64b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:07.058048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150264-8970-4c07-b43e-2bb6d2e1a64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:07.131607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-95150264-8970-4c07-b43e-2bb6d2e1a64b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:05:07.132838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-95150264-8970-4c07-b43e-2bb6d2e1a64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:07.247697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 745/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:05:07.526132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eca179-6d13-4f5a-8cd4-f72da986b95e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:05:07.527681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a3eca179-6d13-4f5a-8cd4-f72da986b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:07.666858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eca179-6d13-4f5a-8cd4-f72da986b95e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:05:07.720447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:07.766863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce5a32-4965-4bd6-90f5-ba95bf4add1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:05:07.767470 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce5a32-4965-4bd6-90f5-ba95bf4add1c admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:07.767740 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce5a32-4965-4bd6-90f5-ba95bf4add1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:07.768002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce5a32-4965-4bd6-90f5-ba95bf4add1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:07.768632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce5a32-4965-4bd6-90f5-ba95bf4add1c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:05:07.770921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-5bce5a32-4965-4bd6-90f5-ba95bf4add1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:05:07.770921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: warnings.warn(msg) Sep 22 22:05:07.770921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: Sep 22 22:05:07.772056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce5a32-4965-4bd6-90f5-ba95bf4add1c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:05:07.791741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 733/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 22 22:05:07 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:05:09.979976 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edcc1d-542a-4175-ac74-71a4391cadd3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:09.980586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edcc1d-542a-4175-ac74-71a4391cadd3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:09.980586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edcc1d-542a-4175-ac74-71a4391cadd3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:09.982980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 746/1479] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:05:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:05:09.989766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cacfaa-0ba4-4052-9dc6-55313102b9a0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:09.990257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cacfaa-0ba4-4052-9dc6-55313102b9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:09.990466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cacfaa-0ba4-4052-9dc6-55313102b9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:10.074399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-72cacfaa-0ba4-4052-9dc6-55313102b9a0 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:05:10.076198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-72cacfaa-0ba4-4052-9dc6-55313102b9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:10.188760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 734/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:05:10.553328 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edcc1d-542a-4175-ac74-71a4391cadd3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:05:10.560122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-31edcc1d-542a-4175-ac74-71a4391cadd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:10.577434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:10.753757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edcc1d-542a-4175-ac74-71a4391cadd3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:05:10.844759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:10.883484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aec415-2346-470e-99da-763221fc71eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:05:10.884107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aec415-2346-470e-99da-763221fc71eb service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:10.884376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aec415-2346-470e-99da-763221fc71eb service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:10.884643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aec415-2346-470e-99da-763221fc71eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:10.886298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-34aec415-2346-470e-99da-763221fc71eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:10.984236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aec415-2346-470e-99da-763221fc71eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:05:10.985863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aec415-2346-470e-99da-763221fc71eb service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:05:11.009266 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 747/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:05:13.351694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1900f0-cc52-4490-a0f1-33f7db3f057b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:13.352324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1900f0-cc52-4490-a0f1-33f7db3f057b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:13.352324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1900f0-cc52-4490-a0f1-33f7db3f057b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:13.353611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 735/1482] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:05:13.360175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8911a-889c-41d2-957e-d43abfbc7f39 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:13.360942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8911a-889c-41d2-957e-d43abfbc7f39 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:13.361103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8911a-889c-41d2-957e-d43abfbc7f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:13.440919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-75c8911a-889c-41d2-957e-d43abfbc7f39 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:05:13.442242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-75c8911a-889c-41d2-957e-d43abfbc7f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:13.499271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:13.552644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 748/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:05:13.839811 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1900f0-cc52-4490-a0f1-33f7db3f057b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:05:13.842276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cd1900f0-cc52-4490-a0f1-33f7db3f057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:13.870353 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:13.954452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1900f0-cc52-4490-a0f1-33f7db3f057b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:05:14.157681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758f836-09b9-4ae4-9df4-229dd8017bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:05:14.158296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758f836-09b9-4ae4-9df4-229dd8017bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:14.158564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758f836-09b9-4ae4-9df4-229dd8017bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:14.158825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758f836-09b9-4ae4-9df4-229dd8017bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:14.160496 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6758f836-09b9-4ae4-9df4-229dd8017bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:14.237981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:14.273859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758f836-09b9-4ae4-9df4-229dd8017bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:05:14.275296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758f836-09b9-4ae4-9df4-229dd8017bc3 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:05:14.294678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 736/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:05:16.504469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801abc9-5f1d-4c3a-ae76-3114b60bde56 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:16.505098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801abc9-5f1d-4c3a-ae76-3114b60bde56 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:16.505098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801abc9-5f1d-4c3a-ae76-3114b60bde56 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:16.506366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 749/1485] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:05:16.512859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f160f97-6ac1-4bd6-9311-7a05cda7510e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:16.513702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f160f97-6ac1-4bd6-9311-7a05cda7510e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:16.513702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f160f97-6ac1-4bd6-9311-7a05cda7510e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:16.584513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4f160f97-6ac1-4bd6-9311-7a05cda7510e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:05:16.585780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4f160f97-6ac1-4bd6-9311-7a05cda7510e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:16.687768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 737/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:05:16.982869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801abc9-5f1d-4c3a-ae76-3114b60bde56 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:05:16.985321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9801abc9-5f1d-4c3a-ae76-3114b60bde56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:17.102818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801abc9-5f1d-4c3a-ae76-3114b60bde56 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:05:17.185302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:17.187867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf84582-64e6-4903-bcf7-735f785f21fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:05:17.188789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf84582-64e6-4903-bcf7-735f785f21fd service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:17.189376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf84582-64e6-4903-bcf7-735f785f21fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:17.189821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf84582-64e6-4903-bcf7-735f785f21fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:17.192281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-edf84582-64e6-4903-bcf7-735f785f21fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:17.320686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf84582-64e6-4903-bcf7-735f785f21fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:05:17.322158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf84582-64e6-4903-bcf7-735f785f21fd service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:05:17.341580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 750/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:05:19.653884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af59cf-fe9c-4268-9f54-972f71a20ea9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:19.654895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af59cf-fe9c-4268-9f54-972f71a20ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:19.654895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af59cf-fe9c-4268-9f54-972f71a20ea9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:19.656707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 738/1488] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:05:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:05:19.666494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a7aa1-98bd-4a45-9cd5-f83e902ba0ab None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:19.666983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a7aa1-98bd-4a45-9cd5-f83e902ba0ab None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:19.667131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a7aa1-98bd-4a45-9cd5-f83e902ba0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:19.746281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-577a7aa1-98bd-4a45-9cd5-f83e902ba0ab None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:05:19.747525 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-577a7aa1-98bd-4a45-9cd5-f83e902ba0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:19.801218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:19.846948 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 751/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:05:20.140439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af59cf-fe9c-4268-9f54-972f71a20ea9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:05:20.142049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-14af59cf-fe9c-4268-9f54-972f71a20ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:20.186487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:20.264190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af59cf-fe9c-4268-9f54-972f71a20ea9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:05:20.345249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44266b0e-a920-48d8-91af-76380e829750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:05:20.345880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44266b0e-a920-48d8-91af-76380e829750 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:20.346134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44266b0e-a920-48d8-91af-76380e829750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:20.346401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44266b0e-a920-48d8-91af-76380e829750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:20.348019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-44266b0e-a920-48d8-91af-76380e829750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:20.443379 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:20.476272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44266b0e-a920-48d8-91af-76380e829750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:05:20.477714 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44266b0e-a920-48d8-91af-76380e829750 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:05:20.496183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 739/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:05:22.919265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fc6bc-f94b-40db-88a8-0d6a60c70e1a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:22.920141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fc6bc-f94b-40db-88a8-0d6a60c70e1a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:22.920141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fc6bc-f94b-40db-88a8-0d6a60c70e1a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:22.922312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 752/1491] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 22 22:05:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:05:22.929183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8671-6c00-48e1-8915-69e86c158047 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:22.929963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8671-6c00-48e1-8915-69e86c158047 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:22.930155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8671-6c00-48e1-8915-69e86c158047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:23.007349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-85ae8671-6c00-48e1-8915-69e86c158047 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:05:23.008581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-85ae8671-6c00-48e1-8915-69e86c158047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:23.116563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 740/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 22 22:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:05:23.409917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fc6bc-f94b-40db-88a8-0d6a60c70e1a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:05:23.411517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f22fc6bc-f94b-40db-88a8-0d6a60c70e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:23.518121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fc6bc-f94b-40db-88a8-0d6a60c70e1a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:05:23.602619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ad145-f028-4028-a91c-50e50cfe444f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:05:23.603238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ad145-f028-4028-a91c-50e50cfe444f service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:05:23.603509 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ad145-f028-4028-a91c-50e50cfe444f service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:05:23.603773 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ad145-f028-4028-a91c-50e50cfe444f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:05:23.605447 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b95ad145-f028-4028-a91c-50e50cfe444f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:05:23.614741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:23.723763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ad145-f028-4028-a91c-50e50cfe444f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:05:23.725228 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ad145-f028-4028-a91c-50e50cfe444f service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:05:23.744432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 753/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:05:33.114875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=82 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:05:33.741751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=50 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:39.240680 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02735a69-90f1-4fa8-be85-ceb3a79ee046 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:39.241666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02735a69-90f1-4fa8-be85-ceb3a79ee046 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:39.241666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02735a69-90f1-4fa8-be85-ceb3a79ee046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:39.327750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-02735a69-90f1-4fa8-be85-ceb3a79ee046 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:06:39.328958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-02735a69-90f1-4fa8-be85-ceb3a79ee046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:39.431078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 741/1494] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:06:39.439443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26a3a8-a12f-45a4-9c91-e2e336d8c97c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:39.439972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26a3a8-a12f-45a4-9c91-e2e336d8c97c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:39.439972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26a3a8-a12f-45a4-9c91-e2e336d8c97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:39.519263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-de26a3a8-a12f-45a4-9c91-e2e336d8c97c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:06:39.520392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-de26a3a8-a12f-45a4-9c91-e2e336d8c97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:39.627973 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 754/1495] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:06:39.635721 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02735a69-90f1-4fa8-be85-ceb3a79ee046 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:06:39.636941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-02735a69-90f1-4fa8-be85-ceb3a79ee046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:39.649391 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02735a69-90f1-4fa8-be85-ceb3a79ee046 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:06:39.718490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:39.756685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ace79-99c1-485d-a583-4b46568bd961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:06:39.757295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ace79-99c1-485d-a583-4b46568bd961 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:39.757562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ace79-99c1-485d-a583-4b46568bd961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:39.758064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ace79-99c1-485d-a583-4b46568bd961 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:39.758705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ace79-99c1-485d-a583-4b46568bd961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:06:39.758999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ace79-99c1-485d-a583-4b46568bd961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:06:39.760016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-0f1ace79-99c1-485d-a583-4b46568bd961 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:06:39.760016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: warnings.warn(msg) Sep 22 22:06:39.760016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: Sep 22 22:06:39.760887 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ace79-99c1-485d-a583-4b46568bd961 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:06:39.772304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 742/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:06:39.784238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26a3a8-a12f-45a4-9c91-e2e336d8c97c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:06:39.793739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26a3a8-a12f-45a4-9c91-e2e336d8c97c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:06:39.856287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:39.892463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b5f2c-5d2b-4a96-9972-f9f9e7d362b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:06:39.893072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5f2c-5d2b-4a96-9972-f9f9e7d362b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:39.893346 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5f2c-5d2b-4a96-9972-f9f9e7d362b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:39.893603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5f2c-5d2b-4a96-9972-f9f9e7d362b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:39.894276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b5f2c-5d2b-4a96-9972-f9f9e7d362b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:06:39.896037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-c82b5f2c-5d2b-4a96-9972-f9f9e7d362b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:06:39.896037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: warnings.warn(msg) Sep 22 22:06:39.896037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: Sep 22 22:06:39.897229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b5f2c-5d2b-4a96-9972-f9f9e7d362b0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:06:39.962518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 755/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:06:39 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:06:39.967140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ace79-99c1-485d-a583-4b46568bd961 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:06:39.968693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0f1ace79-99c1-485d-a583-4b46568bd961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:40.015289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ace79-99c1-485d-a583-4b46568bd961 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:06:40.124345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a89e07-71e5-4fb9-8c60-48fbcc3e0cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:06:40.124873 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89e07-71e5-4fb9-8c60-48fbcc3e0cce admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:40.125149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89e07-71e5-4fb9-8c60-48fbcc3e0cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:40.125416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89e07-71e5-4fb9-8c60-48fbcc3e0cce admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:40.126077 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a89e07-71e5-4fb9-8c60-48fbcc3e0cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:06:40.127095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-b3a89e07-71e5-4fb9-8c60-48fbcc3e0cce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:06:40.127095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: warnings.warn(msg) Sep 22 22:06:40.127095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: Sep 22 22:06:40.128293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a89e07-71e5-4fb9-8c60-48fbcc3e0cce admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:06:40.174567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 743/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:06:39 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:06:40.178889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b5f2c-5d2b-4a96-9972-f9f9e7d362b0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:06:40.180600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c82b5f2c-5d2b-4a96-9972-f9f9e7d362b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:40.245971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b5f2c-5d2b-4a96-9972-f9f9e7d362b0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:06:40.332845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:40.345364 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c363b-c492-4d05-a654-3dd6550e8e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:06:40.346034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c363b-c492-4d05-a654-3dd6550e8e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:40.346294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c363b-c492-4d05-a654-3dd6550e8e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:40.346910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c363b-c492-4d05-a654-3dd6550e8e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:40.347561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c363b-c492-4d05-a654-3dd6550e8e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:06:40.348816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-bf9c363b-c492-4d05-a654-3dd6550e8e32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:06:40.348816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: warnings.warn(msg) Sep 22 22:06:40.348816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: Sep 22 22:06:40.349703 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c363b-c492-4d05-a654-3dd6550e8e32 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:06:40.362525 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 756/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:06:40.366920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a89e07-71e5-4fb9-8c60-48fbcc3e0cce admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:06:40.368836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b3a89e07-71e5-4fb9-8c60-48fbcc3e0cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:40.380241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a89e07-71e5-4fb9-8c60-48fbcc3e0cce admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:06:40.407683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:40.488240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691b47c-faef-44b2-ba8b-43c150b466ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:06:40.488848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691b47c-faef-44b2-ba8b-43c150b466ff admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:40.489114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691b47c-faef-44b2-ba8b-43c150b466ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:40.489374 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691b47c-faef-44b2-ba8b-43c150b466ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:40.490039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691b47c-faef-44b2-ba8b-43c150b466ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:06:40.491058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-f691b47c-faef-44b2-ba8b-43c150b466ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:06:40.491058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: warnings.warn(msg) Sep 22 22:06:40.491058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: Sep 22 22:06:40.491924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691b47c-faef-44b2-ba8b-43c150b466ff admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:06:40.504731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 744/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:06:40.509752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c363b-c492-4d05-a654-3dd6550e8e32 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:06:40.511959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bf9c363b-c492-4d05-a654-3dd6550e8e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:40.548846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c363b-c492-4d05-a654-3dd6550e8e32 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:06:40.660310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366ead6-ef86-4d1c-97fc-08dc4961b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:06:40.660877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366ead6-ef86-4d1c-97fc-08dc4961b9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:40.661149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366ead6-ef86-4d1c-97fc-08dc4961b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:40.661414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366ead6-ef86-4d1c-97fc-08dc4961b9f9 admin admin] PATH_INFO: `/v3/projects/a07fe7de96f74331a2578ed793d0dc78/users/87d42fae592e44349779b3632aee34b8/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:40.684122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366ead6-ef86-4d1c-97fc-08dc4961b9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07fe7de96f74331a2578ed793d0dc78, user_id=87d42fae592e44349779b3632aee34b8, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:06:40.685154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-3366ead6-ef86-4d1c-97fc-08dc4961b9f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:06:40.685154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: warnings.warn(msg) Sep 22 22:06:40.685154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: Sep 22 22:06:40.687115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366ead6-ef86-4d1c-97fc-08dc4961b9f9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:06:40.714468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 757/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:06:40 2022] PUT /identity/v3/projects/a07fe7de96f74331a2578ed793d0dc78/users/87d42fae592e44349779b3632aee34b8/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:06:40.731176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ea04a-451d-4115-9974-f0463a93a3e5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:40.731459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ea04a-451d-4115-9974-f0463a93a3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:40.731723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ea04a-451d-4115-9974-f0463a93a3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:40.788113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bb7ea04a-451d-4115-9974-f0463a93a3e5 None None] MFA Rules not processed for user `87d42fae592e44349779b3632aee34b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:06:40.789405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bb7ea04a-451d-4115-9974-f0463a93a3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:40.886306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 745/1502] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:06:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:06:40.904674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd669-54cc-4eba-832b-c117d05eb43b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:40.905015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd669-54cc-4eba-832b-c117d05eb43b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:40.905312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd669-54cc-4eba-832b-c117d05eb43b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:40.907482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 758/1503] 10.222.0.20 () {54 vars in 963 bytes} [Thu Sep 22 22:06:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:06:40.914909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7311f5-d02f-4ecb-b12e-27e333800008 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:40.915087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7311f5-d02f-4ecb-b12e-27e333800008 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:40.915378 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7311f5-d02f-4ecb-b12e-27e333800008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:40.949905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:41.011335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-dc7311f5-d02f-4ecb-b12e-27e333800008 None None] MFA Rules not processed for user `2c639dece626449b9153943b388e52c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:06:41.012589 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-dc7311f5-d02f-4ecb-b12e-27e333800008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:41.096915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 746/1504] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Sep 22 22:06:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:06:41.107321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfd669-54cc-4eba-832b-c117d05eb43b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:06:41.108869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e3cfd669-54cc-4eba-832b-c117d05eb43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:41.165410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:41.230952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfd669-54cc-4eba-832b-c117d05eb43b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:06:41.309433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24d37-63fb-4465-9ff0-01f3f41c7b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:06:41.310107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24d37-63fb-4465-9ff0-01f3f41c7b9b service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:41.310359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24d37-63fb-4465-9ff0-01f3f41c7b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:41.310625 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24d37-63fb-4465-9ff0-01f3f41c7b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:41.312243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f2b24d37-63fb-4465-9ff0-01f3f41c7b9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:41.416382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24d37-63fb-4465-9ff0-01f3f41c7b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:06:41.417802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24d37-63fb-4465-9ff0-01f3f41c7b9b service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:06:41.421421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:41.437415 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 759/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:06:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:06:41.487439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35805477-68c2-4c62-8c45-2a4c35e46de6 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:41.487887 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35805477-68c2-4c62-8c45-2a4c35e46de6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:41.487999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35805477-68c2-4c62-8c45-2a4c35e46de6 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:41.489265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 747/1506] 10.222.0.20 () {52 vars in 830 bytes} [Thu Sep 22 22:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:06:41.493135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24d37-63fb-4465-9ff0-01f3f41c7b9b service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:06:41.494386 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f2b24d37-63fb-4465-9ff0-01f3f41c7b9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:41.601162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24d37-63fb-4465-9ff0-01f3f41c7b9b service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:06:41.699715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:06:41.700266 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:41.700539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:41.700811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] PATH_INFO: `/v3/users/87d42fae592e44349779b3632aee34b8` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:41.714254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d42fae592e44349779b3632aee34b8)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:06:41.715301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:06:41.715301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: warnings.warn(msg) Sep 22 22:06:41.715301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: Sep 22 22:06:41.716512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:06:41.727999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:41.790299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d42fae592e44349779b3632aee34b8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:06:41.803011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d42fae592e44349779b3632aee34b8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:06:41.803444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d42fae592e44349779b3632aee34b8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:06:41.818312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d42fae592e44349779b3632aee34b8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:06:41.841575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d42fae592e44349779b3632aee34b8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:06:41.847816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 760/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:06:41 2022] DELETE /identity/v3/users/87d42fae592e44349779b3632aee34b8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:06:41.852452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb49b43-9040-474e-bc0f-1cfeba2cf3e2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:41.852728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb49b43-9040-474e-bc0f-1cfeba2cf3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:41.852989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb49b43-9040-474e-bc0f-1cfeba2cf3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:41.910786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0eb49b43-9040-474e-bc0f-1cfeba2cf3e2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:06:41.911980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0eb49b43-9040-474e-bc0f-1cfeba2cf3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:42.006616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:42.019641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 748/1508] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:06:42.030089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:06:42.031342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:42.149458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63f1e2-766a-4fed-a7db-fe3255a79aad admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:06:42.213685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:42.230757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859b042-005c-4870-9157-406362ca14a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:06:42.231385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859b042-005c-4870-9157-406362ca14a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:42.231667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859b042-005c-4870-9157-406362ca14a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:42.232272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859b042-005c-4870-9157-406362ca14a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:42.233886 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2859b042-005c-4870-9157-406362ca14a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:42.348682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859b042-005c-4870-9157-406362ca14a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:06:42.350068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859b042-005c-4870-9157-406362ca14a9 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:06:42.368177 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 761/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:06:42.743082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb49b43-9040-474e-bc0f-1cfeba2cf3e2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:06:42.744322 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0eb49b43-9040-474e-bc0f-1cfeba2cf3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:06:42.755481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb49b43-9040-474e-bc0f-1cfeba2cf3e2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:06:42.859384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:06:42.859945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:06:42.860221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:06:42.860490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] PATH_INFO: `/v3/projects/a07fe7de96f74331a2578ed793d0dc78` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:06:42.871004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07fe7de96f74331a2578ed793d0dc78)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:06:42.872085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:06:42.872085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: warnings.warn(msg) Sep 22 22:06:42.872085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: Sep 22 22:06:42.873265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:06:42.937974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07fe7de96f74331a2578ed793d0dc78', 'request_id': 'req-1f5b8371-31e1-4684-9375-6eb372d45db0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:06:42.944394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07fe7de96f74331a2578ed793d0dc78', 'request_id': 'req-1f5b8371-31e1-4684-9375-6eb372d45db0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:06:42.956381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07fe7de96f74331a2578ed793d0dc78', 'request_id': 'req-1f5b8371-31e1-4684-9375-6eb372d45db0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:06:42.987314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] The token cache is being invalidate because project a07fe7de96f74331a2578ed793d0dc78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:06:42.987599 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:06:42.988007 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f5b8371-31e1-4684-9375-6eb372d45db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:06:42.989412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 749/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:06:42 2022] DELETE /identity/v3/projects/a07fe7de96f74331a2578ed793d0dc78 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:06:52.365668 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=62 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:06:52.984662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:08:17.090837 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499660-2ee5-4f6c-9657-098c65abe293 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:17.091486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499660-2ee5-4f6c-9657-098c65abe293 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:17.091486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499660-2ee5-4f6c-9657-098c65abe293 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:17.092733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:08:17.099190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24444783-7e2f-44f3-9692-5ae030c5f4b2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:17.099976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24444783-7e2f-44f3-9692-5ae030c5f4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:17.100146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24444783-7e2f-44f3-9692-5ae030c5f4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:17.188767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-24444783-7e2f-44f3-9692-5ae030c5f4b2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:08:17.189992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-24444783-7e2f-44f3-9692-5ae030c5f4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:17.301456 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:08:17.456456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b499660-2ee5-4f6c-9657-098c65abe293 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:08:17.459760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7b499660-2ee5-4f6c-9657-098c65abe293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:17.593864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b499660-2ee5-4f6c-9657-098c65abe293 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:08:17.600527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d23a4-8fcd-4919-94f4-8a5e91781ce3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:08:17.601180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d23a4-8fcd-4919-94f4-8a5e91781ce3 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:17.601455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d23a4-8fcd-4919-94f4-8a5e91781ce3 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:17.601725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d23a4-8fcd-4919-94f4-8a5e91781ce3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:17.610501 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d23a4-8fcd-4919-94f4-8a5e91781ce3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:08:17.612431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d23a4-8fcd-4919-94f4-8a5e91781ce3 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:08:17.622054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 763/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:08:18.705777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780c1c-6569-4448-8091-48f0c3dfc074 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:18.705777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780c1c-6569-4448-8091-48f0c3dfc074 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:18.706486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780c1c-6569-4448-8091-48f0c3dfc074 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:18.707439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:08:18.715776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47ed3-973c-41c0-949e-1f7c113239e5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:18.716217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47ed3-973c-41c0-949e-1f7c113239e5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:18.716320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47ed3-973c-41c0-949e-1f7c113239e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:18.744426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b2e47ed3-973c-41c0-949e-1f7c113239e5 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:08:18.745638 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b2e47ed3-973c-41c0-949e-1f7c113239e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:18.755060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:08:18.908247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47780c1c-6569-4448-8091-48f0c3dfc074 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:08:18.926355 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47780c1c-6569-4448-8091-48f0c3dfc074 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:08:18.932362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b3710-e29c-4fe5-ac82-6894f9b63ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:08:18.932978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3710-e29c-4fe5-ac82-6894f9b63ee5 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:18.933264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3710-e29c-4fe5-ac82-6894f9b63ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:18.933539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3710-e29c-4fe5-ac82-6894f9b63ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:18.944746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b3710-e29c-4fe5-ac82-6894f9b63ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:08:18.946444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b3710-e29c-4fe5-ac82-6894f9b63ee5 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:08:18.958443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 752/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:08:19.354325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bda4e-1619-452f-9f66-794f3eaf96c4 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:19.354634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bda4e-1619-452f-9f66-794f3eaf96c4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:19.354879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bda4e-1619-452f-9f66-794f3eaf96c4 None None] PATH_INFO: `/v3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:19.356165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 765/1517] 10.222.0.16 () {54 vars in 925 bytes} [Thu Sep 22 22:08:19 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:08:19.365088 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf16c38-9b22-457e-82bc-5bec65164502 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:19.365400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf16c38-9b22-457e-82bc-5bec65164502 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:19.365665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf16c38-9b22-457e-82bc-5bec65164502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:19.428971 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1bf16c38-9b22-457e-82bc-5bec65164502 None None] MFA Rules not processed for user `2c7f2566918b4c719486d1ce285724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:08:19.430265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1bf16c38-9b22-457e-82bc-5bec65164502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:19.449509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:08:19.507980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 753/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 22 22:08:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:08:23.109873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82dfb0-7585-433d-86ca-15bfc2a5ff26 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:23.110385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82dfb0-7585-433d-86ca-15bfc2a5ff26 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:23.110385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82dfb0-7585-433d-86ca-15bfc2a5ff26 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:23.111744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 766/1519] 10.222.0.20 () {54 vars in 961 bytes} [Thu Sep 22 22:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:08:23.119541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe54de8-55b2-4b95-a9c6-5ce1890faeb5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:23.120022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe54de8-55b2-4b95-a9c6-5ce1890faeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:23.120243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe54de8-55b2-4b95-a9c6-5ce1890faeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:23.145952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3fe54de8-55b2-4b95-a9c6-5ce1890faeb5 None None] MFA Rules not processed for user `2c7f2566918b4c719486d1ce285724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:08:23.147170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3fe54de8-55b2-4b95-a9c6-5ce1890faeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:23.158302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 754/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Sep 22 22:08:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:08:23.168771 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82dfb0-7585-433d-86ca-15bfc2a5ff26 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:08:23.183452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82dfb0-7585-433d-86ca-15bfc2a5ff26 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:08:23.188856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169bd21-c8c3-4cb4-9c17-4418ebab1287 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:08:23.189473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169bd21-c8c3-4cb4-9c17-4418ebab1287 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:23.189741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169bd21-c8c3-4cb4-9c17-4418ebab1287 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:23.190047 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169bd21-c8c3-4cb4-9c17-4418ebab1287 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:23.198373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169bd21-c8c3-4cb4-9c17-4418ebab1287 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:08:23.199960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169bd21-c8c3-4cb4-9c17-4418ebab1287 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:08:23.209628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 767/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:08:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:08:30.450162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67636b-a540-4ef5-b725-ac577c695f2f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:30.451106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67636b-a540-4ef5-b725-ac577c695f2f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:30.451106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67636b-a540-4ef5-b725-ac577c695f2f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:30.453209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:08:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:08:30.459797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a2ba-09ea-4572-b90b-c1f1f6271097 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:30.460321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a2ba-09ea-4572-b90b-c1f1f6271097 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:30.460321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a2ba-09ea-4572-b90b-c1f1f6271097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:30.482313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e532a2ba-09ea-4572-b90b-c1f1f6271097 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:08:30.483448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e532a2ba-09ea-4572-b90b-c1f1f6271097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:30.493413 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:08:30.658863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67636b-a540-4ef5-b725-ac577c695f2f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:08:30.675189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67636b-a540-4ef5-b725-ac577c695f2f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:08:30.681231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed05100-5e4d-498d-beb2-efd9afdb43e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:08:30.681820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed05100-5e4d-498d-beb2-efd9afdb43e9 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:30.682124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed05100-5e4d-498d-beb2-efd9afdb43e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:30.682388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed05100-5e4d-498d-beb2-efd9afdb43e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:30.690521 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed05100-5e4d-498d-beb2-efd9afdb43e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:08:30.692212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed05100-5e4d-498d-beb2-efd9afdb43e9 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:08:30.701858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 756/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:08:31.763417 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0aca-87b9-4a23-9090-9e078472794c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:31.766173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0aca-87b9-4a23-9090-9e078472794c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:31.766173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0aca-87b9-4a23-9090-9e078472794c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:31.766173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 22:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:08:31.771752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc100a3-40a7-4a38-9f36-a771dfdeae28 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:31.772255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc100a3-40a7-4a38-9f36-a771dfdeae28 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:31.772389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc100a3-40a7-4a38-9f36-a771dfdeae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:31.801885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-dcc100a3-40a7-4a38-9f36-a771dfdeae28 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:08:31.803467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-dcc100a3-40a7-4a38-9f36-a771dfdeae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:31.812042 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 22:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:08:31.962679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b0aca-87b9-4a23-9090-9e078472794c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:08:31.977985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b0aca-87b9-4a23-9090-9e078472794c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:08:31.984434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb38fd7-b9f7-465d-88aa-97eb30ea3ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:08:31.985050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38fd7-b9f7-465d-88aa-97eb30ea3ed4 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:31.985328 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38fd7-b9f7-465d-88aa-97eb30ea3ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:31.985602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38fd7-b9f7-465d-88aa-97eb30ea3ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:31.994674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb38fd7-b9f7-465d-88aa-97eb30ea3ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:08:31.996351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb38fd7-b9f7-465d-88aa-97eb30ea3ed4 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:08:32.006362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 770/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:08:36.230241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c9af0-5102-423a-b3f7-241097958490 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:36.230862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c9af0-5102-423a-b3f7-241097958490 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:36.230862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c9af0-5102-423a-b3f7-241097958490 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:36.232129 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:08:36.238634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4b86b-0609-440a-8049-9f01243ab3f2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:36.239065 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4b86b-0609-440a-8049-9f01243ab3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:36.239588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4b86b-0609-440a-8049-9f01243ab3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:36.267407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-05c4b86b-0609-440a-8049-9f01243ab3f2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:08:36.268688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-05c4b86b-0609-440a-8049-9f01243ab3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:36.279434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:08:36.572596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c9af0-5102-423a-b3f7-241097958490 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:08:36.575826 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-837c9af0-5102-423a-b3f7-241097958490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:36.662379 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c9af0-5102-423a-b3f7-241097958490 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:08:36.666453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59f01b-d8da-42a1-903e-c176edd4ca90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:08:36.667055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59f01b-d8da-42a1-903e-c176edd4ca90 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:36.667330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59f01b-d8da-42a1-903e-c176edd4ca90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:36.667591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59f01b-d8da-42a1-903e-c176edd4ca90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:36.676996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59f01b-d8da-42a1-903e-c176edd4ca90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:08:36.678451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59f01b-d8da-42a1-903e-c176edd4ca90 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:08:36.688045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 759/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:08:38.886470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e683656-b6e9-448a-89ff-5a1b4de79348 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:38.887423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e683656-b6e9-448a-89ff-5a1b4de79348 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:38.887423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e683656-b6e9-448a-89ff-5a1b4de79348 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:38.889558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:08:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:08:38.894918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e46d4-f457-4373-b16d-018a9dd9cfd4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:38.895355 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e46d4-f457-4373-b16d-018a9dd9cfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:38.895449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e46d4-f457-4373-b16d-018a9dd9cfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:38.917985 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ce6e46d4-f457-4373-b16d-018a9dd9cfd4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:08:38.919198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ce6e46d4-f457-4373-b16d-018a9dd9cfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:38.928817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:08:39.222591 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e683656-b6e9-448a-89ff-5a1b4de79348 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:08:39.235503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e683656-b6e9-448a-89ff-5a1b4de79348 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:08:39.239360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ebf96-d522-489d-b249-81b91f1ee59a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:08:39.239982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ebf96-d522-489d-b249-81b91f1ee59a service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:39.240271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ebf96-d522-489d-b249-81b91f1ee59a service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:39.240605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ebf96-d522-489d-b249-81b91f1ee59a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:39.249716 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ebf96-d522-489d-b249-81b91f1ee59a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:08:39.251171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ebf96-d522-489d-b249-81b91f1ee59a service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:08:39.260701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 773/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:08:42.983462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97119dbb-bd25-4909-9b98-a35a7883ae74 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:42.984021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97119dbb-bd25-4909-9b98-a35a7883ae74 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:42.984021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97119dbb-bd25-4909-9b98-a35a7883ae74 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:42.985348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:08:42.991742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f13de-551c-43b5-a945-540ca80b631e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:42.992489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f13de-551c-43b5-a945-540ca80b631e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:42.992660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f13de-551c-43b5-a945-540ca80b631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:43.006763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=81 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:08:43.019958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bb5f13de-551c-43b5-a945-540ca80b631e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:08:43.021169 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bb5f13de-551c-43b5-a945-540ca80b631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:43.030090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:08:43.332281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97119dbb-bd25-4909-9b98-a35a7883ae74 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:08:43.335417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-97119dbb-bd25-4909-9b98-a35a7883ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:43.420009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:08:43.434638 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97119dbb-bd25-4909-9b98-a35a7883ae74 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:08:43.438300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87866545-6450-4b8a-bb6c-8faa3613f7a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:08:43.438904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87866545-6450-4b8a-bb6c-8faa3613f7a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:43.439173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87866545-6450-4b8a-bb6c-8faa3613f7a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:43.439437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87866545-6450-4b8a-bb6c-8faa3613f7a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:43.448652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87866545-6450-4b8a-bb6c-8faa3613f7a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:08:43.450103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87866545-6450-4b8a-bb6c-8faa3613f7a8 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:08:43.459595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 762/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:08:45.578110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcce696-1e5e-4ed2-b771-894059d98cc9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:45.579049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcce696-1e5e-4ed2-b771-894059d98cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:45.579049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcce696-1e5e-4ed2-b771-894059d98cc9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:45.581206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 22:08:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:08:45.587476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3569f-012f-47a5-96fe-8bdfb5ce1b99 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:45.587958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3569f-012f-47a5-96fe-8bdfb5ce1b99 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:45.588082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3569f-012f-47a5-96fe-8bdfb5ce1b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:45.611554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7cf3569f-012f-47a5-96fe-8bdfb5ce1b99 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:08:45.612734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7cf3569f-012f-47a5-96fe-8bdfb5ce1b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:45.622617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 22:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:08:45.920539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcce696-1e5e-4ed2-b771-894059d98cc9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:08:45.922621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7dcce696-1e5e-4ed2-b771-894059d98cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:08:45.944060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcce696-1e5e-4ed2-b771-894059d98cc9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:08:45.948586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c2073-8433-47e8-b87e-1c36a4efdae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:08:45.949198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c2073-8433-47e8-b87e-1c36a4efdae4 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:08:45.949471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c2073-8433-47e8-b87e-1c36a4efdae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:08:45.949746 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c2073-8433-47e8-b87e-1c36a4efdae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:08:45.959328 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c2073-8433-47e8-b87e-1c36a4efdae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:08:45.961353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c2073-8433-47e8-b87e-1c36a4efdae4 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:08:45.971461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 776/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:08:55.606429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=11 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:08:55.966892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=8 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:12.760116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c104-8195-4e6b-bd56-767ac4b0c199 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:12.761001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c104-8195-4e6b-bd56-767ac4b0c199 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:12.761001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c104-8195-4e6b-bd56-767ac4b0c199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:12.791039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6779c104-8195-4e6b-bd56-767ac4b0c199 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:12.792260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6779c104-8195-4e6b-bd56-767ac4b0c199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:12.801804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 764/1540] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:12.810926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f504f0b-c22b-445b-b365-32d56469a285 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:12.811723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f504f0b-c22b-445b-b365-32d56469a285 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:12.811723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f504f0b-c22b-445b-b365-32d56469a285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:12.843463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9f504f0b-c22b-445b-b365-32d56469a285 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:12.844702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9f504f0b-c22b-445b-b365-32d56469a285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:12.859781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 777/1541] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:12.865308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779c104-8195-4e6b-bd56-767ac4b0c199 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:12.877919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779c104-8195-4e6b-bd56-767ac4b0c199 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:12.887363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b86dd-bb28-4101-9c68-ca2ad64eed4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:12.888314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b86dd-bb28-4101-9c68-ca2ad64eed4e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:12.888764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b86dd-bb28-4101-9c68-ca2ad64eed4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:12.889188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b86dd-bb28-4101-9c68-ca2ad64eed4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:12.890066 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b86dd-bb28-4101-9c68-ca2ad64eed4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:12.890551 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b86dd-bb28-4101-9c68-ca2ad64eed4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:12.892708 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b86dd-bb28-4101-9c68-ca2ad64eed4e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:12.909148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 765/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:12.917899 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f504f0b-c22b-445b-b365-32d56469a285 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:12.932704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f504f0b-c22b-445b-b365-32d56469a285 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:12.943849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db480a25-cd2d-4d6a-aeae-6e3a46cf5ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:12.944493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db480a25-cd2d-4d6a-aeae-6e3a46cf5ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:12.944760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db480a25-cd2d-4d6a-aeae-6e3a46cf5ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:12.945029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db480a25-cd2d-4d6a-aeae-6e3a46cf5ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:12.945688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db480a25-cd2d-4d6a-aeae-6e3a46cf5ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:12.947703 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db480a25-cd2d-4d6a-aeae-6e3a46cf5ae5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.021865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 778/1543] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:12 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:13.026031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b86dd-bb28-4101-9c68-ca2ad64eed4e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.040940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b86dd-bb28-4101-9c68-ca2ad64eed4e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.078901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91580c-decb-4b71-845e-e377bdf50ca3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.079462 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91580c-decb-4b71-845e-e377bdf50ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.079995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91580c-decb-4b71-845e-e377bdf50ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.114677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0e91580c-decb-4b71-845e-e377bdf50ca3 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.116209 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0e91580c-decb-4b71-845e-e377bdf50ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.129444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63eabb-a760-4f44-be48-cd61f18287ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.129444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63eabb-a760-4f44-be48-cd61f18287ee admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.129444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63eabb-a760-4f44-be48-cd61f18287ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.129444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63eabb-a760-4f44-be48-cd61f18287ee admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.130049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63eabb-a760-4f44-be48-cd61f18287ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.130872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63eabb-a760-4f44-be48-cd61f18287ee admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.172381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 766/1544] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:13.173882 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374906-bbc2-4194-ad61-cb5a9b7acaf4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.174216 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374906-bbc2-4194-ad61-cb5a9b7acaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.174489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374906-bbc2-4194-ad61-cb5a9b7acaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.214562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f3374906-bbc2-4194-ad61-cb5a9b7acaf4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.216746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f3374906-bbc2-4194-ad61-cb5a9b7acaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.219693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 779/1545] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:13.223504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb469ca-8fd7-4c3c-9ee4-57bf7a10842d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.224722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb469ca-8fd7-4c3c-9ee4-57bf7a10842d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.225902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb469ca-8fd7-4c3c-9ee4-57bf7a10842d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.236051 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 767/1546] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.236821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3374906-bbc2-4194-ad61-cb5a9b7acaf4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.250568 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fbb469ca-8fd7-4c3c-9ee4-57bf7a10842d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.250823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3374906-bbc2-4194-ad61-cb5a9b7acaf4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.253048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fbb469ca-8fd7-4c3c-9ee4-57bf7a10842d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.256133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0fe61-afc9-41b5-b8c4-0c99854c208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.256829 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0fe61-afc9-41b5-b8c4-0c99854c208d admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.257151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0fe61-afc9-41b5-b8c4-0c99854c208d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.257416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0fe61-afc9-41b5-b8c4-0c99854c208d admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.258100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0fe61-afc9-41b5-b8c4-0c99854c208d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.259882 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0fe61-afc9-41b5-b8c4-0c99854c208d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.263585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 780/1547] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.266046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6e933-80d1-4959-bf3b-d4b08513172d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.266322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6e933-80d1-4959-bf3b-d4b08513172d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.266704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6e933-80d1-4959-bf3b-d4b08513172d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.271489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 768/1548] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:13.272943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac2b8-a1ff-4bb3-8a25-e58d4321f5da None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.273219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac2b8-a1ff-4bb3-8a25-e58d4321f5da None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.273594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac2b8-a1ff-4bb3-8a25-e58d4321f5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.289681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cdc6e933-80d1-4959-bf3b-d4b08513172d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.290941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cdc6e933-80d1-4959-bf3b-d4b08513172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.297959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b97ac2b8-a1ff-4bb3-8a25-e58d4321f5da None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.299115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b97ac2b8-a1ff-4bb3-8a25-e58d4321f5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.300504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 781/1549] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.301440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b8d1f-bc12-4705-a2c0-81b833fd06ab None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.301720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b8d1f-bc12-4705-a2c0-81b833fd06ab None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.302032 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b8d1f-bc12-4705-a2c0-81b833fd06ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.308123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 769/1550] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.309509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032d02-0d8f-456b-a120-cb94fbf6e7fa None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.309786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032d02-0d8f-456b-a120-cb94fbf6e7fa None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.310082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032d02-0d8f-456b-a120-cb94fbf6e7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.323402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f81b8d1f-bc12-4705-a2c0-81b833fd06ab None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.324739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f81b8d1f-bc12-4705-a2c0-81b833fd06ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.329489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-72032d02-0d8f-456b-a120-cb94fbf6e7fa None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.330677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-72032d02-0d8f-456b-a120-cb94fbf6e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.333241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 782/1551] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.334659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a340e-3b81-478f-b654-97bef6068793 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.334947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a340e-3b81-478f-b654-97bef6068793 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.335221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a340e-3b81-478f-b654-97bef6068793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.341907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 770/1552] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.343083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1aa2a-d3c4-42d3-86d6-aa5dbd0c34ba None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.343342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1aa2a-d3c4-42d3-86d6-aa5dbd0c34ba None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.343604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1aa2a-d3c4-42d3-86d6-aa5dbd0c34ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.355522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5e0a340e-3b81-478f-b654-97bef6068793 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.356737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5e0a340e-3b81-478f-b654-97bef6068793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.364528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 783/1553] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.368155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f777e-0361-4797-a856-10f4677c1070 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.368155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f777e-0361-4797-a856-10f4677c1070 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.368155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f777e-0361-4797-a856-10f4677c1070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.369111 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-75a1aa2a-d3c4-42d3-86d6-aa5dbd0c34ba None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.370328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-75a1aa2a-d3c4-42d3-86d6-aa5dbd0c34ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.382347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 771/1554] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.382347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1aa2a-d3c4-42d3-86d6-aa5dbd0c34ba None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.388755 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-240f777e-0361-4797-a856-10f4677c1070 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.388919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1aa2a-d3c4-42d3-86d6-aa5dbd0c34ba None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.389977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-240f777e-0361-4797-a856-10f4677c1070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.393511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88feddc4-9f3a-493a-9b38-6a457ddff99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.394141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feddc4-9f3a-493a-9b38-6a457ddff99b admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.394408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feddc4-9f3a-493a-9b38-6a457ddff99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.394667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feddc4-9f3a-493a-9b38-6a457ddff99b admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.395322 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88feddc4-9f3a-493a-9b38-6a457ddff99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.397457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88feddc4-9f3a-493a-9b38-6a457ddff99b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.398821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 784/1555] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.399793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a40a1-6f7e-4b61-a72a-851bcd013ad1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.400066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a40a1-6f7e-4b61-a72a-851bcd013ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.400331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a40a1-6f7e-4b61-a72a-851bcd013ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.412568 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 772/1556] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:13.414085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b35b9-d47d-4af5-9e92-0fe7c61f606a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.414555 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b35b9-d47d-4af5-9e92-0fe7c61f606a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.414996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b35b9-d47d-4af5-9e92-0fe7c61f606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.421329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e54a40a1-6f7e-4b61-a72a-851bcd013ad1 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.422669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e54a40a1-6f7e-4b61-a72a-851bcd013ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.434560 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 785/1557] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.434560 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a40a1-6f7e-4b61-a72a-851bcd013ad1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.435748 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6d8b35b9-d47d-4af5-9e92-0fe7c61f606a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.437142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6d8b35b9-d47d-4af5-9e92-0fe7c61f606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.441346 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a40a1-6f7e-4b61-a72a-851bcd013ad1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.446155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e2a53-933e-4105-9ee5-b6f3cad1327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.446747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e2a53-933e-4105-9ee5-b6f3cad1327a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.447017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e2a53-933e-4105-9ee5-b6f3cad1327a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.447170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 773/1558] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.447263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e2a53-933e-4105-9ee5-b6f3cad1327a admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.447902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e2a53-933e-4105-9ee5-b6f3cad1327a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:13.448214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e2a53-933e-4105-9ee5-b6f3cad1327a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.448409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3327d-a063-487b-97e3-07efb7acb602 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.448652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3327d-a063-487b-97e3-07efb7acb602 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.448926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3327d-a063-487b-97e3-07efb7acb602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.449220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-505e2a53-933e-4105-9ee5-b6f3cad1327a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:10:13.449220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: warnings.warn(msg) Sep 22 22:10:13.449220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: Sep 22 22:10:13.450138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e2a53-933e-4105-9ee5-b6f3cad1327a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.467559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 786/1559] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:13.467559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e2a53-933e-4105-9ee5-b6f3cad1327a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.469739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-36e3327d-a063-487b-97e3-07efb7acb602 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.470968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-36e3327d-a063-487b-97e3-07efb7acb602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.474567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e2a53-933e-4105-9ee5-b6f3cad1327a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.479219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 774/1560] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.480393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b93fb-c6aa-49e0-a623-6c71a426684b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.480781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b93fb-c6aa-49e0-a623-6c71a426684b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.480910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b93fb-c6aa-49e0-a623-6c71a426684b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.481455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabae07-db81-45f4-9e03-b17b8b773d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.482090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabae07-db81-45f4-9e03-b17b8b773d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.482365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabae07-db81-45f4-9e03-b17b8b773d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.482881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabae07-db81-45f4-9e03-b17b8b773d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.483362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabae07-db81-45f4-9e03-b17b8b773d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:13.483662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabae07-db81-45f4-9e03-b17b8b773d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.485241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabae07-db81-45f4-9e03-b17b8b773d86 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.497649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 787/1561] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:13.498586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabae07-db81-45f4-9e03-b17b8b773d86 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.499896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-461b93fb-c6aa-49e0-a623-6c71a426684b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.501081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-461b93fb-c6aa-49e0-a623-6c71a426684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.511922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 775/1562] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:13.512697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b93fb-c6aa-49e0-a623-6c71a426684b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.514273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabae07-db81-45f4-9e03-b17b8b773d86 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.518913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc60c27-fe60-4bca-8ac0-063173dfa406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.519514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc60c27-fe60-4bca-8ac0-063173dfa406 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.519788 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc60c27-fe60-4bca-8ac0-063173dfa406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.520052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc60c27-fe60-4bca-8ac0-063173dfa406 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.520755 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc60c27-fe60-4bca-8ac0-063173dfa406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:13.521152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc60c27-fe60-4bca-8ac0-063173dfa406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.522650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b93fb-c6aa-49e0-a623-6c71a426684b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.522880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc60c27-fe60-4bca-8ac0-063173dfa406 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.527194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16874885-040f-4967-ab5a-d097ce42f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.527779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874885-040f-4967-ab5a-d097ce42f90a admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.528054 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874885-040f-4967-ab5a-d097ce42f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.528323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874885-040f-4967-ab5a-d097ce42f90a admin admin] PATH_INFO: `/v3/projects/64fa913be9c84feab67bbbb7f9982790/users/1645075799ee49a0873f9da9ea2fff67/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.534595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 788/1563] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:13.535511 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc60c27-fe60-4bca-8ac0-063173dfa406 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.546036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc60c27-fe60-4bca-8ac0-063173dfa406 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.550853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16874885-040f-4967-ab5a-d097ce42f90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fa913be9c84feab67bbbb7f9982790, user_id=1645075799ee49a0873f9da9ea2fff67, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.551078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c2e80-5289-47d6-95fd-02470ea79f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.551457 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c2e80-5289-47d6-95fd-02470ea79f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.551732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c2e80-5289-47d6-95fd-02470ea79f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.552027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c2e80-5289-47d6-95fd-02470ea79f8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.552507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-16874885-040f-4967-ab5a-d097ce42f90a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:10:13.552507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: warnings.warn(msg) Sep 22 22:10:13.552507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: Sep 22 22:10:13.553362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c2e80-5289-47d6-95fd-02470ea79f8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:13.553520 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c2e80-5289-47d6-95fd-02470ea79f8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.554535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16874885-040f-4967-ab5a-d097ce42f90a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.555213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c2e80-5289-47d6-95fd-02470ea79f8f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.569069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 789/1564] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:13.569488 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 776/1565] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:13 2022] PUT /identity/v3/projects/64fa913be9c84feab67bbbb7f9982790/users/1645075799ee49a0873f9da9ea2fff67/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:13.572233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16874885-040f-4967-ab5a-d097ce42f90a admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.578702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c2e80-5289-47d6-95fd-02470ea79f8f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.589140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c2e80-5289-47d6-95fd-02470ea79f8f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.617485 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:13.622928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:13.640659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16874885-040f-4967-ab5a-d097ce42f90a admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.645459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2be6f-12ba-4757-a986-401051777c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.646188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2be6f-12ba-4757-a986-401051777c09 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.646535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2be6f-12ba-4757-a986-401051777c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.647073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2be6f-12ba-4757-a986-401051777c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.647484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2be6f-12ba-4757-a986-401051777c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.648540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-76a2be6f-12ba-4757-a986-401051777c09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:10:13.648540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: warnings.warn(msg) Sep 22 22:10:13.648540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: Sep 22 22:10:13.649730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2be6f-12ba-4757-a986-401051777c09 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.651974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd15f3b-3bbc-477d-9901-0283852ff53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.652639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd15f3b-3bbc-477d-9901-0283852ff53b admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.652932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd15f3b-3bbc-477d-9901-0283852ff53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.653178 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd15f3b-3bbc-477d-9901-0283852ff53b admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.653820 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd15f3b-3bbc-477d-9901-0283852ff53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:13.654163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd15f3b-3bbc-477d-9901-0283852ff53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.655797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd15f3b-3bbc-477d-9901-0283852ff53b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.667076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 790/1566] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:13.668114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd15f3b-3bbc-477d-9901-0283852ff53b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.678060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd15f3b-3bbc-477d-9901-0283852ff53b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.682620 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb5feb-c51b-40c7-9ae1-dc0d32ce88e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.686349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 777/1567] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:13.686494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb5feb-c51b-40c7-9ae1-dc0d32ce88e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.686494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb5feb-c51b-40c7-9ae1-dc0d32ce88e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.686494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb5feb-c51b-40c7-9ae1-dc0d32ce88e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.686737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2be6f-12ba-4757-a986-401051777c09 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.686812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb5feb-c51b-40c7-9ae1-dc0d32ce88e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:13.686812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb5feb-c51b-40c7-9ae1-dc0d32ce88e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.686812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb5feb-c51b-40c7-9ae1-dc0d32ce88e5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.706566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 791/1568] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:13.706566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb5feb-c51b-40c7-9ae1-dc0d32ce88e5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.711856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb5feb-c51b-40c7-9ae1-dc0d32ce88e5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.755032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2be6f-12ba-4757-a986-401051777c09 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.759960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238db9c-7011-432c-9ff4-f65272e83aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.760566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238db9c-7011-432c-9ff4-f65272e83aee admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.761159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238db9c-7011-432c-9ff4-f65272e83aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.761159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238db9c-7011-432c-9ff4-f65272e83aee admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.761699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238db9c-7011-432c-9ff4-f65272e83aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.763643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238db9c-7011-432c-9ff4-f65272e83aee admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.771845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4a138-1533-4b88-aec6-52aeebed41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.772608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4a138-1533-4b88-aec6-52aeebed41fc admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.772885 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4a138-1533-4b88-aec6-52aeebed41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.773154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4a138-1533-4b88-aec6-52aeebed41fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.773806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4a138-1533-4b88-aec6-52aeebed41fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:13.774134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4a138-1533-4b88-aec6-52aeebed41fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.775761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4a138-1533-4b88-aec6-52aeebed41fc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.788482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 792/1569] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:13.789709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4a138-1533-4b88-aec6-52aeebed41fc admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.799615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 778/1570] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:13.799615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238db9c-7011-432c-9ff4-f65272e83aee admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.800537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4a138-1533-4b88-aec6-52aeebed41fc admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.859964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba2b9-116a-4c4a-a4a1-95ca8ce870df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.860673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba2b9-116a-4c4a-a4a1-95ca8ce870df admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.860822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba2b9-116a-4c4a-a4a1-95ca8ce870df admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.861092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba2b9-116a-4c4a-a4a1-95ca8ce870df admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.861730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ba2b9-116a-4c4a-a4a1-95ca8ce870df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.863172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238db9c-7011-432c-9ff4-f65272e83aee admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.863673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ba2b9-116a-4c4a-a4a1-95ca8ce870df admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.868433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6a375-36b2-4015-bf86-e3e6b8e38786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.869071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6a375-36b2-4015-bf86-e3e6b8e38786 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.869343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6a375-36b2-4015-bf86-e3e6b8e38786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.869608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6a375-36b2-4015-bf86-e3e6b8e38786 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.870286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6a375-36b2-4015-bf86-e3e6b8e38786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.872181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6a375-36b2-4015-bf86-e3e6b8e38786 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:13.907872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 779/1571] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:13.907872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e4d7-7412-46fd-8718-953220b2e775 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.907872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e4d7-7412-46fd-8718-953220b2e775 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.907872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e4d7-7412-46fd-8718-953220b2e775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.910880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 793/1572] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:13.911832 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba2b9-116a-4c4a-a4a1-95ca8ce870df admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:13.934728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6be8e4d7-7412-46fd-8718-953220b2e775 None None] MFA Rules not processed for user `1645075799ee49a0873f9da9ea2fff67`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:13.935943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6be8e4d7-7412-46fd-8718-953220b2e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:13.945784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:13.957282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:13.975829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba2b9-116a-4c4a-a4a1-95ca8ce870df admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:13.980836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb853-b876-4cda-ae1a-a8d7516a384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:13.981485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb853-b876-4cda-ae1a-a8d7516a384a admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:13.981726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb853-b876-4cda-ae1a-a8d7516a384a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:13.982022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb853-b876-4cda-ae1a-a8d7516a384a admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:13.982652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cb853-b876-4cda-ae1a-a8d7516a384a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:13.984580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cb853-b876-4cda-ae1a-a8d7516a384a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.005400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 780/1573] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:14.010304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8e4d7-7412-46fd-8718-953220b2e775 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.013152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 794/1574] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:13 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.013990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb853-b876-4cda-ae1a-a8d7516a384a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.020707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8e4d7-7412-46fd-8718-953220b2e775 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.079064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99fd7b-2d44-4fdc-bb7d-ce8961b46d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.079593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99fd7b-2d44-4fdc-bb7d-ce8961b46d24 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.079849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99fd7b-2d44-4fdc-bb7d-ce8961b46d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.080116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99fd7b-2d44-4fdc-bb7d-ce8961b46d24 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.080731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99fd7b-2d44-4fdc-bb7d-ce8961b46d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.080961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb853-b876-4cda-ae1a-a8d7516a384a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.082681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99fd7b-2d44-4fdc-bb7d-ce8961b46d24 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.086443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef11a2e-38bb-4f4b-96be-eca18ae37fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.087052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11a2e-38bb-4f4b-96be-eca18ae37fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.087324 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11a2e-38bb-4f4b-96be-eca18ae37fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.087594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11a2e-38bb-4f4b-96be-eca18ae37fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.088218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11a2e-38bb-4f4b-96be-eca18ae37fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.090244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11a2e-38bb-4f4b-96be-eca18ae37fe1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.108941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 781/1575] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:14 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.108941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99fd7b-2d44-4fdc-bb7d-ce8961b46d24 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.119225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99fd7b-2d44-4fdc-bb7d-ce8961b46d24 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.122571 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 795/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:14 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.123416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef11a2e-38bb-4f4b-96be-eca18ae37fe1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.126522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6823a0-27a1-4d59-a809-c7fd98875b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.127129 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6823a0-27a1-4d59-a809-c7fd98875b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.127400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6823a0-27a1-4d59-a809-c7fd98875b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.127665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6823a0-27a1-4d59-a809-c7fd98875b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.128284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6823a0-27a1-4d59-a809-c7fd98875b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.130213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6823a0-27a1-4d59-a809-c7fd98875b7f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.164918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 782/1577] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:14 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.164918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6823a0-27a1-4d59-a809-c7fd98875b7f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.188510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef11a2e-38bb-4f4b-96be-eca18ae37fe1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.227120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6823a0-27a1-4d59-a809-c7fd98875b7f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.232385 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828effd7-cad8-4eea-8d6d-49e0ac61109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.233004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828effd7-cad8-4eea-8d6d-49e0ac61109b admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.233274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828effd7-cad8-4eea-8d6d-49e0ac61109b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.233561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828effd7-cad8-4eea-8d6d-49e0ac61109b admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.234203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828effd7-cad8-4eea-8d6d-49e0ac61109b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.234928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:14.236111 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828effd7-cad8-4eea-8d6d-49e0ac61109b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.248355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933633fc-5684-4f80-986c-4150eb17f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.249074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933633fc-5684-4f80-986c-4150eb17f141 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.249394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933633fc-5684-4f80-986c-4150eb17f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.249707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933633fc-5684-4f80-986c-4150eb17f141 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.250449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933633fc-5684-4f80-986c-4150eb17f141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.251587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-933633fc-5684-4f80-986c-4150eb17f141 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:10:14.251587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: warnings.warn(msg) Sep 22 22:10:14.251587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: Sep 22 22:10:14.252875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933633fc-5684-4f80-986c-4150eb17f141 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.262316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 783/1578] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:14 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.262316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828effd7-cad8-4eea-8d6d-49e0ac61109b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.270885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828effd7-cad8-4eea-8d6d-49e0ac61109b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.275068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 796/1579] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:14 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.275750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933633fc-5684-4f80-986c-4150eb17f141 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.278803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041109d1-2113-4056-aabc-5fc324b7f985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.279417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041109d1-2113-4056-aabc-5fc324b7f985 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.279741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041109d1-2113-4056-aabc-5fc324b7f985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.280006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041109d1-2113-4056-aabc-5fc324b7f985 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.280631 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041109d1-2113-4056-aabc-5fc324b7f985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.282637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041109d1-2113-4056-aabc-5fc324b7f985 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.285232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933633fc-5684-4f80-986c-4150eb17f141 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.290015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96dbed-0d15-4c92-a615-8de48116ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.290610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96dbed-0d15-4c92-a615-8de48116ffdc admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.290897 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96dbed-0d15-4c92-a615-8de48116ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.291171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96dbed-0d15-4c92-a615-8de48116ffdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.291781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96dbed-0d15-4c92-a615-8de48116ffdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.293664 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96dbed-0d15-4c92-a615-8de48116ffdc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.306098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 784/1580] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:14 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.306922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041109d1-2113-4056-aabc-5fc324b7f985 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.311678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:14.317250 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041109d1-2113-4056-aabc-5fc324b7f985 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.322976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c160f-7641-4eb3-997f-1cf99591633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.323622 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c160f-7641-4eb3-997f-1cf99591633e admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.323940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c160f-7641-4eb3-997f-1cf99591633e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.324193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c160f-7641-4eb3-997f-1cf99591633e admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.324812 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c160f-7641-4eb3-997f-1cf99591633e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.326767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c160f-7641-4eb3-997f-1cf99591633e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.328548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 797/1581] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:14 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.329627 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96dbed-0d15-4c92-a615-8de48116ffdc admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.351921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 785/1582] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:14 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.352809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c160f-7641-4eb3-997f-1cf99591633e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.362515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c160f-7641-4eb3-997f-1cf99591633e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.397522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96dbed-0d15-4c92-a615-8de48116ffdc admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.402270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12e668-7f3e-4f53-a9f9-9df3bcb156bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.402891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e668-7f3e-4f53-a9f9-9df3bcb156bf admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.403166 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e668-7f3e-4f53-a9f9-9df3bcb156bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.403434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e668-7f3e-4f53-a9f9-9df3bcb156bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.404091 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12e668-7f3e-4f53-a9f9-9df3bcb156bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.405682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12e668-7f3e-4f53-a9f9-9df3bcb156bf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.416007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 798/1583] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.416891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12e668-7f3e-4f53-a9f9-9df3bcb156bf admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.423546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4a78e-5cd2-4938-b35c-c706df552210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.424161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4a78e-5cd2-4938-b35c-c706df552210 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.424432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4a78e-5cd2-4938-b35c-c706df552210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.424693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4a78e-5cd2-4938-b35c-c706df552210 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.425318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4a78e-5cd2-4938-b35c-c706df552210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.426664 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12e668-7f3e-4f53-a9f9-9df3bcb156bf admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.427255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4a78e-5cd2-4938-b35c-c706df552210 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.431385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539eb26e-aa33-40ab-8bc6-f2e878e98f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.431981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eb26e-aa33-40ab-8bc6-f2e878e98f6c admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.432258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eb26e-aa33-40ab-8bc6-f2e878e98f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.432555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eb26e-aa33-40ab-8bc6-f2e878e98f6c admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.433348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eb26e-aa33-40ab-8bc6-f2e878e98f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.435280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eb26e-aa33-40ab-8bc6-f2e878e98f6c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.451185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 786/1584] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:14 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.452060 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4a78e-5cd2-4938-b35c-c706df552210 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.459502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 799/1585] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:14 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.460989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539eb26e-aa33-40ab-8bc6-f2e878e98f6c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.462263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4a78e-5cd2-4938-b35c-c706df552210 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.466833 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3bfe6-e8cb-4990-a133-deec3ba0e016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.467431 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3bfe6-e8cb-4990-a133-deec3ba0e016 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.467704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3bfe6-e8cb-4990-a133-deec3ba0e016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.467968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3bfe6-e8cb-4990-a133-deec3ba0e016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.468605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3bfe6-e8cb-4990-a133-deec3ba0e016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.470228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3bfe6-e8cb-4990-a133-deec3ba0e016 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.470969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539eb26e-aa33-40ab-8bc6-f2e878e98f6c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.475778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b533e56-feed-4493-97b4-245db3db4cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.476707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533e56-feed-4493-97b4-245db3db4cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.476980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533e56-feed-4493-97b4-245db3db4cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.477245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533e56-feed-4493-97b4-245db3db4cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.477909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b533e56-feed-4493-97b4-245db3db4cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.479483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b533e56-feed-4493-97b4-245db3db4cfb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.480747 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 787/1586] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.481701 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3bfe6-e8cb-4990-a133-deec3ba0e016 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.493365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 800/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.493365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b533e56-feed-4493-97b4-245db3db4cfb admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.493599 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3bfe6-e8cb-4990-a133-deec3ba0e016 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.497862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68151f3b-91fd-45d8-8f91-6726a54680e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.498463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68151f3b-91fd-45d8-8f91-6726a54680e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.498739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68151f3b-91fd-45d8-8f91-6726a54680e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.499032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68151f3b-91fd-45d8-8f91-6726a54680e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.499661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68151f3b-91fd-45d8-8f91-6726a54680e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.500755 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b533e56-feed-4493-97b4-245db3db4cfb admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.501248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68151f3b-91fd-45d8-8f91-6726a54680e0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.505478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99f1e3-db59-485c-b60e-abb6aa996de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.507506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99f1e3-db59-485c-b60e-abb6aa996de8 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.507792 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99f1e3-db59-485c-b60e-abb6aa996de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.508091 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99f1e3-db59-485c-b60e-abb6aa996de8 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.508759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99f1e3-db59-485c-b60e-abb6aa996de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.510990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99f1e3-db59-485c-b60e-abb6aa996de8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.512279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 788/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.513062 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68151f3b-91fd-45d8-8f91-6726a54680e0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.522806 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68151f3b-91fd-45d8-8f91-6726a54680e0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.528124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90f37e-75c6-4339-bea6-3859940a0baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.528799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90f37e-75c6-4339-bea6-3859940a0baf admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.529072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90f37e-75c6-4339-bea6-3859940a0baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.529285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90f37e-75c6-4339-bea6-3859940a0baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.530044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90f37e-75c6-4339-bea6-3859940a0baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.531648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90f37e-75c6-4339-bea6-3859940a0baf admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.537915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 801/1589] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:14 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:14.537915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99f1e3-db59-485c-b60e-abb6aa996de8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.543584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 789/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.543584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90f37e-75c6-4339-bea6-3859940a0baf admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.550497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99f1e3-db59-485c-b60e-abb6aa996de8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.554731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90f37e-75c6-4339-bea6-3859940a0baf admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.555804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc367e-a54b-4ea8-8ac1-0024c109fb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.556421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc367e-a54b-4ea8-8ac1-0024c109fb2d admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.556698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc367e-a54b-4ea8-8ac1-0024c109fb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.556969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc367e-a54b-4ea8-8ac1-0024c109fb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.557618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc367e-a54b-4ea8-8ac1-0024c109fb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.559255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc367e-a54b-4ea8-8ac1-0024c109fb2d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.559557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a58b8e-65aa-4941-a8d2-9de8a3404fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.560204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a58b8e-65aa-4941-a8d2-9de8a3404fba admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.560516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a58b8e-65aa-4941-a8d2-9de8a3404fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.560815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a58b8e-65aa-4941-a8d2-9de8a3404fba admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.561454 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a58b8e-65aa-4941-a8d2-9de8a3404fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.563631 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a58b8e-65aa-4941-a8d2-9de8a3404fba admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.569449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 802/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.570447 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc367e-a54b-4ea8-8ac1-0024c109fb2d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.574213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 790/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.575201 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a58b8e-65aa-4941-a8d2-9de8a3404fba admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.580605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc367e-a54b-4ea8-8ac1-0024c109fb2d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.584636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a58b8e-65aa-4941-a8d2-9de8a3404fba admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.585825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae71384-8f17-4428-9f3d-fe75edcfe440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.586459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae71384-8f17-4428-9f3d-fe75edcfe440 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.586739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae71384-8f17-4428-9f3d-fe75edcfe440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.587010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae71384-8f17-4428-9f3d-fe75edcfe440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.587650 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae71384-8f17-4428-9f3d-fe75edcfe440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.589087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb98189-92c0-48ff-a1fa-388cdc3f5708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.589257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae71384-8f17-4428-9f3d-fe75edcfe440 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.589658 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb98189-92c0-48ff-a1fa-388cdc3f5708 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.589963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb98189-92c0-48ff-a1fa-388cdc3f5708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.590231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb98189-92c0-48ff-a1fa-388cdc3f5708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.590850 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb98189-92c0-48ff-a1fa-388cdc3f5708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.592397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb98189-92c0-48ff-a1fa-388cdc3f5708 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.599940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 803/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.600743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae71384-8f17-4428-9f3d-fe75edcfe440 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.602848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 791/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.603865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb98189-92c0-48ff-a1fa-388cdc3f5708 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.611760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae71384-8f17-4428-9f3d-fe75edcfe440 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.613627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb98189-92c0-48ff-a1fa-388cdc3f5708 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.617387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0fac0-2b5b-42e8-98a6-b7172ccb4b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.618026 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0fac0-2b5b-42e8-98a6-b7172ccb4b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.618227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9119d-e40e-410f-b924-2062bb9c5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.618345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0fac0-2b5b-42e8-98a6-b7172ccb4b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.618555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0fac0-2b5b-42e8-98a6-b7172ccb4b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.618799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9119d-e40e-410f-b924-2062bb9c5a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.619068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9119d-e40e-410f-b924-2062bb9c5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.619197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0fac0-2b5b-42e8-98a6-b7172ccb4b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.619332 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9119d-e40e-410f-b924-2062bb9c5a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.619986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9119d-e40e-410f-b924-2062bb9c5a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.620805 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0fac0-2b5b-42e8-98a6-b7172ccb4b46 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.621591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9119d-e40e-410f-b924-2062bb9c5a3b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.631657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 804/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.635185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 792/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.635327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0fac0-2b5b-42e8-98a6-b7172ccb4b46 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.635441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9119d-e40e-410f-b924-2062bb9c5a3b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.642585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0fac0-2b5b-42e8-98a6-b7172ccb4b46 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.643764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9119d-e40e-410f-b924-2062bb9c5a3b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.647489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657a56-399f-4bf2-8756-4b8ba1a774e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.648084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657a56-399f-4bf2-8756-4b8ba1a774e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.648361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657a56-399f-4bf2-8756-4b8ba1a774e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.648467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378110b-1974-4700-b54f-a11db53e0351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.648629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657a56-399f-4bf2-8756-4b8ba1a774e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.648938 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378110b-1974-4700-b54f-a11db53e0351 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.649212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378110b-1974-4700-b54f-a11db53e0351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.649319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59657a56-399f-4bf2-8756-4b8ba1a774e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.649476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378110b-1974-4700-b54f-a11db53e0351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.650137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378110b-1974-4700-b54f-a11db53e0351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.650864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59657a56-399f-4bf2-8756-4b8ba1a774e2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.651711 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378110b-1974-4700-b54f-a11db53e0351 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.664052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 805/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.664052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657a56-399f-4bf2-8756-4b8ba1a774e2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.664300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 793/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.664300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378110b-1974-4700-b54f-a11db53e0351 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.671965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378110b-1974-4700-b54f-a11db53e0351 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.672381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657a56-399f-4bf2-8756-4b8ba1a774e2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.676555 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e61215-875c-4147-a196-7a1f2ea3f992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.676913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86166e31-42bf-40dc-a08f-d095250f523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.677153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e61215-875c-4147-a196-7a1f2ea3f992 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.677476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e61215-875c-4147-a196-7a1f2ea3f992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.677678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166e31-42bf-40dc-a08f-d095250f523d admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.677789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e61215-875c-4147-a196-7a1f2ea3f992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.678372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e61215-875c-4147-a196-7a1f2ea3f992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.678472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166e31-42bf-40dc-a08f-d095250f523d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.678749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166e31-42bf-40dc-a08f-d095250f523d admin admin] PATH_INFO: `/v3/projects/b56654f66be9494db618d9c82a70ab38/users/e5d4998f54924ecab01a6dbc64b6d9db/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.679981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e61215-875c-4147-a196-7a1f2ea3f992 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.691659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 794/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.692478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e61215-875c-4147-a196-7a1f2ea3f992 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.694961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86166e31-42bf-40dc-a08f-d095250f523d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56654f66be9494db618d9c82a70ab38, user_id=e5d4998f54924ecab01a6dbc64b6d9db, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.697482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86166e31-42bf-40dc-a08f-d095250f523d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.705314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e61215-875c-4147-a196-7a1f2ea3f992 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.707349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:14.712999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 806/1600] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:14 2022] PUT /identity/v3/projects/b56654f66be9494db618d9c82a70ab38/users/e5d4998f54924ecab01a6dbc64b6d9db/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:14.714214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86166e31-42bf-40dc-a08f-d095250f523d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.759263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:14.774384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba31ea-99cc-4836-afbc-0d5ea0eaa0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.775001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba31ea-99cc-4836-afbc-0d5ea0eaa0fc admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.775258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba31ea-99cc-4836-afbc-0d5ea0eaa0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.775524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba31ea-99cc-4836-afbc-0d5ea0eaa0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.776166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba31ea-99cc-4836-afbc-0d5ea0eaa0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.777769 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba31ea-99cc-4836-afbc-0d5ea0eaa0fc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.777895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86166e31-42bf-40dc-a08f-d095250f523d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.782447 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f621e8-0c76-4ca3-8138-208c51bfce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.783239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f621e8-0c76-4ca3-8138-208c51bfce36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.783404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f621e8-0c76-4ca3-8138-208c51bfce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.783723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f621e8-0c76-4ca3-8138-208c51bfce36 admin admin] PATH_INFO: `/v3/projects/f944c970a4a94d49ab5e35dc623324c5/users/7ee94d467982480390342612b23d4d81/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.788275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 795/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:14.789110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba31ea-99cc-4836-afbc-0d5ea0eaa0fc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.798689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba31ea-99cc-4836-afbc-0d5ea0eaa0fc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.799972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f621e8-0c76-4ca3-8138-208c51bfce36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f944c970a4a94d49ab5e35dc623324c5, user_id=7ee94d467982480390342612b23d4d81, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.803035 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f621e8-0c76-4ca3-8138-208c51bfce36 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.804504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f9b4-9f2a-4da8-92de-f2d4f0af41dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.805160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f9b4-9f2a-4da8-92de-f2d4f0af41dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.805437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f9b4-9f2a-4da8-92de-f2d4f0af41dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.805707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f9b4-9f2a-4da8-92de-f2d4f0af41dc admin admin] PATH_INFO: `/v3/projects/83571a1fae8643a7a7603ff20a27b211/users/f09e5e57f5d54fbca1f4adb91781aaff/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.817807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 807/1602] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:14 2022] PUT /identity/v3/projects/f944c970a4a94d49ab5e35dc623324c5/users/7ee94d467982480390342612b23d4d81/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:14.818901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f621e8-0c76-4ca3-8138-208c51bfce36 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.823131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0f9b4-9f2a-4da8-92de-f2d4f0af41dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=83571a1fae8643a7a7603ff20a27b211, user_id=f09e5e57f5d54fbca1f4adb91781aaff, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.825768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0f9b4-9f2a-4da8-92de-f2d4f0af41dc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.840407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 796/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:14 2022] PUT /identity/v3/projects/83571a1fae8643a7a7603ff20a27b211/users/f09e5e57f5d54fbca1f4adb91781aaff/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:14.841119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f9b4-9f2a-4da8-92de-f2d4f0af41dc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.886426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f621e8-0c76-4ca3-8138-208c51bfce36 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.904679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f9b4-9f2a-4da8-92de-f2d4f0af41dc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:14.909414 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ef7e6-bfb4-4e82-ba0f-7866b7ec9c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.910100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ef7e6-bfb4-4e82-ba0f-7866b7ec9c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.910418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ef7e6-bfb4-4e82-ba0f-7866b7ec9c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.910920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ef7e6-bfb4-4e82-ba0f-7866b7ec9c05 admin admin] PATH_INFO: `/v3/projects/371de922e78c4f9b92fb1597afb111fa/users/8a4aa6a4354845a094868ebd71e2d9bf/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.926034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ef7e6-bfb4-4e82-ba0f-7866b7ec9c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371de922e78c4f9b92fb1597afb111fa, user_id=8a4aa6a4354845a094868ebd71e2d9bf, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.928865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ef7e6-bfb4-4e82-ba0f-7866b7ec9c05 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.943894 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 797/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:14 2022] PUT /identity/v3/projects/371de922e78c4f9b92fb1597afb111fa/users/8a4aa6a4354845a094868ebd71e2d9bf/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:14.944586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ef7e6-bfb4-4e82-ba0f-7866b7ec9c05 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.953152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a5f2f-78ac-431c-8cb2-3daa90ce354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:14.954019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a5f2f-78ac-431c-8cb2-3daa90ce354d admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:14.954280 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a5f2f-78ac-431c-8cb2-3daa90ce354d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:14.954579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a5f2f-78ac-431c-8cb2-3daa90ce354d admin admin] PATH_INFO: `/v3/projects/f4f6c57bec6d4567bd1d8066e20e1945/users/664ca23211794b9dade2baf58b884c42/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:14.970345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a5f2f-78ac-431c-8cb2-3daa90ce354d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f6c57bec6d4567bd1d8066e20e1945, user_id=664ca23211794b9dade2baf58b884c42, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:14.972998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a5f2f-78ac-431c-8cb2-3daa90ce354d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:14.987090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 808/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:14 2022] PUT /identity/v3/projects/f4f6c57bec6d4567bd1d8066e20e1945/users/664ca23211794b9dade2baf58b884c42/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:14.987876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a5f2f-78ac-431c-8cb2-3daa90ce354d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:14.999660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:15.010647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ef7e6-bfb4-4e82-ba0f-7866b7ec9c05 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:15.050527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a5f2f-78ac-431c-8cb2-3daa90ce354d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:15.055682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409bafe-2fd8-4998-bf52-ba2add28452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:15.056372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409bafe-2fd8-4998-bf52-ba2add28452d admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.056644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409bafe-2fd8-4998-bf52-ba2add28452d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.056908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409bafe-2fd8-4998-bf52-ba2add28452d admin admin] PATH_INFO: `/v3/projects/70ea4d633ac449cfaca6c06bd55783c3/users/c2479b21c49f43518b7fe65b2e1d4080/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.059273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:15.071527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409bafe-2fd8-4998-bf52-ba2add28452d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ea4d633ac449cfaca6c06bd55783c3, user_id=c2479b21c49f43518b7fe65b2e1d4080, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:15.073331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708a413-09b6-4e3f-8741-ec3c3949e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:15.074020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a413-09b6-4e3f-8741-ec3c3949e460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.074204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409bafe-2fd8-4998-bf52-ba2add28452d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:15.074322 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a413-09b6-4e3f-8741-ec3c3949e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.074570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a413-09b6-4e3f-8741-ec3c3949e460 admin admin] PATH_INFO: `/v3/projects/2e9e0bbed9004d7398f04f9338335202/users/f1a734b8ca2d4658be2bc600d8c3f24d/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.087606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 809/1606] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:14 2022] PUT /identity/v3/projects/70ea4d633ac449cfaca6c06bd55783c3/users/c2479b21c49f43518b7fe65b2e1d4080/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:15.089277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708a413-09b6-4e3f-8741-ec3c3949e460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9e0bbed9004d7398f04f9338335202, user_id=f1a734b8ca2d4658be2bc600d8c3f24d, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:15.092013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708a413-09b6-4e3f-8741-ec3c3949e460 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:15.099908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166278f-27f4-47d8-8e61-0d0dcbd8d7ec None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.100356 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166278f-27f4-47d8-8e61-0d0dcbd8d7ec None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.100666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166278f-27f4-47d8-8e61-0d0dcbd8d7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.106362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 798/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:14 2022] PUT /identity/v3/projects/2e9e0bbed9004d7398f04f9338335202/users/f1a734b8ca2d4658be2bc600d8c3f24d/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:15.107139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708a413-09b6-4e3f-8741-ec3c3949e460 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:15.122572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9166278f-27f4-47d8-8e61-0d0dcbd8d7ec None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:15.123789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9166278f-27f4-47d8-8e61-0d0dcbd8d7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:15.167864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708a413-09b6-4e3f-8741-ec3c3949e460 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:15.172940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fefb0-cce8-4764-8927-6970c2212770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:15.173592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fefb0-cce8-4764-8927-6970c2212770 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.173857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fefb0-cce8-4764-8927-6970c2212770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.174148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fefb0-cce8-4764-8927-6970c2212770 admin admin] PATH_INFO: `/v3/projects/f6607f666a2c4cf99d2226913a1e228f/users/f59244f44d5845a5844e923de3653fb3/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.185995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 810/1608] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:15.187251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db1b4e-5f75-4eda-99d9-f888906f5430 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.187532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db1b4e-5f75-4eda-99d9-f888906f5430 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.187797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db1b4e-5f75-4eda-99d9-f888906f5430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.188996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fefb0-cce8-4764-8927-6970c2212770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6607f666a2c4cf99d2226913a1e228f, user_id=f59244f44d5845a5844e923de3653fb3, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:15.192074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fefb0-cce8-4764-8927-6970c2212770 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:15.207779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 799/1609] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:15 2022] PUT /identity/v3/projects/f6607f666a2c4cf99d2226913a1e228f/users/f59244f44d5845a5844e923de3653fb3/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:15.208164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-18db1b4e-5f75-4eda-99d9-f888906f5430 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:15.209593 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-18db1b4e-5f75-4eda-99d9-f888906f5430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:15.209872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805372d-c904-4f6e-9c21-7501d0dc2485 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.218742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805372d-c904-4f6e-9c21-7501d0dc2485 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.219146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805372d-c904-4f6e-9c21-7501d0dc2485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.242160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d805372d-c904-4f6e-9c21-7501d0dc2485 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:15.243369 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d805372d-c904-4f6e-9c21-7501d0dc2485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:15.269777 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 811/1610] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:15.270694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db1b4e-5f75-4eda-99d9-f888906f5430 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:15.281490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db1b4e-5f75-4eda-99d9-f888906f5430 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:15.287160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3f89f-03ec-468b-a5fe-002ecb206d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:15.288088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3f89f-03ec-468b-a5fe-002ecb206d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.288358 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3f89f-03ec-468b-a5fe-002ecb206d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.288622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3f89f-03ec-468b-a5fe-002ecb206d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.289271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3f89f-03ec-468b-a5fe-002ecb206d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:15.290906 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3f89f-03ec-468b-a5fe-002ecb206d62 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:15.301342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 812/1611] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:15.302683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8eba1-cfbe-4232-bc54-6f61e24ed9ae None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.302960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8eba1-cfbe-4232-bc54-6f61e24ed9ae None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.303253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8eba1-cfbe-4232-bc54-6f61e24ed9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.306081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 800/1612] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:15.307403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6d60-3fb4-4c0e-aed7-94d43b5f6219 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.307707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6d60-3fb4-4c0e-aed7-94d43b5f6219 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.307972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6d60-3fb4-4c0e-aed7-94d43b5f6219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.327287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-17a8eba1-cfbe-4232-bc54-6f61e24ed9ae None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:15.328525 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-17a8eba1-cfbe-4232-bc54-6f61e24ed9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:15.337444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 813/1613] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:15.338522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106939-6a78-457e-b20e-1cfa06f24aa9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.338804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106939-6a78-457e-b20e-1cfa06f24aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.339076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106939-6a78-457e-b20e-1cfa06f24aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.344608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-862d6d60-3fb4-4c0e-aed7-94d43b5f6219 None None] MFA Rules not processed for user `c2479b21c49f43518b7fe65b2e1d4080`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:15.346188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-862d6d60-3fb4-4c0e-aed7-94d43b5f6219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:15.360546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-46106939-6a78-457e-b20e-1cfa06f24aa9 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:15.361754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-46106939-6a78-457e-b20e-1cfa06f24aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:15.370109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 814/1614] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:15.372073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46106939-6a78-457e-b20e-1cfa06f24aa9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:15.385945 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:15.392238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:15.413484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 801/1615] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:15.414762 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ae6c2-250f-4c66-ada0-246abc0bb2f2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.415024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ae6c2-250f-4c66-ada0-246abc0bb2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.415295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ae6c2-250f-4c66-ada0-246abc0bb2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.437111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46106939-6a78-457e-b20e-1cfa06f24aa9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:15.442137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11072b-4ad9-49f3-8fb1-7cdcd8e7633a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:15.442723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11072b-4ad9-49f3-8fb1-7cdcd8e7633a service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.443137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11072b-4ad9-49f3-8fb1-7cdcd8e7633a service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.443398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11072b-4ad9-49f3-8fb1-7cdcd8e7633a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.447623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-eb4ae6c2-250f-4c66-ada0-246abc0bb2f2 None None] MFA Rules not processed for user `f59244f44d5845a5844e923de3653fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:15.448900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eb4ae6c2-250f-4c66-ada0-246abc0bb2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:15.454266 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11072b-4ad9-49f3-8fb1-7cdcd8e7633a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:15.456265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11072b-4ad9-49f3-8fb1-7cdcd8e7633a service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:15.466425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 815/1616] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:15.467252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11072b-4ad9-49f3-8fb1-7cdcd8e7633a service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:15.476600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11072b-4ad9-49f3-8fb1-7cdcd8e7633a service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:15.481485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520c408-2bf1-405e-951c-3462dd18fd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:15.482197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520c408-2bf1-405e-951c-3462dd18fd1f service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.482472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520c408-2bf1-405e-951c-3462dd18fd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.482995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520c408-2bf1-405e-951c-3462dd18fd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.494508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520c408-2bf1-405e-951c-3462dd18fd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:15.495920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520c408-2bf1-405e-951c-3462dd18fd1f service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:15.506747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 816/1617] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:15.507591 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520c408-2bf1-405e-951c-3462dd18fd1f service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:15.517113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520c408-2bf1-405e-951c-3462dd18fd1f service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:15.521380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 802/1618] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:15.521380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ae6c2-250f-4c66-ada0-246abc0bb2f2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:15.521380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eb4ae6c2-250f-4c66-ada0-246abc0bb2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:15.525959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d233df7-61b4-4c75-8f64-b19018c3a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:15.526703 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d233df7-61b4-4c75-8f64-b19018c3a9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.527344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d233df7-61b4-4c75-8f64-b19018c3a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.527687 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d233df7-61b4-4c75-8f64-b19018c3a9e2 admin admin] PATH_INFO: `/v3/projects/371de922e78c4f9b92fb1597afb111fa/users/8a4aa6a4354845a094868ebd71e2d9bf/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.530560 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d233df7-61b4-4c75-8f64-b19018c3a9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371de922e78c4f9b92fb1597afb111fa, user_id=8a4aa6a4354845a094868ebd71e2d9bf, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:15.532327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ae6c2-250f-4c66-ada0-246abc0bb2f2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:15.533327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d233df7-61b4-4c75-8f64-b19018c3a9e2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:15.536143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce196-bb85-4849-a0a3-0333cc160d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:15.536935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce196-bb85-4849-a0a3-0333cc160d8d service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.537218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce196-bb85-4849-a0a3-0333cc160d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.537516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce196-bb85-4849-a0a3-0333cc160d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.556180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 817/1619] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:15 2022] PUT /identity/v3/projects/371de922e78c4f9b92fb1597afb111fa/users/8a4aa6a4354845a094868ebd71e2d9bf/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:15.556180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d233df7-61b4-4c75-8f64-b19018c3a9e2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:15.556502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ce196-bb85-4849-a0a3-0333cc160d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:15.556502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ce196-bb85-4849-a0a3-0333cc160d8d service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:15.567684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 803/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:15.571373 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce196-bb85-4849-a0a3-0333cc160d8d service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:15.583473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce196-bb85-4849-a0a3-0333cc160d8d service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:15.644600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d233df7-61b4-4c75-8f64-b19018c3a9e2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:15.649569 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b9e18-94ee-4432-a72e-3d345386df36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:15.650437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b9e18-94ee-4432-a72e-3d345386df36 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.650822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b9e18-94ee-4432-a72e-3d345386df36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.651046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403d708-7832-4c47-8e09-0f86e1f73773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:15.652131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b9e18-94ee-4432-a72e-3d345386df36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.652261 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403d708-7832-4c47-8e09-0f86e1f73773 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.652674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403d708-7832-4c47-8e09-0f86e1f73773 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.652807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403d708-7832-4c47-8e09-0f86e1f73773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.736483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b9e18-94ee-4432-a72e-3d345386df36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:15.737983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b9e18-94ee-4432-a72e-3d345386df36 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:15.751856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 804/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:15.753545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536e0a-4577-4751-93aa-d97c92f28cee None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.754044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536e0a-4577-4751-93aa-d97c92f28cee None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.754524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536e0a-4577-4751-93aa-d97c92f28cee None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.755293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403d708-7832-4c47-8e09-0f86e1f73773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:15.757096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403d708-7832-4c47-8e09-0f86e1f73773 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:15.757292 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 805/1622] 10.222.0.20 () {54 vars in 961 bytes} [Thu Sep 22 22:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:10:15.758867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536e0a-4577-4751-93aa-d97c92f28cee None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:15.770707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 818/1623] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:15.772622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47239368-063b-4fd1-a419-583dd4ad99a0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.773861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47239368-063b-4fd1-a419-583dd4ad99a0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.774418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47239368-063b-4fd1-a419-583dd4ad99a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.777578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:15.823402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-47239368-063b-4fd1-a419-583dd4ad99a0 None None] MFA Rules not processed for user `8a4aa6a4354845a094868ebd71e2d9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:15.826512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-47239368-063b-4fd1-a419-583dd4ad99a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:15.834579 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536e0a-4577-4751-93aa-d97c92f28cee None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:15.841298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff6471-045f-4a4d-9361-1ce91f2af165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:15.842903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6471-045f-4a4d-9361-1ce91f2af165 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.851660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6471-045f-4a4d-9361-1ce91f2af165 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.852182 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6471-045f-4a4d-9361-1ce91f2af165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.884901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:15.941877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff6471-045f-4a4d-9361-1ce91f2af165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:15.943170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff6471-045f-4a4d-9361-1ce91f2af165 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:15.954921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 806/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:15.956330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad771e5-1931-46c7-8730-68f8ef089151 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:15.956668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad771e5-1931-46c7-8730-68f8ef089151 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:15.956861 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad771e5-1931-46c7-8730-68f8ef089151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:15.961271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 819/1625] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:15.980745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47239368-063b-4fd1-a419-583dd4ad99a0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:15.994657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47239368-063b-4fd1-a419-583dd4ad99a0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:16.000325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb9e6-3bdc-4b0a-a527-4a7c5cd85ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:16.002401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb9e6-3bdc-4b0a-a527-4a7c5cd85ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:16.002903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb9e6-3bdc-4b0a-a527-4a7c5cd85ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:16.003397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb9e6-3bdc-4b0a-a527-4a7c5cd85ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:16.018555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cb9e6-3bdc-4b0a-a527-4a7c5cd85ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:16.022480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cb9e6-3bdc-4b0a-a527-4a7c5cd85ec4 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:16.040293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fad771e5-1931-46c7-8730-68f8ef089151 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:16.041515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fad771e5-1931-46c7-8730-68f8ef089151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:16.054059 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 820/1626] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:16.181204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 807/1627] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Sep 22 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:16.191704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb9e6-3bdc-4b0a-a527-4a7c5cd85ec4 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:16.213699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb9e6-3bdc-4b0a-a527-4a7c5cd85ec4 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:16.229803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bda3d-3391-439a-af2c-d691819965b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:16.230642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bda3d-3391-439a-af2c-d691819965b8 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:16.232414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bda3d-3391-439a-af2c-d691819965b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:16.232688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bda3d-3391-439a-af2c-d691819965b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:16.372631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bda3d-3391-439a-af2c-d691819965b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:16.373880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bda3d-3391-439a-af2c-d691819965b8 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:16.389624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 821/1628] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:16.789428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9335-0831-4f8e-8beb-fb593679f23e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:16.790524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9335-0831-4f8e-8beb-fb593679f23e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:16.791053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9335-0831-4f8e-8beb-fb593679f23e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:16.793401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 808/1629] 10.222.0.20 () {54 vars in 912 bytes} [Thu Sep 22 22:10:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:10:16.804566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f510f11-0cb9-4cae-8afd-0503faefb3e0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:16.804848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f510f11-0cb9-4cae-8afd-0503faefb3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:16.805288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f510f11-0cb9-4cae-8afd-0503faefb3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:16.866758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0f510f11-0cb9-4cae-8afd-0503faefb3e0 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:16.868066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0f510f11-0cb9-4cae-8afd-0503faefb3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:16.893375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 822/1630] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:10:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:16.930417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce9335-0831-4f8e-8beb-fb593679f23e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:16.935444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f510f11-0cb9-4cae-8afd-0503faefb3e0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:16.953628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f510f11-0cb9-4cae-8afd-0503faefb3e0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:16.961167 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce9335-0831-4f8e-8beb-fb593679f23e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:16.971138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ff748-66da-4e1c-8843-3127f73a5780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:16.971602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff748-66da-4e1c-8843-3127f73a5780 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:16.971684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff748-66da-4e1c-8843-3127f73a5780 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:16.971888 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff748-66da-4e1c-8843-3127f73a5780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:16.994205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:16.994859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:16.995129 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:16.995393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] PATH_INFO: `/v3/users/1645075799ee49a0873f9da9ea2fff67` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:16.998634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1645075799ee49a0873f9da9ea2fff67)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:17.001188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:10:17.001188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: warnings.warn(msg) Sep 22 22:10:17.001188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: Sep 22 22:10:17.002809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:17.011288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ff748-66da-4e1c-8843-3127f73a5780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:17.012743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ff748-66da-4e1c-8843-3127f73a5780 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:17.033622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 823/1631] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:10:17.120037 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:17.138499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1645075799ee49a0873f9da9ea2fff67'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:17.139639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1645075799ee49a0873f9da9ea2fff67'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:17.159858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1645075799ee49a0873f9da9ea2fff67'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:17.189341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1645075799ee49a0873f9da9ea2fff67'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:17.191288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3b9d3a6e-6164-496b-8dc9-79da6bd02493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1645075799ee49a0873f9da9ea2fff67'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:17.242788 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 809/1632] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:16 2022] DELETE /identity/v3/users/1645075799ee49a0873f9da9ea2fff67 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:17.247479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463770aa-f63d-4517-9dc1-dbb5ffacbec3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:17.247762 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463770aa-f63d-4517-9dc1-dbb5ffacbec3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:17.248031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463770aa-f63d-4517-9dc1-dbb5ffacbec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:17.288371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-463770aa-f63d-4517-9dc1-dbb5ffacbec3 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:17.290765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-463770aa-f63d-4517-9dc1-dbb5ffacbec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:17.360341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0ed6-b0f3-45d6-9401-9842f7f2b9a8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:17.360655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0ed6-b0f3-45d6-9401-9842f7f2b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:17.360925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0ed6-b0f3-45d6-9401-9842f7f2b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:17.417397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ecac0ed6-b0f3-45d6-9401-9842f7f2b9a8 None None] MFA Rules not processed for user `7ee94d467982480390342612b23d4d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:17.418651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ecac0ed6-b0f3-45d6-9401-9842f7f2b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:17.456097 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 824/1633] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:17.467320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463770aa-f63d-4517-9dc1-dbb5ffacbec3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:17.469538 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-463770aa-f63d-4517-9dc1-dbb5ffacbec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:17.546393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:17.603821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 810/1634] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:17.608215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac0ed6-b0f3-45d6-9401-9842f7f2b9a8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:17.610481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ecac0ed6-b0f3-45d6-9401-9842f7f2b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:17.634133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463770aa-f63d-4517-9dc1-dbb5ffacbec3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:17.644901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae792e8-55e8-448d-8a20-ba6da7beddc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:17.647466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae792e8-55e8-448d-8a20-ba6da7beddc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:17.647807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae792e8-55e8-448d-8a20-ba6da7beddc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:17.648104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae792e8-55e8-448d-8a20-ba6da7beddc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:17.657576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac0ed6-b0f3-45d6-9401-9842f7f2b9a8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:17.671976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b83b8-2d06-4828-83d0-c8fdbe92b127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:17.672560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b83b8-2d06-4828-83d0-c8fdbe92b127 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:17.672813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b83b8-2d06-4828-83d0-c8fdbe92b127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:17.673082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b83b8-2d06-4828-83d0-c8fdbe92b127 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:17.673775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b83b8-2d06-4828-83d0-c8fdbe92b127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:17.676700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae792e8-55e8-448d-8a20-ba6da7beddc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:17.679281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae792e8-55e8-448d-8a20-ba6da7beddc6 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:17.681448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b83b8-2d06-4828-83d0-c8fdbe92b127 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:17.720259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 825/1635] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:10:17.753701 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 811/1636] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:17 2022] POST /identity/v3/projects => generated 405 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:10:17.757810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae792e8-55e8-448d-8a20-ba6da7beddc6 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:17.768644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae792e8-55e8-448d-8a20-ba6da7beddc6 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:17.876549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29d56-6630-4ff6-b8d3-39ec6f232ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:17.877281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29d56-6630-4ff6-b8d3-39ec6f232ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:17.877631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29d56-6630-4ff6-b8d3-39ec6f232ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:17.878122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29d56-6630-4ff6-b8d3-39ec6f232ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:17.878851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c29d56-6630-4ff6-b8d3-39ec6f232ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:17.881090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c29d56-6630-4ff6-b8d3-39ec6f232ff7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:17.943407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 826/1637] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:17 2022] POST /identity/v3/users => generated 309 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:10:17.948306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b83b8-2d06-4828-83d0-c8fdbe92b127 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:17.960037 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b83b8-2d06-4828-83d0-c8fdbe92b127 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:17.981218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bd722-b57c-4719-ab88-e43005a8a937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:17.982287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bd722-b57c-4719-ab88-e43005a8a937 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:17.982747 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bd722-b57c-4719-ab88-e43005a8a937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:17.984338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bd722-b57c-4719-ab88-e43005a8a937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:17.984338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bd722-b57c-4719-ab88-e43005a8a937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:17.986122 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bd722-b57c-4719-ab88-e43005a8a937 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:18.013999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 812/1638] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:18.018452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29d56-6630-4ff6-b8d3-39ec6f232ff7 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:18.046624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29d56-6630-4ff6-b8d3-39ec6f232ff7 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:18.052358 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa64009-4273-4362-8d05-4f0b9d6c5662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:18.053737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa64009-4273-4362-8d05-4f0b9d6c5662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:18.054370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa64009-4273-4362-8d05-4f0b9d6c5662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:18.054812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa64009-4273-4362-8d05-4f0b9d6c5662 admin admin] PATH_INFO: `/v3/projects/c6da1117d47945178703f5989edd1df1/users/d39a1accdbdc43c695c5d7d3cfb3e1c0/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:18.079123 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa64009-4273-4362-8d05-4f0b9d6c5662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6da1117d47945178703f5989edd1df1, user_id=d39a1accdbdc43c695c5d7d3cfb3e1c0, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:18.083904 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa64009-4273-4362-8d05-4f0b9d6c5662 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:18.116523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 827/1639] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:18 2022] PUT /identity/v3/projects/c6da1117d47945178703f5989edd1df1/users/d39a1accdbdc43c695c5d7d3cfb3e1c0/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:18.120373 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bd722-b57c-4719-ab88-e43005a8a937 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:18.136653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bd722-b57c-4719-ab88-e43005a8a937 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:18.259026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9dd3d-3ce3-4759-bf36-997b0a56dd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:18.259703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9dd3d-3ce3-4759-bf36-997b0a56dd51 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:18.259975 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9dd3d-3ce3-4759-bf36-997b0a56dd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:18.261377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9dd3d-3ce3-4759-bf36-997b0a56dd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:18.262356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9dd3d-3ce3-4759-bf36-997b0a56dd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:18.267422 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9dd3d-3ce3-4759-bf36-997b0a56dd51 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:18.289905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 813/1640] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:18.294251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa64009-4273-4362-8d05-4f0b9d6c5662 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:18.308392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa64009-4273-4362-8d05-4f0b9d6c5662 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:18.318628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7d776-5f13-49bc-b433-1551ef1ac5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:18.319681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7d776-5f13-49bc-b433-1551ef1ac5d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:18.320003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7d776-5f13-49bc-b433-1551ef1ac5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:18.320325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7d776-5f13-49bc-b433-1551ef1ac5d7 admin admin] PATH_INFO: `/v3/projects/c6da1117d47945178703f5989edd1df1/users/d39a1accdbdc43c695c5d7d3cfb3e1c0/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:18.325945 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7d776-5f13-49bc-b433-1551ef1ac5d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6da1117d47945178703f5989edd1df1, user_id=d39a1accdbdc43c695c5d7d3cfb3e1c0, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:18.331489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7d776-5f13-49bc-b433-1551ef1ac5d7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:18.363496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 828/1641] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:18 2022] PUT /identity/v3/projects/c6da1117d47945178703f5989edd1df1/users/d39a1accdbdc43c695c5d7d3cfb3e1c0/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:18.426546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5fc1-e2f7-48d6-aed1-d3a1f8ab63d9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:18.427264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5fc1-e2f7-48d6-aed1-d3a1f8ab63d9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:18.427904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5fc1-e2f7-48d6-aed1-d3a1f8ab63d9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:18.430078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 814/1642] 10.222.0.20 () {54 vars in 961 bytes} [Thu Sep 22 22:10:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:10:18.438018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7ef45-7ae7-4e4e-bb8e-92da4ca0f9cf None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:18.438229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7ef45-7ae7-4e4e-bb8e-92da4ca0f9cf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:18.438609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7ef45-7ae7-4e4e-bb8e-92da4ca0f9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:18.477977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-24f7ef45-7ae7-4e4e-bb8e-92da4ca0f9cf None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:18.479004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-24f7ef45-7ae7-4e4e-bb8e-92da4ca0f9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:18.668042 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 829/1643] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Sep 22 22:10:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:18.674368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aca57-3fe3-4152-86dc-dbc0bbeafb6f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:18.674882 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aca57-3fe3-4152-86dc-dbc0bbeafb6f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:18.675362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aca57-3fe3-4152-86dc-dbc0bbeafb6f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:18.676929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 815/1644] 10.222.0.20 () {54 vars in 912 bytes} [Thu Sep 22 22:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:10:18.684553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1e6d-8816-4cd0-916b-ffeb8cc5c7de None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:18.684955 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1e6d-8816-4cd0-916b-ffeb8cc5c7de None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:18.685494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1e6d-8816-4cd0-916b-ffeb8cc5c7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:18.727040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3a5e1e6d-8816-4cd0-916b-ffeb8cc5c7de None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:18.729982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3a5e1e6d-8816-4cd0-916b-ffeb8cc5c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:18.749165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 830/1645] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:10:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:18.762720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aca57-3fe3-4152-86dc-dbc0bbeafb6f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:18.764930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-973aca57-3fe3-4152-86dc-dbc0bbeafb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:18.790786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:18.858217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aca57-3fe3-4152-86dc-dbc0bbeafb6f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:18.862103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cf6b0-296c-4cb0-a34d-19ff0591792a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:18.862887 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cf6b0-296c-4cb0-a34d-19ff0591792a service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:18.863253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cf6b0-296c-4cb0-a34d-19ff0591792a service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:18.863617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cf6b0-296c-4cb0-a34d-19ff0591792a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:18.877720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cf6b0-296c-4cb0-a34d-19ff0591792a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:18.879683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cf6b0-296c-4cb0-a34d-19ff0591792a service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:18.893615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 816/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:20.537588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e1e6d-8816-4cd0-916b-ffeb8cc5c7de None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:20.539243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3a5e1e6d-8816-4cd0-916b-ffeb8cc5c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:20.567515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:20.736580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e1e6d-8816-4cd0-916b-ffeb8cc5c7de None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:20.742612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:20.743314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:20.743677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:20.743890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] PATH_INFO: `/v3/projects/64fa913be9c84feab67bbbb7f9982790` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:20.745033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fa913be9c84feab67bbbb7f9982790)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:20.746108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 22:10:20.746108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: warnings.warn(msg) Sep 22 22:10:20.746108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: Sep 22 22:10:20.747453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:20.858179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fa913be9c84feab67bbbb7f9982790', 'request_id': 'req-57dbf169-92b7-433d-9021-6738e72f4bc2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:20.874889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fa913be9c84feab67bbbb7f9982790', 'request_id': 'req-57dbf169-92b7-433d-9021-6738e72f4bc2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:20.886037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fa913be9c84feab67bbbb7f9982790', 'request_id': 'req-57dbf169-92b7-433d-9021-6738e72f4bc2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:20.923996 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] The token cache is being invalidate because project 64fa913be9c84feab67bbbb7f9982790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:20.924692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:20.927471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-57dbf169-92b7-433d-9021-6738e72f4bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:20.947254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 831/1647] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:20 2022] DELETE /identity/v3/projects/64fa913be9c84feab67bbbb7f9982790 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:20.947393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cf6b0-296c-4cb0-a34d-19ff0591792a service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:20.971460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cf6b0-296c-4cb0-a34d-19ff0591792a service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:21.155596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:21.156577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:21.157049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:21.157434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] PATH_INFO: `/v3/users/8a4aa6a4354845a094868ebd71e2d9bf` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:21.158794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4aa6a4354845a094868ebd71e2d9bf)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:21.160868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:21.254465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4aa6a4354845a094868ebd71e2d9bf'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:21.259014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4aa6a4354845a094868ebd71e2d9bf'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:21.277219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4aa6a4354845a094868ebd71e2d9bf'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:21.303466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4aa6a4354845a094868ebd71e2d9bf'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:21.304417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4aa6a4354845a094868ebd71e2d9bf'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:21.348938 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 817/1648] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:20 2022] DELETE /identity/v3/users/8a4aa6a4354845a094868ebd71e2d9bf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:21.762113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1e9f7-4b0b-4211-a376-b86625ebb6ff None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:21.763063 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1e9f7-4b0b-4211-a376-b86625ebb6ff None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:21.764008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1e9f7-4b0b-4211-a376-b86625ebb6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:21.831702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-20f1e9f7-4b0b-4211-a376-b86625ebb6ff None None] MFA Rules not processed for user `d39a1accdbdc43c695c5d7d3cfb3e1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:21.833078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-20f1e9f7-4b0b-4211-a376-b86625ebb6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:21.957998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 832/1649] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:21 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:22.588629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:22.597471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1e9f7-4b0b-4211-a376-b86625ebb6ff None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:22.597471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-20f1e9f7-4b0b-4211-a376-b86625ebb6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:22.600109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:22.678626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:22.699217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:22.761519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4546259-8555-4423-8a4b-658fe99ea7f1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:22.774291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1e9f7-4b0b-4211-a376-b86625ebb6ff None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:22.776615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:22.777521 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:22.777521 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:22.777801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] PATH_INFO: `/v3/projects/371de922e78c4f9b92fb1597afb111fa` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:22.779598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=371de922e78c4f9b92fb1597afb111fa)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:22.781281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:22.791613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd922eb-f076-419c-bf34-b34de35e80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:22.792402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd922eb-f076-419c-bf34-b34de35e80f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:22.792534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd922eb-f076-419c-bf34-b34de35e80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:22.792950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd922eb-f076-419c-bf34-b34de35e80f8 admin admin] PATH_INFO: `/v3/users/c2479b21c49f43518b7fe65b2e1d4080` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:22.794263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd922eb-f076-419c-bf34-b34de35e80f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2479b21c49f43518b7fe65b2e1d4080)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:22.796326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd922eb-f076-419c-bf34-b34de35e80f8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:22.902451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371de922e78c4f9b92fb1597afb111fa', 'request_id': 'req-449ca2bf-e247-42a1-85a3-419fe7c79002'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:22.905222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cd922eb-f076-419c-bf34-b34de35e80f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2479b21c49f43518b7fe65b2e1d4080'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:22.930677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cd922eb-f076-419c-bf34-b34de35e80f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2479b21c49f43518b7fe65b2e1d4080'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:22.931260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cd922eb-f076-419c-bf34-b34de35e80f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2479b21c49f43518b7fe65b2e1d4080'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:22.944255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371de922e78c4f9b92fb1597afb111fa', 'request_id': 'req-449ca2bf-e247-42a1-85a3-419fe7c79002'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:22.944443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cd922eb-f076-419c-bf34-b34de35e80f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2479b21c49f43518b7fe65b2e1d4080'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:22.959727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371de922e78c4f9b92fb1597afb111fa', 'request_id': 'req-449ca2bf-e247-42a1-85a3-419fe7c79002'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:22.972012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cd922eb-f076-419c-bf34-b34de35e80f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2479b21c49f43518b7fe65b2e1d4080'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:22.991507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] The token cache is being invalidate because project 371de922e78c4f9b92fb1597afb111fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:22.992024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:22.995236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-449ca2bf-e247-42a1-85a3-419fe7c79002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:22.995467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 833/1650] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:22 2022] DELETE /identity/v3/users/c2479b21c49f43518b7fe65b2e1d4080 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:22.999451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 818/1651] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:22 2022] DELETE /identity/v3/projects/371de922e78c4f9b92fb1597afb111fa => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:23.000244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8db70-4a26-4b18-b9cd-2c89132d4267 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:23.000536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8db70-4a26-4b18-b9cd-2c89132d4267 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:23.000813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8db70-4a26-4b18-b9cd-2c89132d4267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:23.007797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44f4af-bf1f-4e8b-a7b4-925f7243641e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:23.008556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44f4af-bf1f-4e8b-a7b4-925f7243641e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:23.008970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44f4af-bf1f-4e8b-a7b4-925f7243641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:23.046718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-41b8db70-4a26-4b18-b9cd-2c89132d4267 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:23.048182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-41b8db70-4a26-4b18-b9cd-2c89132d4267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:23.082677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ec44f4af-bf1f-4e8b-a7b4-925f7243641e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:23.088041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ec44f4af-bf1f-4e8b-a7b4-925f7243641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:23.161630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 834/1652] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:23.217559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8db70-4a26-4b18-b9cd-2c89132d4267 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:23.219113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-41b8db70-4a26-4b18-b9cd-2c89132d4267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:23.395572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 819/1653] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:23.405612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5158ac-aa7e-41d6-abcf-9134f0f32b6a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:23.406071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5158ac-aa7e-41d6-abcf-9134f0f32b6a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:23.406518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5158ac-aa7e-41d6-abcf-9134f0f32b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:23.435546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:23.463784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8db70-4a26-4b18-b9cd-2c89132d4267 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:23.471798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6f5158ac-aa7e-41d6-abcf-9134f0f32b6a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:23.479612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6f5158ac-aa7e-41d6-abcf-9134f0f32b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:23.481134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086fb22-0ab6-46da-bc61-6b5170c46c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:23.490548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086fb22-0ab6-46da-bc61-6b5170c46c9a service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:23.491500 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086fb22-0ab6-46da-bc61-6b5170c46c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:23.493365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086fb22-0ab6-46da-bc61-6b5170c46c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:23.510893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 820/1654] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:23.517604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5158ac-aa7e-41d6-abcf-9134f0f32b6a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:23.540651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5158ac-aa7e-41d6-abcf-9134f0f32b6a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:23.564014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086fb22-0ab6-46da-bc61-6b5170c46c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:23.566641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbf5bf-47f6-4c0a-bebb-f7561c2615c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:23.567284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf5bf-47f6-4c0a-bebb-f7561c2615c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:23.567560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf5bf-47f6-4c0a-bebb-f7561c2615c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:23.567831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf5bf-47f6-4c0a-bebb-f7561c2615c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:23.568819 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbf5bf-47f6-4c0a-bebb-f7561c2615c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:23.569145 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbf5bf-47f6-4c0a-bebb-f7561c2615c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:23.570606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086fb22-0ab6-46da-bc61-6b5170c46c9a service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:23.570738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbf5bf-47f6-4c0a-bebb-f7561c2615c2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:23.609678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 835/1655] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:10:23.620661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 821/1656] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:23.623348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086fb22-0ab6-46da-bc61-6b5170c46c9a service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:23.669096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086fb22-0ab6-46da-bc61-6b5170c46c9a service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:23.689066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65c337-9475-4236-9afe-d995c015d73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:23.692220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65c337-9475-4236-9afe-d995c015d73c admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:23.693749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65c337-9475-4236-9afe-d995c015d73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:23.695902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65c337-9475-4236-9afe-d995c015d73c admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:23.696594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65c337-9475-4236-9afe-d995c015d73c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:23.707896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65c337-9475-4236-9afe-d995c015d73c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:23.843188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 836/1657] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:23 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:23.846907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbf5bf-47f6-4c0a-bebb-f7561c2615c2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:23.864655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbf5bf-47f6-4c0a-bebb-f7561c2615c2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:24.042195 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:24.112884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca503e38-3b15-443c-9d40-89137a2fb333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:24.113520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503e38-3b15-443c-9d40-89137a2fb333 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:24.113795 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503e38-3b15-443c-9d40-89137a2fb333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:24.114088 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503e38-3b15-443c-9d40-89137a2fb333 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:24.114746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca503e38-3b15-443c-9d40-89137a2fb333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:24.117016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca503e38-3b15-443c-9d40-89137a2fb333 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:24.168232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 822/1658] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:23 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:24.173760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65c337-9475-4236-9afe-d995c015d73c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:24.235060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65c337-9475-4236-9afe-d995c015d73c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:24.274465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0d016-b00a-42ee-a54a-32b2584bbac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:24.275718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0d016-b00a-42ee-a54a-32b2584bbac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:24.278927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0d016-b00a-42ee-a54a-32b2584bbac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:24.279589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0d016-b00a-42ee-a54a-32b2584bbac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:24.280860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0d016-b00a-42ee-a54a-32b2584bbac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:24.284672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0d016-b00a-42ee-a54a-32b2584bbac9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:24.361987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 837/1659] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:24.367000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca503e38-3b15-443c-9d40-89137a2fb333 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:24.392009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca503e38-3b15-443c-9d40-89137a2fb333 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:24.405544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15849f12-535f-4800-80f0-f7cb163248e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:24.406443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849f12-535f-4800-80f0-f7cb163248e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:24.406717 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849f12-535f-4800-80f0-f7cb163248e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:24.406987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849f12-535f-4800-80f0-f7cb163248e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:24.407652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15849f12-535f-4800-80f0-f7cb163248e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:24.411327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15849f12-535f-4800-80f0-f7cb163248e9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:24.450603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 823/1660] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:24.455344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0d016-b00a-42ee-a54a-32b2584bbac9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:24.480839 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0d016-b00a-42ee-a54a-32b2584bbac9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:24.494775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459186cc-c7d1-42d1-a5b3-64d941877d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:24.497075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459186cc-c7d1-42d1-a5b3-64d941877d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:24.499303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459186cc-c7d1-42d1-a5b3-64d941877d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:24.499803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459186cc-c7d1-42d1-a5b3-64d941877d08 admin admin] PATH_INFO: `/v3/projects/6db6d94b932e45cfad7f392a80ea389e/users/16227603336d485e85d0405be0a08908/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:24.564636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459186cc-c7d1-42d1-a5b3-64d941877d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db6d94b932e45cfad7f392a80ea389e, user_id=16227603336d485e85d0405be0a08908, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:24.573704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459186cc-c7d1-42d1-a5b3-64d941877d08 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:24.627791 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 838/1661] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:24 2022] PUT /identity/v3/projects/6db6d94b932e45cfad7f392a80ea389e/users/16227603336d485e85d0405be0a08908/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:24.630703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01160f9-e5bf-4b19-bd7c-184ca655891e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:24.631253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01160f9-e5bf-4b19-bd7c-184ca655891e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:24.631253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01160f9-e5bf-4b19-bd7c-184ca655891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:24.715137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d01160f9-e5bf-4b19-bd7c-184ca655891e None None] MFA Rules not processed for user `16227603336d485e85d0405be0a08908`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:24.718529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d01160f9-e5bf-4b19-bd7c-184ca655891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:24.902238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 824/1662] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:24.909689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459186cc-c7d1-42d1-a5b3-64d941877d08 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:25.035720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459186cc-c7d1-42d1-a5b3-64d941877d08 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:25.045431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d7208-aa77-4232-9ed8-510fdf3a6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:25.046164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d7208-aa77-4232-9ed8-510fdf3a6c70 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:25.046444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d7208-aa77-4232-9ed8-510fdf3a6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:25.046721 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d7208-aa77-4232-9ed8-510fdf3a6c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:25.047376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d7208-aa77-4232-9ed8-510fdf3a6c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:25.052107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d7208-aa77-4232-9ed8-510fdf3a6c70 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:25.113132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01160f9-e5bf-4b19-bd7c-184ca655891e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:25.133616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 839/1663] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:24 2022] POST /identity/v3/projects => generated 387 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:25.141715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01160f9-e5bf-4b19-bd7c-184ca655891e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:25.238762 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9f2b5-e3db-4cb9-a985-cdb59ec33caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:25.239626 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f2b5-e3db-4cb9-a985-cdb59ec33caf admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:25.240155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f2b5-e3db-4cb9-a985-cdb59ec33caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:25.240560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f2b5-e3db-4cb9-a985-cdb59ec33caf admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:25.241388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9f2b5-e3db-4cb9-a985-cdb59ec33caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:25.244406 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9f2b5-e3db-4cb9-a985-cdb59ec33caf admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:25.282584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 825/1664] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:25 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:25.287809 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d7208-aa77-4232-9ed8-510fdf3a6c70 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:25.307050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d7208-aa77-4232-9ed8-510fdf3a6c70 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:25.328686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cf2b4-11d2-4470-affb-c6acd65f26f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:25.329432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cf2b4-11d2-4470-affb-c6acd65f26f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:25.329856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cf2b4-11d2-4470-affb-c6acd65f26f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:25.330911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cf2b4-11d2-4470-affb-c6acd65f26f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:25.331760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cf2b4-11d2-4470-affb-c6acd65f26f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:25.334901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cf2b4-11d2-4470-affb-c6acd65f26f5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:25.366697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 840/1665] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:25.367268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9f2b5-e3db-4cb9-a985-cdb59ec33caf admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:25.400070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9f2b5-e3db-4cb9-a985-cdb59ec33caf admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:25.425501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce40c69-a5db-4d92-94a0-ccceeaceadc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:25.426579 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40c69-a5db-4d92-94a0-ccceeaceadc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:25.429437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40c69-a5db-4d92-94a0-ccceeaceadc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:25.429953 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40c69-a5db-4d92-94a0-ccceeaceadc9 admin admin] PATH_INFO: `/v3/projects/42d9336cfc704bbeae37a52da2bc7a26/users/6d8ba3e9018b47fe89c62bb5e7767c7a/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:25.462366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce40c69-a5db-4d92-94a0-ccceeaceadc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d9336cfc704bbeae37a52da2bc7a26, user_id=6d8ba3e9018b47fe89c62bb5e7767c7a, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:25.465803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce40c69-a5db-4d92-94a0-ccceeaceadc9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:25.503781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 826/1666] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:25 2022] PUT /identity/v3/projects/42d9336cfc704bbeae37a52da2bc7a26/users/6d8ba3e9018b47fe89c62bb5e7767c7a/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:25.505275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cf2b4-11d2-4470-affb-c6acd65f26f5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:25.522232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cf2b4-11d2-4470-affb-c6acd65f26f5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:25.650691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb66319-601d-4f7c-9dff-99e996d839e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:25.651427 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb66319-601d-4f7c-9dff-99e996d839e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:25.651714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb66319-601d-4f7c-9dff-99e996d839e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:25.651977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb66319-601d-4f7c-9dff-99e996d839e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:25.652665 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb66319-601d-4f7c-9dff-99e996d839e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:25.658361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb66319-601d-4f7c-9dff-99e996d839e2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:25.670670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:25.685974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 841/1667] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:25.690946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce40c69-a5db-4d92-94a0-ccceeaceadc9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:25.713815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce40c69-a5db-4d92-94a0-ccceeaceadc9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:25.723745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67ec4-fbfa-483a-b102-e30b2b2312cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:25.725400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67ec4-fbfa-483a-b102-e30b2b2312cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:25.727101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67ec4-fbfa-483a-b102-e30b2b2312cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:25.728223 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67ec4-fbfa-483a-b102-e30b2b2312cd admin admin] PATH_INFO: `/v3/projects/42d9336cfc704bbeae37a52da2bc7a26/users/6d8ba3e9018b47fe89c62bb5e7767c7a/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:25.734375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a67ec4-fbfa-483a-b102-e30b2b2312cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d9336cfc704bbeae37a52da2bc7a26, user_id=6d8ba3e9018b47fe89c62bb5e7767c7a, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:25.737593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a67ec4-fbfa-483a-b102-e30b2b2312cd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:25.774146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 827/1668] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:25 2022] PUT /identity/v3/projects/42d9336cfc704bbeae37a52da2bc7a26/users/6d8ba3e9018b47fe89c62bb5e7767c7a/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:25.787515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6daa64-fdef-46ac-8452-0eca75559f5e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:25.789446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6daa64-fdef-46ac-8452-0eca75559f5e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:25.789993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6daa64-fdef-46ac-8452-0eca75559f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:25.887020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6e6daa64-fdef-46ac-8452-0eca75559f5e None None] MFA Rules not processed for user `6d8ba3e9018b47fe89c62bb5e7767c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:25.891676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6e6daa64-fdef-46ac-8452-0eca75559f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:26.069055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 842/1669] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:26.084945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67ec4-fbfa-483a-b102-e30b2b2312cd admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:26.086831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-73a67ec4-fbfa-483a-b102-e30b2b2312cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:26.092334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:26.274417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67ec4-fbfa-483a-b102-e30b2b2312cd admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:26.290459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d811df-984f-4f52-a967-a04b82db396a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:26.291099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d811df-984f-4f52-a967-a04b82db396a service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:26.291374 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d811df-984f-4f52-a967-a04b82db396a service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:26.291637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d811df-984f-4f52-a967-a04b82db396a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:26.311953 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d811df-984f-4f52-a967-a04b82db396a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:26.313664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d811df-984f-4f52-a967-a04b82db396a service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:26.338804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 828/1670] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:26.625297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725e32a-9c07-4e0c-9eba-78d8c71b64e6 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:26.625602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725e32a-9c07-4e0c-9eba-78d8c71b64e6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:26.625884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725e32a-9c07-4e0c-9eba-78d8c71b64e6 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:26.627682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 843/1671] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:10:26.716351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5767-e7b5-410d-addf-e9500da68daa None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:26.716843 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5767-e7b5-410d-addf-e9500da68daa None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:26.716953 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5767-e7b5-410d-addf-e9500da68daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:26.782625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e2cd5767-e7b5-410d-addf-e9500da68daa None None] MFA Rules not processed for user `2c7f2566918b4c719486d1ce285724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:26.783900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e2cd5767-e7b5-410d-addf-e9500da68daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:27.052591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 829/1672] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:10:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:27.135737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725e32a-9c07-4e0c-9eba-78d8c71b64e6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:27.140329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d725e32a-9c07-4e0c-9eba-78d8c71b64e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:27.197254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725e32a-9c07-4e0c-9eba-78d8c71b64e6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:27.219004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b51b6-4b46-4a08-b0d3-32fd2075892a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:27.219759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b51b6-4b46-4a08-b0d3-32fd2075892a service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:27.220061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b51b6-4b46-4a08-b0d3-32fd2075892a service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:27.220398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b51b6-4b46-4a08-b0d3-32fd2075892a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:27.245438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b51b6-4b46-4a08-b0d3-32fd2075892a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:27.247128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b51b6-4b46-4a08-b0d3-32fd2075892a service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:27.266215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 844/1673] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:10:27.755444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd5767-e7b5-410d-addf-e9500da68daa None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:27.975926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd5767-e7b5-410d-addf-e9500da68daa None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:27.985955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:27.986673 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:27.986951 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:27.987221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] PATH_INFO: `/v3/users/16227603336d485e85d0405be0a08908` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:27.992946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16227603336d485e85d0405be0a08908)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:27.995602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:28.086368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b51b6-4b46-4a08-b0d3-32fd2075892a service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:28.089103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-299b51b6-4b46-4a08-b0d3-32fd2075892a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:28.112321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b51b6-4b46-4a08-b0d3-32fd2075892a service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:28.122151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:28.122731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:28.122852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:28.123069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:28.124684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] PATH_INFO: `/v3/projects/70ea4d633ac449cfaca6c06bd55783c3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:28.129448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16227603336d485e85d0405be0a08908'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.131152 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16227603336d485e85d0405be0a08908'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.132377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ea4d633ac449cfaca6c06bd55783c3)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:28.134386 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:28.155189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16227603336d485e85d0405be0a08908'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.170136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16227603336d485e85d0405be0a08908'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.170970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16227603336d485e85d0405be0a08908'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.224779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 830/1674] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:27 2022] DELETE /identity/v3/users/16227603336d485e85d0405be0a08908 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:28.226102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:28.228100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:28.245988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ea4d633ac449cfaca6c06bd55783c3', 'request_id': 'req-70a96885-957d-49f9-b7ab-1a1fd4443347'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.262336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ea4d633ac449cfaca6c06bd55783c3', 'request_id': 'req-70a96885-957d-49f9-b7ab-1a1fd4443347'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.269536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ea4d633ac449cfaca6c06bd55783c3', 'request_id': 'req-70a96885-957d-49f9-b7ab-1a1fd4443347'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.306913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] The token cache is being invalidate because project 70ea4d633ac449cfaca6c06bd55783c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:28.307283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.308904 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-70a96885-957d-49f9-b7ab-1a1fd4443347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.312153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 845/1675] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:28 2022] DELETE /identity/v3/projects/70ea4d633ac449cfaca6c06bd55783c3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:10:28.315468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d36dd8-a1eb-4271-ac45-82e20e05d084 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:28.315468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d36dd8-a1eb-4271-ac45-82e20e05d084 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:28.315468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d36dd8-a1eb-4271-ac45-82e20e05d084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:28.362728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e79d5e-804e-4244-a8f4-a5b22506aa0d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:28.364470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-23d36dd8-a1eb-4271-ac45-82e20e05d084 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:28.365360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-23d36dd8-a1eb-4271-ac45-82e20e05d084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:28.368168 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ec7d4-615e-439a-9516-05a55963efdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:28.368813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ec7d4-615e-439a-9516-05a55963efdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:28.369086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ec7d4-615e-439a-9516-05a55963efdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:28.369435 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ec7d4-615e-439a-9516-05a55963efdd admin admin] PATH_INFO: `/v3/users/f59244f44d5845a5844e923de3653fb3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:28.370735 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ec7d4-615e-439a-9516-05a55963efdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59244f44d5845a5844e923de3653fb3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:28.372801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ec7d4-615e-439a-9516-05a55963efdd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:28.380335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 846/1676] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:28.382000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581316a-bf66-4ce6-8740-b041d52c5ca0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:28.382369 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581316a-bf66-4ce6-8740-b041d52c5ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:28.382685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581316a-bf66-4ce6-8740-b041d52c5ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:28.426456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b581316a-bf66-4ce6-8740-b041d52c5ca0 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:28.427965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b581316a-bf66-4ce6-8740-b041d52c5ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:28.460433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f09ec7d4-615e-439a-9516-05a55963efdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59244f44d5845a5844e923de3653fb3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.461244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f09ec7d4-615e-439a-9516-05a55963efdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59244f44d5845a5844e923de3653fb3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.470350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 847/1677] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:28.477186 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581316a-bf66-4ce6-8740-b041d52c5ca0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:28.477186 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b581316a-bf66-4ce6-8740-b041d52c5ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:28.478939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f09ec7d4-615e-439a-9516-05a55963efdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59244f44d5845a5844e923de3653fb3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.493131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f09ec7d4-615e-439a-9516-05a55963efdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59244f44d5845a5844e923de3653fb3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.514275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f09ec7d4-615e-439a-9516-05a55963efdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59244f44d5845a5844e923de3653fb3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:28.572842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 831/1678] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:28 2022] DELETE /identity/v3/users/f59244f44d5845a5844e923de3653fb3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:28.572842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e104f1f-c5d2-46eb-b507-3effd6684e6f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:28.572842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e104f1f-c5d2-46eb-b507-3effd6684e6f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:28.572842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e104f1f-c5d2-46eb-b507-3effd6684e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:28.602838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:28.611108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9e104f1f-c5d2-46eb-b507-3effd6684e6f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:28.612286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9e104f1f-c5d2-46eb-b507-3effd6684e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:28.641771 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581316a-bf66-4ce6-8740-b041d52c5ca0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:28.697101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:28.753770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 832/1679] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:28.754863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd1f77-d3fc-4994-a8a8-291e7c620925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:28.755091 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237845b-b481-43ee-886b-93b3aae14249 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:28.755776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237845b-b481-43ee-886b-93b3aae14249 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:28.756603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd1f77-d3fc-4994-a8a8-291e7c620925 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:28.756690 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237845b-b481-43ee-886b-93b3aae14249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:28.756769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd1f77-d3fc-4994-a8a8-291e7c620925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:28.756769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd1f77-d3fc-4994-a8a8-291e7c620925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:28.765766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c3bd1f77-d3fc-4994-a8a8-291e7c620925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:28.778168 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8237845b-b481-43ee-886b-93b3aae14249 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:28.779521 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8237845b-b481-43ee-886b-93b3aae14249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:28.790156 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 833/1680] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:28.791003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237845b-b481-43ee-886b-93b3aae14249 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:28.791099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd1f77-d3fc-4994-a8a8-291e7c620925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:28.792453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd1f77-d3fc-4994-a8a8-291e7c620925 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:28.804970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237845b-b481-43ee-886b-93b3aae14249 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:28.811841 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12074ff8-a1d2-49db-b3cd-203be7b039cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:28.812746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12074ff8-a1d2-49db-b3cd-203be7b039cd admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:28.813420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12074ff8-a1d2-49db-b3cd-203be7b039cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:28.813950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12074ff8-a1d2-49db-b3cd-203be7b039cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:28.815085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12074ff8-a1d2-49db-b3cd-203be7b039cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:28.816257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12074ff8-a1d2-49db-b3cd-203be7b039cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:28.818317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12074ff8-a1d2-49db-b3cd-203be7b039cd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:28.819693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 848/1681] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:28.823689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd1f77-d3fc-4994-a8a8-291e7c620925 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:28.825145 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c3bd1f77-d3fc-4994-a8a8-291e7c620925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:28.835952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 834/1682] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:28.842731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12074ff8-a1d2-49db-b3cd-203be7b039cd admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:28.844486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd1f77-d3fc-4994-a8a8-291e7c620925 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:28.857172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cacc9-0083-490f-b46c-c3a866f68f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:28.857824 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cacc9-0083-490f-b46c-c3a866f68f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:28.858126 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cacc9-0083-490f-b46c-c3a866f68f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:28.858405 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cacc9-0083-490f-b46c-c3a866f68f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:28.859091 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12074ff8-a1d2-49db-b3cd-203be7b039cd admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:28.866114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d89a2-9d15-4dfc-bda9-546e54cec938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:28.867333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d89a2-9d15-4dfc-bda9-546e54cec938 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:28.867774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d89a2-9d15-4dfc-bda9-546e54cec938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:28.868336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d89a2-9d15-4dfc-bda9-546e54cec938 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:28.869955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d89a2-9d15-4dfc-bda9-546e54cec938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:28.872729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d89a2-9d15-4dfc-bda9-546e54cec938 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:28.890843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cacc9-0083-490f-b46c-c3a866f68f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:28.892375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cacc9-0083-490f-b46c-c3a866f68f7d service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:28.919836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 849/1683] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:10:28.924022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 835/1684] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:28 2022] POST /identity/v3/projects => generated 405 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:28.926687 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cacc9-0083-490f-b46c-c3a866f68f7d service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:28.937680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cacc9-0083-490f-b46c-c3a866f68f7d service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:29.066713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789c701-8a1b-44a8-bb1b-00539bef7fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:29.067368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789c701-8a1b-44a8-bb1b-00539bef7fab admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:29.068192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789c701-8a1b-44a8-bb1b-00539bef7fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:29.068192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789c701-8a1b-44a8-bb1b-00539bef7fab admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:29.068648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789c701-8a1b-44a8-bb1b-00539bef7fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:29.071554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789c701-8a1b-44a8-bb1b-00539bef7fab admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:29.121694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 850/1685] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:28 2022] POST /identity/v3/users => generated 303 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:10:29.125808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d89a2-9d15-4dfc-bda9-546e54cec938 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:29.141325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d89a2-9d15-4dfc-bda9-546e54cec938 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:29.153577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cd785-6a8f-4fad-8c17-365cf3971b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:29.154323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cd785-6a8f-4fad-8c17-365cf3971b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:29.154606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cd785-6a8f-4fad-8c17-365cf3971b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:29.155002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cd785-6a8f-4fad-8c17-365cf3971b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:29.155749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cd785-6a8f-4fad-8c17-365cf3971b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:29.157453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cd785-6a8f-4fad-8c17-365cf3971b74 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:29.177782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 836/1686] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:10:29.181071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789c701-8a1b-44a8-bb1b-00539bef7fab admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:29.196937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789c701-8a1b-44a8-bb1b-00539bef7fab admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:29.205115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b040f1-9e88-43f5-b2bb-700444888111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:29.205781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b040f1-9e88-43f5-b2bb-700444888111 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:29.206090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b040f1-9e88-43f5-b2bb-700444888111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:29.206441 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b040f1-9e88-43f5-b2bb-700444888111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:29.207163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b040f1-9e88-43f5-b2bb-700444888111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:29.209193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b040f1-9e88-43f5-b2bb-700444888111 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:29.232698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 851/1687] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:29.236839 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cd785-6a8f-4fad-8c17-365cf3971b74 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:29.251171 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cd785-6a8f-4fad-8c17-365cf3971b74 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:29.262537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b7909-bce4-44cd-8890-3c8ea9e9fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:29.263393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7909-bce4-44cd-8890-3c8ea9e9fb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:29.263771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7909-bce4-44cd-8890-3c8ea9e9fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:29.264131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7909-bce4-44cd-8890-3c8ea9e9fb27 admin admin] PATH_INFO: `/v3/projects/386e3b20ac0845db86c79cdf9fca2a87/users/05d27637433043fab58ec30fdf1b9e63/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:29.286530 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b7909-bce4-44cd-8890-3c8ea9e9fb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386e3b20ac0845db86c79cdf9fca2a87, user_id=05d27637433043fab58ec30fdf1b9e63, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:29.291126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b7909-bce4-44cd-8890-3c8ea9e9fb27 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:29.313357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 837/1688] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:29 2022] PUT /identity/v3/projects/386e3b20ac0845db86c79cdf9fca2a87/users/05d27637433043fab58ec30fdf1b9e63/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:29.328474 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38370e64-684b-40e7-abf5-bfa32db4b217 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:29.329018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38370e64-684b-40e7-abf5-bfa32db4b217 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:29.329499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38370e64-684b-40e7-abf5-bfa32db4b217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:29.432149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b7909-bce4-44cd-8890-3c8ea9e9fb27 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:29.434452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5c2b7909-bce4-44cd-8890-3c8ea9e9fb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:29.467774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-38370e64-684b-40e7-abf5-bfa32db4b217 None None] MFA Rules not processed for user `05d27637433043fab58ec30fdf1b9e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:29.469206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-38370e64-684b-40e7-abf5-bfa32db4b217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:29.609781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:29.630340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b7909-bce4-44cd-8890-3c8ea9e9fb27 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:29.632741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 852/1689] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:29.633926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38370e64-684b-40e7-abf5-bfa32db4b217 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:29.656450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203620b4-7600-46de-b832-582696243d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:29.657050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203620b4-7600-46de-b832-582696243d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:29.657323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203620b4-7600-46de-b832-582696243d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:29.657594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203620b4-7600-46de-b832-582696243d2f admin admin] PATH_INFO: `/v3/users/7ee94d467982480390342612b23d4d81` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:29.658706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38370e64-684b-40e7-abf5-bfa32db4b217 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:29.662162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203620b4-7600-46de-b832-582696243d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee94d467982480390342612b23d4d81)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:29.664379 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203620b4-7600-46de-b832-582696243d2f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:29.678214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb321-620f-4bcd-9379-0fcd04303a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:29.679395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb321-620f-4bcd-9379-0fcd04303a05 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:29.680103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb321-620f-4bcd-9379-0fcd04303a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:29.680788 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb321-620f-4bcd-9379-0fcd04303a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:29.682295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb321-620f-4bcd-9379-0fcd04303a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:29.691123 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb321-620f-4bcd-9379-0fcd04303a05 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:29.785455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 853/1690] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:29 2022] POST /identity/v3/projects => generated 405 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:29.790072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb321-620f-4bcd-9379-0fcd04303a05 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:29.794727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-203620b4-7600-46de-b832-582696243d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee94d467982480390342612b23d4d81'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:29.796533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-203620b4-7600-46de-b832-582696243d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee94d467982480390342612b23d4d81'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:29.816554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-203620b4-7600-46de-b832-582696243d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee94d467982480390342612b23d4d81'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:29.827010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-203620b4-7600-46de-b832-582696243d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee94d467982480390342612b23d4d81'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:29.827871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-203620b4-7600-46de-b832-582696243d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee94d467982480390342612b23d4d81'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:29.835492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:29.887751 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 838/1691] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:29 2022] DELETE /identity/v3/users/7ee94d467982480390342612b23d4d81 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:10:29.976211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb321-620f-4bcd-9379-0fcd04303a05 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:30.128544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12998a-2940-4cec-8a01-449168906394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:30.129566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12998a-2940-4cec-8a01-449168906394 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:30.130161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12998a-2940-4cec-8a01-449168906394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:30.130654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12998a-2940-4cec-8a01-449168906394 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:30.132064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12998a-2940-4cec-8a01-449168906394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:30.140817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12998a-2940-4cec-8a01-449168906394 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:30.202850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 854/1692] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:29 2022] POST /identity/v3/users => generated 309 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:30.206613 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203620b4-7600-46de-b832-582696243d2f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:30.208604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-203620b4-7600-46de-b832-582696243d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:30.236300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203620b4-7600-46de-b832-582696243d2f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:30.255148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dcd51-8871-4e51-a4e3-0d328f01d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:30.255852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dcd51-8871-4e51-a4e3-0d328f01d5bb admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:30.256118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dcd51-8871-4e51-a4e3-0d328f01d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:30.256373 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dcd51-8871-4e51-a4e3-0d328f01d5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:30.257028 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dcd51-8871-4e51-a4e3-0d328f01d5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:30.263442 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dcd51-8871-4e51-a4e3-0d328f01d5bb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:30.301441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 839/1693] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:10:30.305147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12998a-2940-4cec-8a01-449168906394 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:30.316105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12998a-2940-4cec-8a01-449168906394 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:30.338689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ef806-3e77-4d8a-8718-6958d80e83c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:30.339376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ef806-3e77-4d8a-8718-6958d80e83c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:30.345608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ef806-3e77-4d8a-8718-6958d80e83c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:30.346004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ef806-3e77-4d8a-8718-6958d80e83c3 admin admin] PATH_INFO: `/v3/projects/0bab60c6792a47f486d61491fbb0e142/users/2952163d98534305a9cc1aceac845d79/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:30.432949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ef806-3e77-4d8a-8718-6958d80e83c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bab60c6792a47f486d61491fbb0e142, user_id=2952163d98534305a9cc1aceac845d79, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:30.435559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ef806-3e77-4d8a-8718-6958d80e83c3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:30.470815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 855/1694] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:30 2022] PUT /identity/v3/projects/0bab60c6792a47f486d61491fbb0e142/users/2952163d98534305a9cc1aceac845d79/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:30.474773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dcd51-8871-4e51-a4e3-0d328f01d5bb admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:30.496060 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dcd51-8871-4e51-a4e3-0d328f01d5bb admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:30.639739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455661b-9407-4847-8d0d-1c85d2629cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:30.642716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455661b-9407-4847-8d0d-1c85d2629cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:30.643006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455661b-9407-4847-8d0d-1c85d2629cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:30.643346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455661b-9407-4847-8d0d-1c85d2629cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:30.644037 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455661b-9407-4847-8d0d-1c85d2629cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:30.651777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455661b-9407-4847-8d0d-1c85d2629cdd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:30.654044 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ef806-3e77-4d8a-8718-6958d80e83c3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:30.656093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c07ef806-3e77-4d8a-8718-6958d80e83c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:30.680631 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 840/1695] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:30.681311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ef806-3e77-4d8a-8718-6958d80e83c3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:30.682118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455661b-9407-4847-8d0d-1c85d2629cdd admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:30.693410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:30.694801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:30.700470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:30.702813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] PATH_INFO: `/v3/projects/f6607f666a2c4cf99d2226913a1e228f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:30.707347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455661b-9407-4847-8d0d-1c85d2629cdd admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:30.708425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6607f666a2c4cf99d2226913a1e228f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:30.712989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:30.718968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e54c8-74e2-45e1-be12-7541b5bb9a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:30.719727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e54c8-74e2-45e1-be12-7541b5bb9a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:30.720002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e54c8-74e2-45e1-be12-7541b5bb9a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:30.720273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e54c8-74e2-45e1-be12-7541b5bb9a6f admin admin] PATH_INFO: `/v3/projects/0bab60c6792a47f486d61491fbb0e142/users/2952163d98534305a9cc1aceac845d79/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:30.722335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e54c8-74e2-45e1-be12-7541b5bb9a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bab60c6792a47f486d61491fbb0e142, user_id=2952163d98534305a9cc1aceac845d79, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:30.728183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e54c8-74e2-45e1-be12-7541b5bb9a6f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:30.776242 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 841/1696] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:30 2022] PUT /identity/v3/projects/0bab60c6792a47f486d61491fbb0e142/users/2952163d98534305a9cc1aceac845d79/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:30.792381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aeb04-4139-4cac-9906-8afa5d1f02fc None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:30.792679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aeb04-4139-4cac-9906-8afa5d1f02fc None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:30.792927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aeb04-4139-4cac-9906-8afa5d1f02fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:30.840467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:30.853875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6607f666a2c4cf99d2226913a1e228f', 'request_id': 'req-46a2c751-c5a0-4d56-9170-df6a75b82f1e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:30.879212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-352aeb04-4139-4cac-9906-8afa5d1f02fc None None] MFA Rules not processed for user `f09e5e57f5d54fbca1f4adb91781aaff`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:30.883772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6607f666a2c4cf99d2226913a1e228f', 'request_id': 'req-46a2c751-c5a0-4d56-9170-df6a75b82f1e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:30.904461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-352aeb04-4139-4cac-9906-8afa5d1f02fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:30.906407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6607f666a2c4cf99d2226913a1e228f', 'request_id': 'req-46a2c751-c5a0-4d56-9170-df6a75b82f1e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:30.935056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] The token cache is being invalidate because project f6607f666a2c4cf99d2226913a1e228f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:30.935335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:30.936128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-46a2c751-c5a0-4d56-9170-df6a75b82f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:30.943454 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 856/1697] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:30 2022] DELETE /identity/v3/projects/f6607f666a2c4cf99d2226913a1e228f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:30.952752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd46d1-abf6-49ee-8960-cbd1cb2d1432 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:30.953794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd46d1-abf6-49ee-8960-cbd1cb2d1432 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:30.954351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd46d1-abf6-49ee-8960-cbd1cb2d1432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:30.997456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c3cd46d1-abf6-49ee-8960-cbd1cb2d1432 None None] MFA Rules not processed for user `2952163d98534305a9cc1aceac845d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:30.998799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c3cd46d1-abf6-49ee-8960-cbd1cb2d1432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:31.070270 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 842/1698] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:31.071413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352aeb04-4139-4cac-9906-8afa5d1f02fc None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:31.082757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-352aeb04-4139-4cac-9906-8afa5d1f02fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:31.156309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 857/1699] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:31.156309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0234cd-49b4-47b0-82c5-817dad4a89b5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:31.156309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0234cd-49b4-47b0-82c5-817dad4a89b5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:31.156309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0234cd-49b4-47b0-82c5-817dad4a89b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:31.165629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:31.204439 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-de0234cd-49b4-47b0-82c5-817dad4a89b5 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:31.206290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-de0234cd-49b4-47b0-82c5-817dad4a89b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:31.218466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352aeb04-4139-4cac-9906-8afa5d1f02fc None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:31.221499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 858/1700] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:31.222490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0234cd-49b4-47b0-82c5-817dad4a89b5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:31.229933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-de0234cd-49b4-47b0-82c5-817dad4a89b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:31.238387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:31.242163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:31.242457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:31.242708 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] PATH_INFO: `/v3/projects/6db6d94b932e45cfad7f392a80ea389e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:31.252757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db6d94b932e45cfad7f392a80ea389e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:31.268217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0234cd-49b4-47b0-82c5-817dad4a89b5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:31.279325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:31.299066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:31.299742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:31.300019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:31.300291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] PATH_INFO: `/v3/projects/f944c970a4a94d49ab5e35dc623324c5` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:31.301503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f944c970a4a94d49ab5e35dc623324c5)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:31.303466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:31.430268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db6d94b932e45cfad7f392a80ea389e', 'request_id': 'req-981f1a46-261a-4f0e-b535-6b0277165ffb'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:31.441164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db6d94b932e45cfad7f392a80ea389e', 'request_id': 'req-981f1a46-261a-4f0e-b535-6b0277165ffb'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:31.449866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f944c970a4a94d49ab5e35dc623324c5', 'request_id': 'req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:31.461896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db6d94b932e45cfad7f392a80ea389e', 'request_id': 'req-981f1a46-261a-4f0e-b535-6b0277165ffb'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:31.468481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f944c970a4a94d49ab5e35dc623324c5', 'request_id': 'req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:31.478498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f944c970a4a94d49ab5e35dc623324c5', 'request_id': 'req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:31.490624 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] The token cache is being invalidate because project 6db6d94b932e45cfad7f392a80ea389e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:31.491506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:31.493294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-981f1a46-261a-4f0e-b535-6b0277165ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:31.496190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 843/1701] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:31 2022] DELETE /identity/v3/projects/6db6d94b932e45cfad7f392a80ea389e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:31.502128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfb08-046c-43f6-aa32-2e99832afacd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:31.502508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfb08-046c-43f6-aa32-2e99832afacd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:31.502857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfb08-046c-43f6-aa32-2e99832afacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:31.515293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] The token cache is being invalidate because project f944c970a4a94d49ab5e35dc623324c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:31.515854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:31.516740 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:31.518881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 859/1702] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:31 2022] DELETE /identity/v3/projects/f944c970a4a94d49ab5e35dc623324c5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:31.519969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:31.523108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:31.557620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-84ecfb08-046c-43f6-aa32-2e99832afacd None None] MFA Rules not processed for user `f09e5e57f5d54fbca1f4adb91781aaff`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:31.558907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-84ecfb08-046c-43f6-aa32-2e99832afacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:31.587347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:31.621146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8c9bb-ae4b-4a3c-bba6-56fd83af6198 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:31.633917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cd93e-4adc-45bb-8e90-4d45956158a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:31.636288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cd93e-4adc-45bb-8e90-4d45956158a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:31.639732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cd93e-4adc-45bb-8e90-4d45956158a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:31.640223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cd93e-4adc-45bb-8e90-4d45956158a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:31.646705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6e7cd93e-4adc-45bb-8e90-4d45956158a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:31.711368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 844/1703] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:31.712666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3ce32-82e7-445c-9c06-d19e6f90265d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:31.713015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3ce32-82e7-445c-9c06-d19e6f90265d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:31.713385 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3ce32-82e7-445c-9c06-d19e6f90265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:31.769714 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d8b3ce32-82e7-445c-9c06-d19e6f90265d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:31.771428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d8b3ce32-82e7-445c-9c06-d19e6f90265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:31.840370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cd93e-4adc-45bb-8e90-4d45956158a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:31.843617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cd93e-4adc-45bb-8e90-4d45956158a5 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:31.869167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 860/1704] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:31 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:31.872896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cd93e-4adc-45bb-8e90-4d45956158a5 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:31.874697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6e7cd93e-4adc-45bb-8e90-4d45956158a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:31.937261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 845/1705] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:31.938381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3ce32-82e7-445c-9c06-d19e6f90265d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:31.942322 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d8b3ce32-82e7-445c-9c06-d19e6f90265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:31.980888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3ce32-82e7-445c-9c06-d19e6f90265d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:31.987555 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:31.988213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:31.988489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:31.989195 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] PATH_INFO: `/v3/users/d39a1accdbdc43c695c5d7d3cfb3e1c0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:31.991318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39a1accdbdc43c695c5d7d3cfb3e1c0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:31.993710 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:32.021778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:32.097083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39a1accdbdc43c695c5d7d3cfb3e1c0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.099506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39a1accdbdc43c695c5d7d3cfb3e1c0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.109139 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cd93e-4adc-45bb-8e90-4d45956158a5 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:32.118415 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:32.120022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:32.120700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:32.122697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] PATH_INFO: `/v3/users/6d8ba3e9018b47fe89c62bb5e7767c7a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:32.124643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39a1accdbdc43c695c5d7d3cfb3e1c0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.125877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8ba3e9018b47fe89c62bb5e7767c7a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:32.131996 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:32.139317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39a1accdbdc43c695c5d7d3cfb3e1c0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.149083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39a1accdbdc43c695c5d7d3cfb3e1c0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.207097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 846/1706] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:31 2022] DELETE /identity/v3/users/d39a1accdbdc43c695c5d7d3cfb3e1c0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:32.207097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:32.207097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:32.257240 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8ba3e9018b47fe89c62bb5e7767c7a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.278155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8ba3e9018b47fe89c62bb5e7767c7a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.278780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8ba3e9018b47fe89c62bb5e7767c7a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.292610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8ba3e9018b47fe89c62bb5e7767c7a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.331465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8ba3e9018b47fe89c62bb5e7767c7a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.336665 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:32.346879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 861/1707] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:31 2022] DELETE /identity/v3/users/6d8ba3e9018b47fe89c62bb5e7767c7a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:32.348143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:32.354944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:32.361108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69509e-7899-4287-a32e-9c12786f07ec admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:32.574427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72331902-4840-402e-b685-c25b7833ca57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:32.575163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72331902-4840-402e-b685-c25b7833ca57 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:32.575466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72331902-4840-402e-b685-c25b7833ca57 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:32.575773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72331902-4840-402e-b685-c25b7833ca57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:32.584776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35b469-b060-428d-bd60-fa4449a25f97 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:32.586872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-72331902-4840-402e-b685-c25b7833ca57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:32.607050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049c154-7acf-41d1-8a9a-31430e6f4c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:32.607928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049c154-7acf-41d1-8a9a-31430e6f4c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:32.608032 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049c154-7acf-41d1-8a9a-31430e6f4c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:32.608236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049c154-7acf-41d1-8a9a-31430e6f4c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:32.608899 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049c154-7acf-41d1-8a9a-31430e6f4c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:32.609196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049c154-7acf-41d1-8a9a-31430e6f4c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:32.613815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049c154-7acf-41d1-8a9a-31430e6f4c26 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:32.677480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 862/1708] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:32.678553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049c154-7acf-41d1-8a9a-31430e6f4c26 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:32.686905 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d049c154-7acf-41d1-8a9a-31430e6f4c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:32.722171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049c154-7acf-41d1-8a9a-31430e6f4c26 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:32.740776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:32.741639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:32.742388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:32.745862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] PATH_INFO: `/v3/users/05d27637433043fab58ec30fdf1b9e63` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:32.749393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d27637433043fab58ec30fdf1b9e63)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:32.758681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:32.776390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:32.916743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d27637433043fab58ec30fdf1b9e63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.944983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d27637433043fab58ec30fdf1b9e63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.946535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d27637433043fab58ec30fdf1b9e63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.957342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d27637433043fab58ec30fdf1b9e63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:32.973284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72331902-4840-402e-b685-c25b7833ca57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:32.975440 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72331902-4840-402e-b685-c25b7833ca57 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:33.001546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d27637433043fab58ec30fdf1b9e63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:33.022659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 847/1709] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 818 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:33.023999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa6916-6ce9-4ba9-befa-a70e1bd67f08 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:33.024278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa6916-6ce9-4ba9-befa-a70e1bd67f08 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:33.024550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa6916-6ce9-4ba9-befa-a70e1bd67f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:33.034378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 863/1710] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:32 2022] DELETE /identity/v3/users/05d27637433043fab58ec30fdf1b9e63 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:33.037557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:33.050261 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:33.097264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1baa6916-6ce9-4ba9-befa-a70e1bd67f08 None None] MFA Rules not processed for user `664ca23211794b9dade2baf58b884c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:33.099310 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1baa6916-6ce9-4ba9-befa-a70e1bd67f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:33.221892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2b6ba-2948-4a78-979b-108a648b8e98 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:33.236291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b20fe1-3c2b-4242-9059-6bc2f0e97089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:33.236941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b20fe1-3c2b-4242-9059-6bc2f0e97089 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:33.237218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b20fe1-3c2b-4242-9059-6bc2f0e97089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:33.237496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b20fe1-3c2b-4242-9059-6bc2f0e97089 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:33.238321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b20fe1-3c2b-4242-9059-6bc2f0e97089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:33.240437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b20fe1-3c2b-4242-9059-6bc2f0e97089 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:33.272157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:33.283414 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 848/1711] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:33.293482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacbffe-8408-49b7-b775-67685713cc5e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:33.293896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacbffe-8408-49b7-b775-67685713cc5e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:33.294057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacbffe-8408-49b7-b775-67685713cc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:33.312096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 864/1712] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:33 2022] POST /identity/v3/projects => generated 365 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:33.316324 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91c9a-bebc-4f68-b928-caa8dccf9952 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:33.316785 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91c9a-bebc-4f68-b928-caa8dccf9952 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:33.317471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91c9a-bebc-4f68-b928-caa8dccf9952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:33.352059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4bacbffe-8408-49b7-b775-67685713cc5e None None] MFA Rules not processed for user `e5d4998f54924ecab01a6dbc64b6d9db`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:33.353300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4bacbffe-8408-49b7-b775-67685713cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:33.370108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bda91c9a-bebc-4f68-b928-caa8dccf9952 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:33.374394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bda91c9a-bebc-4f68-b928-caa8dccf9952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:33.529226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 849/1713] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:33.540350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacbffe-8408-49b7-b775-67685713cc5e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:33.543209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4bacbffe-8408-49b7-b775-67685713cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:33.555882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 865/1714] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:33.556968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda91c9a-bebc-4f68-b928-caa8dccf9952 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:33.572503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda91c9a-bebc-4f68-b928-caa8dccf9952 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:33.579439 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b283c-1e67-4c88-a56f-8de91b531c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:33.580330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b283c-1e67-4c88-a56f-8de91b531c74 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:33.580618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b283c-1e67-4c88-a56f-8de91b531c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:33.580889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b283c-1e67-4c88-a56f-8de91b531c74 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:33.581907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b283c-1e67-4c88-a56f-8de91b531c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:33.584508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b283c-1e67-4c88-a56f-8de91b531c74 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:33.627629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 866/1715] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:33 2022] POST /identity/v3/users => generated 283 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:33.628706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b283c-1e67-4c88-a56f-8de91b531c74 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:33.648282 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b283c-1e67-4c88-a56f-8de91b531c74 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:33.664890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da1135-c4d9-401d-9b6b-3cdc6fd36bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:33.665533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da1135-c4d9-401d-9b6b-3cdc6fd36bff admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:33.665812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da1135-c4d9-401d-9b6b-3cdc6fd36bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:33.666126 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da1135-c4d9-401d-9b6b-3cdc6fd36bff admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:33.666793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da1135-c4d9-401d-9b6b-3cdc6fd36bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:33.673939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da1135-c4d9-401d-9b6b-3cdc6fd36bff admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:33.688633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:33.699876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 867/1716] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:33.700775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da1135-c4d9-401d-9b6b-3cdc6fd36bff admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:33.711779 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-10da1135-c4d9-401d-9b6b-3cdc6fd36bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:33.768603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacbffe-8408-49b7-b775-67685713cc5e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:33.782580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7140896-9470-4e59-b30b-fdd6fbb3cbd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:33.783583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140896-9470-4e59-b30b-fdd6fbb3cbd7 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:33.784075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140896-9470-4e59-b30b-fdd6fbb3cbd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:33.784529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140896-9470-4e59-b30b-fdd6fbb3cbd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:33.866211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da1135-c4d9-401d-9b6b-3cdc6fd36bff admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:33.878488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af406bd-0fd7-49b0-b5f6-cae58bb658fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:33.879308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af406bd-0fd7-49b0-b5f6-cae58bb658fc service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:33.879725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af406bd-0fd7-49b0-b5f6-cae58bb658fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:33.880316 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af406bd-0fd7-49b0-b5f6-cae58bb658fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:33.912407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af406bd-0fd7-49b0-b5f6-cae58bb658fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:33.915374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af406bd-0fd7-49b0-b5f6-cae58bb658fc service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:33.921849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7140896-9470-4e59-b30b-fdd6fbb3cbd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:33.924268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7140896-9470-4e59-b30b-fdd6fbb3cbd7 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:33.936596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 868/1717] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:33.939691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af406bd-0fd7-49b0-b5f6-cae58bb658fc service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:33.942405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 850/1718] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:33.944844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c89ae-8835-47d1-97bf-d330b32d4e79 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:33.945294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c89ae-8835-47d1-97bf-d330b32d4e79 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:33.945640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c89ae-8835-47d1-97bf-d330b32d4e79 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:33.948362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 851/1719] 10.222.0.20 () {54 vars in 912 bytes} [Thu Sep 22 22:10:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:10:33.949730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c89ae-8835-47d1-97bf-d330b32d4e79 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:33.951880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-678c89ae-8835-47d1-97bf-d330b32d4e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:33.965963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af406bd-0fd7-49b0-b5f6-cae58bb658fc service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:33.991865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0f4b5-4f37-4bbd-9edb-aaae5fadf11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:33.992506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f4b5-4f37-4bbd-9edb-aaae5fadf11d admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:33.992786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f4b5-4f37-4bbd-9edb-aaae5fadf11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:33.995243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c89ae-8835-47d1-97bf-d330b32d4e79 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:33.996437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f4b5-4f37-4bbd-9edb-aaae5fadf11d admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:33.997142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0f4b5-4f37-4bbd-9edb-aaae5fadf11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:34.000790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0f4b5-4f37-4bbd-9edb-aaae5fadf11d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:34.002643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:34.004413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:34.004929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:34.005372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] PATH_INFO: `/v3/projects/c6da1117d47945178703f5989edd1df1` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:34.007241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6da1117d47945178703f5989edd1df1)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:34.010132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:34.026893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 869/1720] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:34.031862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474e4d-0819-4229-ba8c-5ede95a179ae None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:34.032157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474e4d-0819-4229-ba8c-5ede95a179ae None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:34.038330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474e4d-0819-4229-ba8c-5ede95a179ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:34.153103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a2474e4d-0819-4229-ba8c-5ede95a179ae None None] MFA Rules not processed for user `d512b60a42ed456a82dff11d17b77c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:34.154470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a2474e4d-0819-4229-ba8c-5ede95a179ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:34.157691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6da1117d47945178703f5989edd1df1', 'request_id': 'req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:34.173696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6da1117d47945178703f5989edd1df1', 'request_id': 'req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:34.211294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6da1117d47945178703f5989edd1df1', 'request_id': 'req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:34.238720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] The token cache is being invalidate because project c6da1117d47945178703f5989edd1df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:34.239239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:34.242899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:34.247737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 852/1721] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:33 2022] DELETE /identity/v3/projects/c6da1117d47945178703f5989edd1df1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:34.251403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:34.254872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:34.314176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:34.404650 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 870/1722] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:10:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:34.405495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2474e4d-0819-4229-ba8c-5ede95a179ae None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:34.414930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a2474e4d-0819-4229-ba8c-5ede95a179ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:34.509297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bf84c-9da9-40f9-97a8-c0df6f3b76d0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:34.519609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:34.520167 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:34.520443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:34.521143 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] PATH_INFO: `/v3/projects/42d9336cfc704bbeae37a52da2bc7a26` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:34.522069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d9336cfc704bbeae37a52da2bc7a26)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:34.537478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:34.563897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:34.652888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d9336cfc704bbeae37a52da2bc7a26', 'request_id': 'req-0588cbc1-c318-4589-a9b6-50af107cab65'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:34.662603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2474e4d-0819-4229-ba8c-5ede95a179ae None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:34.665097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d9336cfc704bbeae37a52da2bc7a26', 'request_id': 'req-0588cbc1-c318-4589-a9b6-50af107cab65'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:34.680277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d9336cfc704bbeae37a52da2bc7a26', 'request_id': 'req-0588cbc1-c318-4589-a9b6-50af107cab65'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:34.760380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] The token cache is being invalidate because project 42d9336cfc704bbeae37a52da2bc7a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:34.760828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:34.761675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:34.766677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 853/1723] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:34 2022] DELETE /identity/v3/projects/42d9336cfc704bbeae37a52da2bc7a26 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:34.766677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:34.768120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:34.804285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7047d37-fb24-4741-9eb2-f0183613fa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:34.805265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047d37-fb24-4741-9eb2-f0183613fa2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:34.807492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047d37-fb24-4741-9eb2-f0183613fa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:34.807938 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047d37-fb24-4741-9eb2-f0183613fa2a admin admin] PATH_INFO: `/v3/projects/095e5304b32b44ab90cebdb30bdb68d1/users/56316c76d3a8459b9a8643a5aa808948/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:34.847396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7047d37-fb24-4741-9eb2-f0183613fa2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=095e5304b32b44ab90cebdb30bdb68d1, user_id=56316c76d3a8459b9a8643a5aa808948, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:34.850234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7047d37-fb24-4741-9eb2-f0183613fa2a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:34.899621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 871/1724] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:34 2022] PUT /identity/v3/projects/095e5304b32b44ab90cebdb30bdb68d1/users/56316c76d3a8459b9a8643a5aa808948/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:34.909668 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717157a-151d-43a1-af6e-f345e2cd0117 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:34.909668 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717157a-151d-43a1-af6e-f345e2cd0117 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:34.909668 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717157a-151d-43a1-af6e-f345e2cd0117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:34.942158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588cbc1-c318-4589-a9b6-50af107cab65 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:34.963072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4717157a-151d-43a1-af6e-f345e2cd0117 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:34.964345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4717157a-151d-43a1-af6e-f345e2cd0117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:35.099550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 872/1725] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:35.100496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717157a-151d-43a1-af6e-f345e2cd0117 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:35.107445 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4717157a-151d-43a1-af6e-f345e2cd0117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:35.130052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af58bbd-bca9-4255-a348-6905a4b3a18b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:35.132620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58bbd-bca9-4255-a348-6905a4b3a18b service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:35.133049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58bbd-bca9-4255-a348-6905a4b3a18b service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:35.133503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58bbd-bca9-4255-a348-6905a4b3a18b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:35.135980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4af58bbd-bca9-4255-a348-6905a4b3a18b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:35.173444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:35.246411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:35.249380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717157a-151d-43a1-af6e-f345e2cd0117 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:35.261132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361ca38-94ee-4930-a87c-a1bad28b1604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:35.262159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361ca38-94ee-4930-a87c-a1bad28b1604 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:35.262483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361ca38-94ee-4930-a87c-a1bad28b1604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:35.262765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361ca38-94ee-4930-a87c-a1bad28b1604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:35.269499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1361ca38-94ee-4930-a87c-a1bad28b1604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:35.292742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361ca38-94ee-4930-a87c-a1bad28b1604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:35.295491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361ca38-94ee-4930-a87c-a1bad28b1604 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:35.309455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af58bbd-bca9-4255-a348-6905a4b3a18b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:35.317201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 873/1726] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:35.318747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921fb0-451b-4768-a862-c9667f4d0485 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:35.319248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af58bbd-bca9-4255-a348-6905a4b3a18b service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:35.323655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921fb0-451b-4768-a862-c9667f4d0485 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:35.323939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921fb0-451b-4768-a862-c9667f4d0485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:35.335761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 854/1727] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:35.347025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e97d2-6e4c-4f76-afb4-fe8a6a94b805 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:35.347313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e97d2-6e4c-4f76-afb4-fe8a6a94b805 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:35.349050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e97d2-6e4c-4f76-afb4-fe8a6a94b805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:35.385642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7d921fb0-451b-4768-a862-c9667f4d0485 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:35.397338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7d921fb0-451b-4768-a862-c9667f4d0485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:35.424849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 874/1728] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:35.436341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d921fb0-451b-4768-a862-c9667f4d0485 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:35.446985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7d921fb0-451b-4768-a862-c9667f4d0485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:35.465377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-640e97d2-6e4c-4f76-afb4-fe8a6a94b805 None None] MFA Rules not processed for user `56316c76d3a8459b9a8643a5aa808948`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:35.467104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-640e97d2-6e4c-4f76-afb4-fe8a6a94b805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:35.472064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d921fb0-451b-4768-a862-c9667f4d0485 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:35.478614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:35.479660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:35.481348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:35.481912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] PATH_INFO: `/v3/projects/386e3b20ac0845db86c79cdf9fca2a87` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:35.483323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386e3b20ac0845db86c79cdf9fca2a87)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:35.485379 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:35.567002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386e3b20ac0845db86c79cdf9fca2a87', 'request_id': 'req-aa842c6c-4070-4812-b60c-f74ce7631e52'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:35.585770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386e3b20ac0845db86c79cdf9fca2a87', 'request_id': 'req-aa842c6c-4070-4812-b60c-f74ce7631e52'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:35.607850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386e3b20ac0845db86c79cdf9fca2a87', 'request_id': 'req-aa842c6c-4070-4812-b60c-f74ce7631e52'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:35.641820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 855/1729] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:35.646433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a2d1-251a-438d-bd95-52cde831317f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:35.646848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a2d1-251a-438d-bd95-52cde831317f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:35.647153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a2d1-251a-438d-bd95-52cde831317f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:35.650292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] The token cache is being invalidate because project 386e3b20ac0845db86c79cdf9fca2a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:35.650585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:35.656365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-aa842c6c-4070-4812-b60c-f74ce7631e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:35.658791 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 875/1730] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:35 2022] DELETE /identity/v3/projects/386e3b20ac0845db86c79cdf9fca2a87 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:35.661494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f29aff-763a-4ec2-9469-116177c750d7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:35.661929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f29aff-763a-4ec2-9469-116177c750d7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:35.663038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f29aff-763a-4ec2-9469-116177c750d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:35.700999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7540a2d1-251a-438d-bd95-52cde831317f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:35.705794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7540a2d1-251a-438d-bd95-52cde831317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:35.765940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-19f29aff-763a-4ec2-9469-116177c750d7 None None] MFA Rules not processed for user `f1a734b8ca2d4658be2bc600d8c3f24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:35.767270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-19f29aff-763a-4ec2-9469-116177c750d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:35.865585 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 856/1731] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:35.870057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabc046-f429-4a8b-93d1-7c5bb87db568 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:35.870382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabc046-f429-4a8b-93d1-7c5bb87db568 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:35.870972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabc046-f429-4a8b-93d1-7c5bb87db568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:35.938905 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 876/1732] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:35.940884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f29aff-763a-4ec2-9469-116177c750d7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:35.943630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-19f29aff-763a-4ec2-9469-116177c750d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:35.960859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6cabc046-f429-4a8b-93d1-7c5bb87db568 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:35.962475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6cabc046-f429-4a8b-93d1-7c5bb87db568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:35.970203 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f29aff-763a-4ec2-9469-116177c750d7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:35.980567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739e45c-879e-466e-931f-492ad7b73ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:35.982526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739e45c-879e-466e-931f-492ad7b73ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:35.983066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739e45c-879e-466e-931f-492ad7b73ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:35.983531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739e45c-879e-466e-931f-492ad7b73ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:35.984397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739e45c-879e-466e-931f-492ad7b73ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:35.987103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739e45c-879e-466e-931f-492ad7b73ae1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:35.999299 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 857/1733] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:36.001481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabc046-f429-4a8b-93d1-7c5bb87db568 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:36.003896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6cabc046-f429-4a8b-93d1-7c5bb87db568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:36.035217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 877/1734] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:35 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:36.035825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739e45c-879e-466e-931f-492ad7b73ae1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:36.047124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabc046-f429-4a8b-93d1-7c5bb87db568 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:36.060784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:36.138973 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:36.174392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:36.176046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739e45c-879e-466e-931f-492ad7b73ae1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:36.176470 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:36.177406 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:36.178903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] PATH_INFO: `/v3/users/2952163d98534305a9cc1aceac845d79` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:36.182510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2952163d98534305a9cc1aceac845d79)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:36.189145 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:36.190716 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8ef32-fa03-4f71-ad26-9a2738868c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:36.191581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8ef32-fa03-4f71-ad26-9a2738868c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:36.195074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8ef32-fa03-4f71-ad26-9a2738868c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:36.195547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8ef32-fa03-4f71-ad26-9a2738868c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:36.198585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8ef32-fa03-4f71-ad26-9a2738868c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:36.199250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8ef32-fa03-4f71-ad26-9a2738868c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:36.201111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8ef32-fa03-4f71-ad26-9a2738868c8b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:36.248551 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 878/1735] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:36.250082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673c1e4-db20-4052-ab64-aa1a2a0e2c58 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:36.251200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673c1e4-db20-4052-ab64-aa1a2a0e2c58 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:36.251666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673c1e4-db20-4052-ab64-aa1a2a0e2c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:36.284000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8673c1e4-db20-4052-ab64-aa1a2a0e2c58 None None] MFA Rules not processed for user `f1a734b8ca2d4658be2bc600d8c3f24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:36.286849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8673c1e4-db20-4052-ab64-aa1a2a0e2c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:36.343315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2952163d98534305a9cc1aceac845d79'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:36.344022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2952163d98534305a9cc1aceac845d79'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:36.358325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2952163d98534305a9cc1aceac845d79'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:36.394215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2952163d98534305a9cc1aceac845d79'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:36.395051 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2952163d98534305a9cc1aceac845d79'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:36.422916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 879/1736] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:36.423848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673c1e4-db20-4052-ab64-aa1a2a0e2c58 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:36.435331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8673c1e4-db20-4052-ab64-aa1a2a0e2c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:36.456261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 858/1737] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:35 2022] DELETE /identity/v3/users/2952163d98534305a9cc1aceac845d79 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:36.459890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:36.462613 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:36.471136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673c1e4-db20-4052-ab64-aa1a2a0e2c58 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:36.628241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72828aa4-f4f8-44c3-b0ef-b95d7e683d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:36.629165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72828aa4-f4f8-44c3-b0ef-b95d7e683d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:36.629633 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72828aa4-f4f8-44c3-b0ef-b95d7e683d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:36.630113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72828aa4-f4f8-44c3-b0ef-b95d7e683d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:36.631046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72828aa4-f4f8-44c3-b0ef-b95d7e683d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:36.631561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72828aa4-f4f8-44c3-b0ef-b95d7e683d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:36.633399 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72828aa4-f4f8-44c3-b0ef-b95d7e683d3e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:36.674621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e45dd1-690e-4069-b8d4-9ab4f1e66a79 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:36.676098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 880/1738] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:36.677711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72828aa4-f4f8-44c3-b0ef-b95d7e683d3e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:36.683527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-72828aa4-f4f8-44c3-b0ef-b95d7e683d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:36.695791 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa895a-6e50-414f-9938-0ceaab0f9ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:36.696960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa895a-6e50-414f-9938-0ceaab0f9ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:36.696960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa895a-6e50-414f-9938-0ceaab0f9ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:36.696960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa895a-6e50-414f-9938-0ceaab0f9ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:36.697491 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa895a-6e50-414f-9938-0ceaab0f9ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:36.720015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa895a-6e50-414f-9938-0ceaab0f9ff8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:36.721619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72828aa4-f4f8-44c3-b0ef-b95d7e683d3e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:36.738703 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a0903-ff4d-4614-b84c-dbb7b982d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:36.739432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a0903-ff4d-4614-b84c-dbb7b982d5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:36.739827 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a0903-ff4d-4614-b84c-dbb7b982d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:36.740545 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a0903-ff4d-4614-b84c-dbb7b982d5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:36.741151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a0903-ff4d-4614-b84c-dbb7b982d5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:36.743244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a0903-ff4d-4614-b84c-dbb7b982d5a9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:36.770403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 859/1739] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:36 2022] POST /identity/v3/users => generated 289 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:36.774413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa895a-6e50-414f-9938-0ceaab0f9ff8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:36.778479 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-32aa895a-6e50-414f-9938-0ceaab0f9ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:36.807142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 881/1740] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:36 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:36.808052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a0903-ff4d-4614-b84c-dbb7b982d5a9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:36.860475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:36.977054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a0903-ff4d-4614-b84c-dbb7b982d5a9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:36.990262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d82e4-81dc-4d6e-b5c0-4322277a0956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:36.990912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d82e4-81dc-4d6e-b5c0-4322277a0956 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:36.991198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d82e4-81dc-4d6e-b5c0-4322277a0956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:36.991475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d82e4-81dc-4d6e-b5c0-4322277a0956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:36.992115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d82e4-81dc-4d6e-b5c0-4322277a0956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:37.001997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d82e4-81dc-4d6e-b5c0-4322277a0956 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:37.016884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:37.033270 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa895a-6e50-414f-9938-0ceaab0f9ff8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:37.091133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 882/1741] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:36 2022] POST /identity/v3/projects => generated 373 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:37.092301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d82e4-81dc-4d6e-b5c0-4322277a0956 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:37.193901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d82e4-81dc-4d6e-b5c0-4322277a0956 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:37.201505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9492df2-3566-400c-b550-995073025461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:37.202713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9492df2-3566-400c-b550-995073025461 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:37.203220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9492df2-3566-400c-b550-995073025461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:37.203676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9492df2-3566-400c-b550-995073025461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:37.204520 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9492df2-3566-400c-b550-995073025461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:37.206980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9492df2-3566-400c-b550-995073025461 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:37.219975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 883/1742] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:37.221003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9492df2-3566-400c-b550-995073025461 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:37.241663 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9492df2-3566-400c-b550-995073025461 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:37.270646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3011b-5c32-447b-8e95-43a8ea67d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:37.271321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3011b-5c32-447b-8e95-43a8ea67d9ac admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:37.271604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3011b-5c32-447b-8e95-43a8ea67d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:37.271950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3011b-5c32-447b-8e95-43a8ea67d9ac admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:37.272625 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3011b-5c32-447b-8e95-43a8ea67d9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:37.274637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3011b-5c32-447b-8e95-43a8ea67d9ac admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:37.279269 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eb1d6-11c7-4bc4-b806-d5506a8e9471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:37.281012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb1d6-11c7-4bc4-b806-d5506a8e9471 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:37.282249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb1d6-11c7-4bc4-b806-d5506a8e9471 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:37.283246 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb1d6-11c7-4bc4-b806-d5506a8e9471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:37.289003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b86eb1d6-11c7-4bc4-b806-d5506a8e9471 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:37.330450 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 884/1743] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:37 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:37.330450 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3011b-5c32-447b-8e95-43a8ea67d9ac admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:37.356078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3011b-5c32-447b-8e95-43a8ea67d9ac admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:37.369759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747dcf4-fbee-4cb2-8d46-a1f67e682399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:37.370414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747dcf4-fbee-4cb2-8d46-a1f67e682399 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:37.370696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747dcf4-fbee-4cb2-8d46-a1f67e682399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:37.371362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747dcf4-fbee-4cb2-8d46-a1f67e682399 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:37.371602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747dcf4-fbee-4cb2-8d46-a1f67e682399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:37.373545 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747dcf4-fbee-4cb2-8d46-a1f67e682399 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:37.462984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 885/1744] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:37 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:37.463838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747dcf4-fbee-4cb2-8d46-a1f67e682399 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:37.542473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747dcf4-fbee-4cb2-8d46-a1f67e682399 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:37.556046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921816f-8a0f-4259-a832-f20ce77a6d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:37.556999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921816f-8a0f-4259-a832-f20ce77a6d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:37.557459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921816f-8a0f-4259-a832-f20ce77a6d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:37.557993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921816f-8a0f-4259-a832-f20ce77a6d9f admin admin] PATH_INFO: `/v3/projects/481779f57ee6481d87f7eaa204eefaee/users/2ac778edd29a4832bb5d4db89acdbdf6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:37.563476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb1d6-11c7-4bc4-b806-d5506a8e9471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:37.567573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb1d6-11c7-4bc4-b806-d5506a8e9471 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:37.591082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 860/1745] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 819 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:37.591781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eb1d6-11c7-4bc4-b806-d5506a8e9471 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:37.622612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eb1d6-11c7-4bc4-b806-d5506a8e9471 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:37.625421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921816f-8a0f-4259-a832-f20ce77a6d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=481779f57ee6481d87f7eaa204eefaee, user_id=2ac778edd29a4832bb5d4db89acdbdf6, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:37.628284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921816f-8a0f-4259-a832-f20ce77a6d9f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:37.633988 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe787a-7c58-4f1a-ae09-6ecf8b9cbd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:37.634636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe787a-7c58-4f1a-ae09-6ecf8b9cbd9c admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:37.635061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe787a-7c58-4f1a-ae09-6ecf8b9cbd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:37.635366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe787a-7c58-4f1a-ae09-6ecf8b9cbd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:37.636080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe787a-7c58-4f1a-ae09-6ecf8b9cbd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:37.640847 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe787a-7c58-4f1a-ae09-6ecf8b9cbd9c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:37.660115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 886/1746] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:37 2022] PUT /identity/v3/projects/481779f57ee6481d87f7eaa204eefaee/users/2ac778edd29a4832bb5d4db89acdbdf6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:37.661505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921816f-8a0f-4259-a832-f20ce77a6d9f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:37.670754 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 861/1747] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:37.672873 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe787a-7c58-4f1a-ae09-6ecf8b9cbd9c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:37.678713 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0dfe787a-7c58-4f1a-ae09-6ecf8b9cbd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:37.865693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:37.910520 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921816f-8a0f-4259-a832-f20ce77a6d9f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:37.917766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df3c75-736f-41b4-93bb-fb6489c46e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:37.920540 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df3c75-736f-41b4-93bb-fb6489c46e17 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:37.920919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df3c75-736f-41b4-93bb-fb6489c46e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:37.921293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df3c75-736f-41b4-93bb-fb6489c46e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:37.923057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df3c75-736f-41b4-93bb-fb6489c46e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:37.929651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df3c75-736f-41b4-93bb-fb6489c46e17 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:37.943717 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe787a-7c58-4f1a-ae09-6ecf8b9cbd9c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:37.954185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 887/1748] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:37.955221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df3c75-736f-41b4-93bb-fb6489c46e17 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:37.983210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df3c75-736f-41b4-93bb-fb6489c46e17 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:37.995655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5ff84-8ae5-44a1-8495-c8b4ea6e0fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:37.998941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5ff84-8ae5-44a1-8495-c8b4ea6e0fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:38.001894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5ff84-8ae5-44a1-8495-c8b4ea6e0fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:38.002565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5ff84-8ae5-44a1-8495-c8b4ea6e0fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:38.003134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5ff84-8ae5-44a1-8495-c8b4ea6e0fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:38.004912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5ff84-8ae5-44a1-8495-c8b4ea6e0fbf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:38.041754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 888/1749] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:38.045254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5ff84-8ae5-44a1-8495-c8b4ea6e0fbf admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:38.048318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:38.073539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5ff84-8ae5-44a1-8495-c8b4ea6e0fbf admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:38.087631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66093fe2-4f77-4f33-b17d-5a94d048e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:38.088478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093fe2-4f77-4f33-b17d-5a94d048e398 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:38.088758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093fe2-4f77-4f33-b17d-5a94d048e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:38.089027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093fe2-4f77-4f33-b17d-5a94d048e398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:38.091424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc47c-bd7e-482b-97cd-21301e274705 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:38.092563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc47c-bd7e-482b-97cd-21301e274705 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:38.093089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc47c-bd7e-482b-97cd-21301e274705 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:38.093460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc47c-bd7e-482b-97cd-21301e274705 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:38.093887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66093fe2-4f77-4f33-b17d-5a94d048e398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:38.096573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0cffc47c-bd7e-482b-97cd-21301e274705 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:38.102074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66093fe2-4f77-4f33-b17d-5a94d048e398 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:38.114728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffc47c-bd7e-482b-97cd-21301e274705 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:38.116654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffc47c-bd7e-482b-97cd-21301e274705 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:38.135209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 862/1750] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:38.135428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 889/1751] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:38.135428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66093fe2-4f77-4f33-b17d-5a94d048e398 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:38.135586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc47c-bd7e-482b-97cd-21301e274705 service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:38.147034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc47c-bd7e-482b-97cd-21301e274705 service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:38.152663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d41be-3b4e-45a3-8c2e-863854efbdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:38.155238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d41be-3b4e-45a3-8c2e-863854efbdd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:38.155666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d41be-3b4e-45a3-8c2e-863854efbdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:38.156066 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d41be-3b4e-45a3-8c2e-863854efbdd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:38.156931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d41be-3b4e-45a3-8c2e-863854efbdd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:38.158890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d41be-3b4e-45a3-8c2e-863854efbdd1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:38.169724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66093fe2-4f77-4f33-b17d-5a94d048e398 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:38.188982 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 863/1752] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:38.190490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a06000-fd94-4389-b9c5-24813fba8394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:38.191192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06000-fd94-4389-b9c5-24813fba8394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:38.191479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06000-fd94-4389-b9c5-24813fba8394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:38.191748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06000-fd94-4389-b9c5-24813fba8394 admin admin] PATH_INFO: `/v3/projects/481779f57ee6481d87f7eaa204eefaee/users/2ac778edd29a4832bb5d4db89acdbdf6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:38.192409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d41be-3b4e-45a3-8c2e-863854efbdd1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:38.196371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e20d41be-3b4e-45a3-8c2e-863854efbdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:38.196512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a06000-fd94-4389-b9c5-24813fba8394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481779f57ee6481d87f7eaa204eefaee, user_id=2ac778edd29a4832bb5d4db89acdbdf6, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:38.206712 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a06000-fd94-4389-b9c5-24813fba8394 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:38.232646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d41be-3b4e-45a3-8c2e-863854efbdd1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:38.246821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 890/1753] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:38 2022] PUT /identity/v3/projects/481779f57ee6481d87f7eaa204eefaee/users/2ac778edd29a4832bb5d4db89acdbdf6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:38.246821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a06000-fd94-4389-b9c5-24813fba8394 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:38.391195 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:38.392532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:38.393017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:38.393464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] PATH_INFO: `/v3/projects/0bab60c6792a47f486d61491fbb0e142` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:38.394931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bab60c6792a47f486d61491fbb0e142)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:38.397901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:38.457006 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a06000-fd94-4389-b9c5-24813fba8394 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:38.504075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bab60c6792a47f486d61491fbb0e142', 'request_id': 'req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:38.511095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bab60c6792a47f486d61491fbb0e142', 'request_id': 'req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:38.525012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bab60c6792a47f486d61491fbb0e142', 'request_id': 'req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:38.559300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] The token cache is being invalidate because project 0bab60c6792a47f486d61491fbb0e142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:38.560435 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:38.561627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:38.565054 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 864/1754] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:38 2022] DELETE /identity/v3/projects/0bab60c6792a47f486d61491fbb0e142 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:38.566517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:38.574505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:38.666609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b80238-0463-4df0-98ea-c908038b0bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:38.668509 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b80238-0463-4df0-98ea-c908038b0bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:38.668853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b80238-0463-4df0-98ea-c908038b0bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:38.669940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b80238-0463-4df0-98ea-c908038b0bc7 admin admin] PATH_INFO: `/v3/projects/56b8c202d67b4aaba68540132ac6cc24/users/75b1d9c4f4154af49a80a20a719d1035/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:38.715283 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:38.727081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b80238-0463-4df0-98ea-c908038b0bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b8c202d67b4aaba68540132ac6cc24, user_id=75b1d9c4f4154af49a80a20a719d1035, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:38.730098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b80238-0463-4df0-98ea-c908038b0bc7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:38.767743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 891/1755] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:38 2022] PUT /identity/v3/projects/56b8c202d67b4aaba68540132ac6cc24/users/75b1d9c4f4154af49a80a20a719d1035/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:38.769312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435cbb0-cc92-4c3a-bdef-c75ea369da51 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:38.769609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435cbb0-cc92-4c3a-bdef-c75ea369da51 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:38.769936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435cbb0-cc92-4c3a-bdef-c75ea369da51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:38.812019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5c1ed-b5bf-4e5b-ad17-44bb32d9dbc3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:38.843137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d435cbb0-cc92-4c3a-bdef-c75ea369da51 None None] MFA Rules not processed for user `2ac778edd29a4832bb5d4db89acdbdf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:38.849782 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d435cbb0-cc92-4c3a-bdef-c75ea369da51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:38.959409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:38.985889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48135665-c032-4263-b997-29b0f6128de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:38.987762 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48135665-c032-4263-b997-29b0f6128de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:38.988149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48135665-c032-4263-b997-29b0f6128de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:38.988520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48135665-c032-4263-b997-29b0f6128de6 admin admin] PATH_INFO: `/v3/projects/1161d2aeb2be4f5f847676616372ba0b/users/9890876abbee40d1a4b7c486e795dcf7/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.039841 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48135665-c032-4263-b997-29b0f6128de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1161d2aeb2be4f5f847676616372ba0b, user_id=9890876abbee40d1a4b7c486e795dcf7, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:39.042886 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48135665-c032-4263-b997-29b0f6128de6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:39.082500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 865/1756] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:38 2022] PUT /identity/v3/projects/1161d2aeb2be4f5f847676616372ba0b/users/9890876abbee40d1a4b7c486e795dcf7/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:39.082500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44b59f-47cd-414b-b7c4-b5a625b8e9ec None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:39.082500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44b59f-47cd-414b-b7c4-b5a625b8e9ec None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:39.082500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44b59f-47cd-414b-b7c4-b5a625b8e9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.132730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1a44b59f-47cd-414b-b7c4-b5a625b8e9ec None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:39.135394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 892/1757] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:39.136225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87d342-bd15-4e1c-ba60-9cf1cfafea0e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:39.136508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87d342-bd15-4e1c-ba60-9cf1cfafea0e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:39.136782 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87d342-bd15-4e1c-ba60-9cf1cfafea0e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.138050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 893/1758] 10.222.0.20 () {54 vars in 912 bytes} [Thu Sep 22 22:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:10:39.140101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff59c83-3c91-4847-a954-84afc9c0a420 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:39.140379 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff59c83-3c91-4847-a954-84afc9c0a420 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:39.140648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff59c83-3c91-4847-a954-84afc9c0a420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.156342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1a44b59f-47cd-414b-b7c4-b5a625b8e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:39.207061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4ff59c83-3c91-4847-a954-84afc9c0a420 None None] MFA Rules not processed for user `75b1d9c4f4154af49a80a20a719d1035`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:39.209597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4ff59c83-3c91-4847-a954-84afc9c0a420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:39.316236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 866/1759] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:39.316236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de369a-279c-4f99-a321-c4a1a616606d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:39.316236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de369a-279c-4f99-a321-c4a1a616606d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:39.316236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de369a-279c-4f99-a321-c4a1a616606d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.346627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b5de369a-279c-4f99-a321-c4a1a616606d None None] MFA Rules not processed for user `664ca23211794b9dade2baf58b884c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:39.346955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b5de369a-279c-4f99-a321-c4a1a616606d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:39.356908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 894/1760] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:39.361776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ab134-c75e-4556-82ef-e099884fb7d7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:39.362081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ab134-c75e-4556-82ef-e099884fb7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:39.362356 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ab134-c75e-4556-82ef-e099884fb7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.405245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b49ab134-c75e-4556-82ef-e099884fb7d7 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:39.406558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b49ab134-c75e-4556-82ef-e099884fb7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:39.415471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 895/1761] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:39.416924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e61f1c-f741-4f08-976e-2a85e96d9f36 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:39.417202 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e61f1c-f741-4f08-976e-2a85e96d9f36 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:39.417466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e61f1c-f741-4f08-976e-2a85e96d9f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.452812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-48e61f1c-f741-4f08-976e-2a85e96d9f36 None None] MFA Rules not processed for user `d512b60a42ed456a82dff11d17b77c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:39.456688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-48e61f1c-f741-4f08-976e-2a85e96d9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:39.460920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 867/1762] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:39.462494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de369a-279c-4f99-a321-c4a1a616606d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:39.481443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b5de369a-279c-4f99-a321-c4a1a616606d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:39.524101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:39.558028 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 896/1763] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:39.559745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a2f2-e533-4596-87ac-28e600b488af None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:39.560279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a2f2-e533-4596-87ac-28e600b488af None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:39.560624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a2f2-e533-4596-87ac-28e600b488af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.588698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ef68a2f2-e533-4596-87ac-28e600b488af None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:39.590212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ef68a2f2-e533-4596-87ac-28e600b488af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:39.602928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 897/1764] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:39.602928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a2f2-e533-4596-87ac-28e600b488af None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:39.615103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ef68a2f2-e533-4596-87ac-28e600b488af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:39.642740 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de369a-279c-4f99-a321-c4a1a616606d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:39.643153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a2f2-e533-4596-87ac-28e600b488af None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:39.651347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d966d5-fab1-4a2d-b80a-e6def34dc87b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:39.652929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d966d5-fab1-4a2d-b80a-e6def34dc87b service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:39.652929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d966d5-fab1-4a2d-b80a-e6def34dc87b service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:39.652929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d966d5-fab1-4a2d-b80a-e6def34dc87b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.654346 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392b851-a6e6-43a3-9c74-a1c542f8d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:39.673253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392b851-a6e6-43a3-9c74-a1c542f8d930 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:39.673253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392b851-a6e6-43a3-9c74-a1c542f8d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:39.673253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392b851-a6e6-43a3-9c74-a1c542f8d930 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.673253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392b851-a6e6-43a3-9c74-a1c542f8d930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:39.676637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392b851-a6e6-43a3-9c74-a1c542f8d930 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:39.763314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 898/1765] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:39 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:39.766655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392b851-a6e6-43a3-9c74-a1c542f8d930 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:39.770156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5392b851-a6e6-43a3-9c74-a1c542f8d930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:39.784836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d966d5-fab1-4a2d-b80a-e6def34dc87b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:39.786411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d966d5-fab1-4a2d-b80a-e6def34dc87b service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:39.811050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 868/1766] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:39.813576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d966d5-fab1-4a2d-b80a-e6def34dc87b service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:39.815326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c1d966d5-fab1-4a2d-b80a-e6def34dc87b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:39.832821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d966d5-fab1-4a2d-b80a-e6def34dc87b service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:39.847503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:39.921076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630931d-df86-41c2-b8b2-9c7a8f7302a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:39.921715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630931d-df86-41c2-b8b2-9c7a8f7302a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:39.922040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630931d-df86-41c2-b8b2-9c7a8f7302a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:39.922312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630931d-df86-41c2-b8b2-9c7a8f7302a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.931514 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630931d-df86-41c2-b8b2-9c7a8f7302a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:39.931742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392b851-a6e6-43a3-9c74-a1c542f8d930 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:39.933095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630931d-df86-41c2-b8b2-9c7a8f7302a4 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:39.935555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b62d9-55c8-4152-918d-9c651bed6d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:39.936185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b62d9-55c8-4152-918d-9c651bed6d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:39.936464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b62d9-55c8-4152-918d-9c651bed6d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:39.936920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b62d9-55c8-4152-918d-9c651bed6d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:39.943775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 869/1767] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:39.944815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630931d-df86-41c2-b8b2-9c7a8f7302a4 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.028458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630931d-df86-41c2-b8b2-9c7a8f7302a4 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.033248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b62d9-55c8-4152-918d-9c651bed6d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.035079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b62d9-55c8-4152-918d-9c651bed6d76 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.039995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f492269-017f-42a7-a519-9d9f3a2d9b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.041423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492269-017f-42a7-a519-9d9f3a2d9b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.041702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492269-017f-42a7-a519-9d9f3a2d9b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.042016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492269-017f-42a7-a519-9d9f3a2d9b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.042969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f492269-017f-42a7-a519-9d9f3a2d9b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:40.043273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f492269-017f-42a7-a519-9d9f3a2d9b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.047138 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f492269-017f-42a7-a519-9d9f3a2d9b91 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.054022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 899/1768] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:40.055438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b62d9-55c8-4152-918d-9c651bed6d76 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.065744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 870/1769] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:40.065744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d54d8-6475-4729-a4da-4585e62edfe1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.065744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d54d8-6475-4729-a4da-4585e62edfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.066095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d54d8-6475-4729-a4da-4585e62edfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.076225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:40.086486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b62d9-55c8-4152-918d-9c651bed6d76 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.097401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-702d54d8-6475-4729-a4da-4585e62edfe1 None None] MFA Rules not processed for user `e5d4998f54924ecab01a6dbc64b6d9db`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:40.098894 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-702d54d8-6475-4729-a4da-4585e62edfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:40.101556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbc10a-4535-4c2d-83b4-56a427ae5f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.104397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbc10a-4535-4c2d-83b4-56a427ae5f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.104840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbc10a-4535-4c2d-83b4-56a427ae5f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.105294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbc10a-4535-4c2d-83b4-56a427ae5f45 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.106502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbc10a-4535-4c2d-83b4-56a427ae5f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.112915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbc10a-4535-4c2d-83b4-56a427ae5f45 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.168838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 900/1770] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:40 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:40.168838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbc10a-4535-4c2d-83b4-56a427ae5f45 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.211160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 871/1771] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:40.212484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d54d8-6475-4729-a4da-4585e62edfe1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.248530 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d54d8-6475-4729-a4da-4585e62edfe1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.276275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87821828-e2eb-4716-b297-bd188485b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.276999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821828-e2eb-4716-b297-bd188485b3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.278633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821828-e2eb-4716-b297-bd188485b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.279368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821828-e2eb-4716-b297-bd188485b3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.284421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87821828-e2eb-4716-b297-bd188485b3a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.289770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87821828-e2eb-4716-b297-bd188485b3a2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.308191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbc10a-4535-4c2d-83b4-56a427ae5f45 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.319775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fbfc2-906c-43e2-8961-909c1ff54273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.320604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fbfc2-906c-43e2-8961-909c1ff54273 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.320893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fbfc2-906c-43e2-8961-909c1ff54273 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.321175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fbfc2-906c-43e2-8961-909c1ff54273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.324285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f52fbfc2-906c-43e2-8961-909c1ff54273 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:40.357667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 872/1772] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:40 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:40.359006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87821828-e2eb-4716-b297-bd188485b3a2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.441068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fbfc2-906c-43e2-8961-909c1ff54273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.444328 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fbfc2-906c-43e2-8961-909c1ff54273 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.467684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 901/1773] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:40.468802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fbfc2-906c-43e2-8961-909c1ff54273 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.485023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fbfc2-906c-43e2-8961-909c1ff54273 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.493623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:40.532706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87821828-e2eb-4716-b297-bd188485b3a2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.539789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de642d7d-e55c-4d9a-9333-d5fa33922617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.540433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642d7d-e55c-4d9a-9333-d5fa33922617 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.540710 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642d7d-e55c-4d9a-9333-d5fa33922617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.540979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642d7d-e55c-4d9a-9333-d5fa33922617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.542325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de642d7d-e55c-4d9a-9333-d5fa33922617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.543976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de642d7d-e55c-4d9a-9333-d5fa33922617 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.560185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 873/1774] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:40.561215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de642d7d-e55c-4d9a-9333-d5fa33922617 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.575907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de642d7d-e55c-4d9a-9333-d5fa33922617 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.580834 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f7609-9d48-40a3-bac5-254a58f78cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.581504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f7609-9d48-40a3-bac5-254a58f78cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.581780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f7609-9d48-40a3-bac5-254a58f78cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.582221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f7609-9d48-40a3-bac5-254a58f78cb3 admin admin] PATH_INFO: `/v3/projects/debce276d78a4dcda1071d44f0ce2a92/users/a29a2b69e4a244c0ae96b3e80deb9cd8/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.602776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f7609-9d48-40a3-bac5-254a58f78cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=debce276d78a4dcda1071d44f0ce2a92, user_id=a29a2b69e4a244c0ae96b3e80deb9cd8, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.605811 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f7609-9d48-40a3-bac5-254a58f78cb3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.626764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe72de-230e-42bd-aa84-0d1ad4893adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.628672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe72de-230e-42bd-aa84-0d1ad4893adb admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.629165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe72de-230e-42bd-aa84-0d1ad4893adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.630503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe72de-230e-42bd-aa84-0d1ad4893adb admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.631869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe72de-230e-42bd-aa84-0d1ad4893adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.634765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 874/1775] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:40 2022] PUT /identity/v3/projects/debce276d78a4dcda1071d44f0ce2a92/users/a29a2b69e4a244c0ae96b3e80deb9cd8/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:40.635176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe72de-230e-42bd-aa84-0d1ad4893adb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.635800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f7609-9d48-40a3-bac5-254a58f78cb3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.671753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 902/1776] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:40 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:40.675866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe72de-230e-42bd-aa84-0d1ad4893adb admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.691541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe72de-230e-42bd-aa84-0d1ad4893adb admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.777388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:40.809353 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f7609-9d48-40a3-bac5-254a58f78cb3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.827064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ee6aa-e901-4689-84c8-d93288c527ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.829660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ee6aa-e901-4689-84c8-d93288c527ba admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.830022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ee6aa-e901-4689-84c8-d93288c527ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.830604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ee6aa-e901-4689-84c8-d93288c527ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.831005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ee6aa-e901-4689-84c8-d93288c527ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.833226 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ee6aa-e901-4689-84c8-d93288c527ba admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.834600 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87545837-a7d4-4af6-b2d0-b5453a2af429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.841031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87545837-a7d4-4af6-b2d0-b5453a2af429 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.841696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87545837-a7d4-4af6-b2d0-b5453a2af429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.842476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87545837-a7d4-4af6-b2d0-b5453a2af429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.845316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87545837-a7d4-4af6-b2d0-b5453a2af429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.849853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 903/1777] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:40.850858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87545837-a7d4-4af6-b2d0-b5453a2af429 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.855797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ee6aa-e901-4689-84c8-d93288c527ba admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.874192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ee6aa-e901-4689-84c8-d93288c527ba admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.881662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936518a-e928-4fc7-8e52-2fb4d662cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.881902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936518a-e928-4fc7-8e52-2fb4d662cfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.882133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936518a-e928-4fc7-8e52-2fb4d662cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.882444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936518a-e928-4fc7-8e52-2fb4d662cfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.883165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936518a-e928-4fc7-8e52-2fb4d662cfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.885898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936518a-e928-4fc7-8e52-2fb4d662cfd6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.902567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 875/1778] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:40.907345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 904/1779] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:40.911130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936518a-e928-4fc7-8e52-2fb4d662cfd6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.911549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87545837-a7d4-4af6-b2d0-b5453a2af429 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:40.938471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87545837-a7d4-4af6-b2d0-b5453a2af429 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.940967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936518a-e928-4fc7-8e52-2fb4d662cfd6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:40.944828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb92d1-4af2-4ba2-a7b3-b1f76f06a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.945813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb92d1-4af2-4ba2-a7b3-b1f76f06a17b admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.946792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb92d1-4af2-4ba2-a7b3-b1f76f06a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.947300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb92d1-4af2-4ba2-a7b3-b1f76f06a17b admin admin] PATH_INFO: `/v3/projects/d918075b5db047418857958b26eb448a/users/f16ce9ab4cff40b986277044b65ef478/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.950863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e58e3-ec7c-4a0a-9f8b-2d9f2a055bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:40.951856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e58e3-ec7c-4a0a-9f8b-2d9f2a055bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:40.952243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e58e3-ec7c-4a0a-9f8b-2d9f2a055bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:40.952764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e58e3-ec7c-4a0a-9f8b-2d9f2a055bc6 admin admin] PATH_INFO: `/v3/projects/debce276d78a4dcda1071d44f0ce2a92/users/a29a2b69e4a244c0ae96b3e80deb9cd8/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:40.955259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e58e3-ec7c-4a0a-9f8b-2d9f2a055bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=debce276d78a4dcda1071d44f0ce2a92, user_id=a29a2b69e4a244c0ae96b3e80deb9cd8, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.959121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e58e3-ec7c-4a0a-9f8b-2d9f2a055bc6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:40.969991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb92d1-4af2-4ba2-a7b3-b1f76f06a17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d918075b5db047418857958b26eb448a, user_id=f16ce9ab4cff40b986277044b65ef478, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:40.974032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb92d1-4af2-4ba2-a7b3-b1f76f06a17b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:41.015870 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 876/1780] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:40 2022] PUT /identity/v3/projects/d918075b5db047418857958b26eb448a/users/f16ce9ab4cff40b986277044b65ef478/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:41.016206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 905/1781] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:40 2022] PUT /identity/v3/projects/debce276d78a4dcda1071d44f0ce2a92/users/a29a2b69e4a244c0ae96b3e80deb9cd8/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:41.029046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53085-aecf-4889-91de-084a12c70e32 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:41.029811 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53085-aecf-4889-91de-084a12c70e32 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:41.030272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53085-aecf-4889-91de-084a12c70e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:41.037517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39686-c376-4dc4-8822-fb6c1eefae87 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:41.037517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39686-c376-4dc4-8822-fb6c1eefae87 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:41.038313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39686-c376-4dc4-8822-fb6c1eefae87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:41.098868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-85a53085-aecf-4889-91de-084a12c70e32 None None] MFA Rules not processed for user `f16ce9ab4cff40b986277044b65ef478`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:41.101189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-85a53085-aecf-4889-91de-084a12c70e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:41.111705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f5a39686-c376-4dc4-8822-fb6c1eefae87 None None] MFA Rules not processed for user `a29a2b69e4a244c0ae96b3e80deb9cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:41.112724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f5a39686-c376-4dc4-8822-fb6c1eefae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:41.263368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:41.285414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 906/1782] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:41.290555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a39686-c376-4dc4-8822-fb6c1eefae87 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:41.310999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 877/1783] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:41.312254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a53085-aecf-4889-91de-084a12c70e32 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:41.416361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a39686-c376-4dc4-8822-fb6c1eefae87 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:41.424084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb8a4b-0cd4-4175-bdc1-60d5c8bcad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:41.425152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb8a4b-0cd4-4175-bdc1-60d5c8bcad2b admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:41.426279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a53085-aecf-4889-91de-084a12c70e32 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:41.426402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb8a4b-0cd4-4175-bdc1-60d5c8bcad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:41.426607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb8a4b-0cd4-4175-bdc1-60d5c8bcad2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:41.427301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb8a4b-0cd4-4175-bdc1-60d5c8bcad2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:41.433657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319f6ce-42e9-411d-8d3b-114ff2f073d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:41.434410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f6ce-42e9-411d-8d3b-114ff2f073d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:41.434868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f6ce-42e9-411d-8d3b-114ff2f073d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:41.435219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f6ce-42e9-411d-8d3b-114ff2f073d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:41.436491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb8a4b-0cd4-4175-bdc1-60d5c8bcad2b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:41.501790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 907/1784] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:41 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:41.505948 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb8a4b-0cd4-4175-bdc1-60d5c8bcad2b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:41.533332 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319f6ce-42e9-411d-8d3b-114ff2f073d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:41.535074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319f6ce-42e9-411d-8d3b-114ff2f073d1 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:41.554918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 878/1785] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:41.581439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe907-987e-4989-ba8f-8672c21461b0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:41.581751 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe907-987e-4989-ba8f-8672c21461b0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:41.582025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe907-987e-4989-ba8f-8672c21461b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:41.630335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:41.689555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb8a4b-0cd4-4175-bdc1-60d5c8bcad2b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:41.712468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829699a0-4b64-428f-8d92-3962bb95ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:41.713382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829699a0-4b64-428f-8d92-3962bb95ae00 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:41.713754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829699a0-4b64-428f-8d92-3962bb95ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:41.714140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829699a0-4b64-428f-8d92-3962bb95ae00 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:41.714894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829699a0-4b64-428f-8d92-3962bb95ae00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:41.717193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829699a0-4b64-428f-8d92-3962bb95ae00 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:41.720163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ea3fe907-987e-4989-ba8f-8672c21461b0 None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:41.721736 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ea3fe907-987e-4989-ba8f-8672c21461b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:41.808252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 908/1786] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:41 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:10:41.813276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829699a0-4b64-428f-8d92-3962bb95ae00 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:41.848308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829699a0-4b64-428f-8d92-3962bb95ae00 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:41.872260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc764212-7183-4b46-b354-7ed36cc7056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:41.873035 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764212-7183-4b46-b354-7ed36cc7056c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:41.873319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764212-7183-4b46-b354-7ed36cc7056c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:41.873631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764212-7183-4b46-b354-7ed36cc7056c admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:41.874270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc764212-7183-4b46-b354-7ed36cc7056c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:41.875887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc764212-7183-4b46-b354-7ed36cc7056c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:41.926859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 909/1787] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:41.928934 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc764212-7183-4b46-b354-7ed36cc7056c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:41.965096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc764212-7183-4b46-b354-7ed36cc7056c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:41.965885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 879/1788] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:10:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:42.014604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd688ec-f562-4805-acd5-f03ee9efbf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:42.019833 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd688ec-f562-4805-acd5-f03ee9efbf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:42.020114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd688ec-f562-4805-acd5-f03ee9efbf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:42.020386 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd688ec-f562-4805-acd5-f03ee9efbf4a admin admin] PATH_INFO: `/v3/projects/905cfc088efc4dceac8fbcaf9d217317/users/aaa34027f78b4659a563c58092762a3c/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:42.102692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd688ec-f562-4805-acd5-f03ee9efbf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=905cfc088efc4dceac8fbcaf9d217317, user_id=aaa34027f78b4659a563c58092762a3c, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:42.109896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd688ec-f562-4805-acd5-f03ee9efbf4a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:42.158265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 910/1789] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:41 2022] PUT /identity/v3/projects/905cfc088efc4dceac8fbcaf9d217317/users/aaa34027f78b4659a563c58092762a3c/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:42.159993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fe907-987e-4989-ba8f-8672c21461b0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:42.180239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fe907-987e-4989-ba8f-8672c21461b0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:42.338043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd688ec-f562-4805-acd5-f03ee9efbf4a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:42.340620 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cdd688ec-f562-4805-acd5-f03ee9efbf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:42.479047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913bbdb-5c08-4cd2-aee1-942b5e3ac3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:42.479867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913bbdb-5c08-4cd2-aee1-942b5e3ac3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:42.481855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913bbdb-5c08-4cd2-aee1-942b5e3ac3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:42.484349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913bbdb-5c08-4cd2-aee1-942b5e3ac3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:42.485198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913bbdb-5c08-4cd2-aee1-942b5e3ac3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:42.492821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913bbdb-5c08-4cd2-aee1-942b5e3ac3b2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:42.534743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 880/1790] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:42.539279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913bbdb-5c08-4cd2-aee1-942b5e3ac3b2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:42.562726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:42.621179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913bbdb-5c08-4cd2-aee1-942b5e3ac3b2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:42.664065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92b314-dbc2-4905-a06e-0aa3ad76b14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:42.665513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92b314-dbc2-4905-a06e-0aa3ad76b14b admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:42.666489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92b314-dbc2-4905-a06e-0aa3ad76b14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:42.667540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92b314-dbc2-4905-a06e-0aa3ad76b14b admin admin] PATH_INFO: `/v3/projects/905cfc088efc4dceac8fbcaf9d217317/users/aaa34027f78b4659a563c58092762a3c/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:42.675635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92b314-dbc2-4905-a06e-0aa3ad76b14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=905cfc088efc4dceac8fbcaf9d217317, user_id=aaa34027f78b4659a563c58092762a3c, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:42.685751 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92b314-dbc2-4905-a06e-0aa3ad76b14b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:42.737434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 881/1791] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:42 2022] PUT /identity/v3/projects/905cfc088efc4dceac8fbcaf9d217317/users/aaa34027f78b4659a563c58092762a3c/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:42.739452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb888c-90ec-4d12-b28b-cee0aa93691a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:42.740041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb888c-90ec-4d12-b28b-cee0aa93691a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:42.742114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb888c-90ec-4d12-b28b-cee0aa93691a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:42.804239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd688ec-f562-4805-acd5-f03ee9efbf4a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:42.871933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-eceb888c-90ec-4d12-b28b-cee0aa93691a None None] MFA Rules not processed for user `aaa34027f78b4659a563c58092762a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:42.873426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eceb888c-90ec-4d12-b28b-cee0aa93691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:43.029279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:43.049894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0134-75fa-4d0a-a738-f0f54b8ee950 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:43.049894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0134-75fa-4d0a-a738-f0f54b8ee950 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:43.049894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0134-75fa-4d0a-a738-f0f54b8ee950 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:43.049894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0134-75fa-4d0a-a738-f0f54b8ee950 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:43.058019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 882/1792] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:43.065334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb888c-90ec-4d12-b28b-cee0aa93691a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:43.066956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eceb888c-90ec-4d12-b28b-cee0aa93691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:43.212291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb888c-90ec-4d12-b28b-cee0aa93691a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:43.227320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc38dc-28a6-4b8e-81c6-38b2940c07e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:43.227965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc38dc-28a6-4b8e-81c6-38b2940c07e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:43.228242 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc38dc-28a6-4b8e-81c6-38b2940c07e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:43.228512 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc38dc-28a6-4b8e-81c6-38b2940c07e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:43.252893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc38dc-28a6-4b8e-81c6-38b2940c07e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:43.256280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc38dc-28a6-4b8e-81c6-38b2940c07e9 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:43.264691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0134-75fa-4d0a-a738-f0f54b8ee950 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:43.266530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0134-75fa-4d0a-a738-f0f54b8ee950 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:43.280531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 883/1793] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:10:43.283898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 911/1794] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:10:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 947 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 22:10:43.285768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24325fc-37df-4cc1-b37d-eaa3fcdf2a85 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:43.285768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24325fc-37df-4cc1-b37d-eaa3fcdf2a85 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:43.286021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24325fc-37df-4cc1-b37d-eaa3fcdf2a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:43.335081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a24325fc-37df-4cc1-b37d-eaa3fcdf2a85 None None] MFA Rules not processed for user `f1a734b8ca2d4658be2bc600d8c3f24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:43.336425 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a24325fc-37df-4cc1-b37d-eaa3fcdf2a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:43.566615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb8022-3197-4ddc-b2c0-a2bd9c34e6c3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:43.567237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb8022-3197-4ddc-b2c0-a2bd9c34e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:43.567734 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb8022-3197-4ddc-b2c0-a2bd9c34e6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:43.577024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 884/1795] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:43.602964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24325fc-37df-4cc1-b37d-eaa3fcdf2a85 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:43.617677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24325fc-37df-4cc1-b37d-eaa3fcdf2a85 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:43.645128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597079d-6e89-44f0-a1db-7102af2700e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:43.650587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597079d-6e89-44f0-a1db-7102af2700e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:43.651243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597079d-6e89-44f0-a1db-7102af2700e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:43.655234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597079d-6e89-44f0-a1db-7102af2700e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:43.730464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f0cb8022-3197-4ddc-b2c0-a2bd9c34e6c3 None None] MFA Rules not processed for user `9890876abbee40d1a4b7c486e795dcf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:43.739221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f0cb8022-3197-4ddc-b2c0-a2bd9c34e6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:43.992474 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:44.003810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597079d-6e89-44f0-a1db-7102af2700e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:44.006685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597079d-6e89-44f0-a1db-7102af2700e6 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:44.023026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 885/1796] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:44.070985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 912/1797] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:44.077755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597079d-6e89-44f0-a1db-7102af2700e6 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:44.274092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:44.388364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597079d-6e89-44f0-a1db-7102af2700e6 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:44.418012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08cda3-93f1-40c5-b79d-3bd89f01f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:44.418906 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08cda3-93f1-40c5-b79d-3bd89f01f1bc admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:44.419184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08cda3-93f1-40c5-b79d-3bd89f01f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:44.419478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08cda3-93f1-40c5-b79d-3bd89f01f1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:44.420596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08cda3-93f1-40c5-b79d-3bd89f01f1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:44.432182 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08cda3-93f1-40c5-b79d-3bd89f01f1bc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:44.512604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 886/1798] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:44 2022] POST /identity/v3/projects => generated 371 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:44.516481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb8022-3197-4ddc-b2c0-a2bd9c34e6c3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:44.536404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00c393-3587-43ff-b966-5ff93a5c2d5d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:44.537023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00c393-3587-43ff-b966-5ff93a5c2d5d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:44.537421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00c393-3587-43ff-b966-5ff93a5c2d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:44.548777 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb8022-3197-4ddc-b2c0-a2bd9c34e6c3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:44.572177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4d00c393-3587-43ff-b966-5ff93a5c2d5d None None] MFA Rules not processed for user `d512b60a42ed456a82dff11d17b77c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:44.573976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4d00c393-3587-43ff-b966-5ff93a5c2d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:44.743685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 887/1799] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 22 22:10:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:44.763575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cbeb8-dc30-43fe-a7f2-122d14717c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:44.766673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cbeb8-dc30-43fe-a7f2-122d14717c54 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:44.766673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cbeb8-dc30-43fe-a7f2-122d14717c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:44.766673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cbeb8-dc30-43fe-a7f2-122d14717c54 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:44.766900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00c393-3587-43ff-b966-5ff93a5c2d5d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:44.767000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cbeb8-dc30-43fe-a7f2-122d14717c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:44.769065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4d00c393-3587-43ff-b966-5ff93a5c2d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:44.770137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cbeb8-dc30-43fe-a7f2-122d14717c54 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:44.828515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 913/1800] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:44 2022] POST /identity/v3/users => generated 292 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:44.837910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cbeb8-dc30-43fe-a7f2-122d14717c54 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:44.838358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00c393-3587-43ff-b966-5ff93a5c2d5d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:44.847460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2284d3f-9ce8-4d6b-a965-8b995e101f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:44.848455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2284d3f-9ce8-4d6b-a965-8b995e101f45 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:44.849037 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2284d3f-9ce8-4d6b-a965-8b995e101f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:44.849575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2284d3f-9ce8-4d6b-a965-8b995e101f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:44.861261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2284d3f-9ce8-4d6b-a965-8b995e101f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:44.867861 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2284d3f-9ce8-4d6b-a965-8b995e101f45 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:44.877176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cbeb8-dc30-43fe-a7f2-122d14717c54 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:44.884935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 888/1801] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:44.893446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d100-ac26-4ff8-97f1-a01a68bf99a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:44.894476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d100-ac26-4ff8-97f1-a01a68bf99a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:44.894897 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d100-ac26-4ff8-97f1-a01a68bf99a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:44.895297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d100-ac26-4ff8-97f1-a01a68bf99a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:44.896157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768d100-ac26-4ff8-97f1-a01a68bf99a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:44.898888 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768d100-ac26-4ff8-97f1-a01a68bf99a4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:44.946568 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2284d3f-9ce8-4d6b-a965-8b995e101f45 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:44.948954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 914/1802] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:44.969890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2284d3f-9ce8-4d6b-a965-8b995e101f45 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:44.983309 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcd5d8-c889-420c-8fc9-edbf481172dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:44.984023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd5d8-c889-420c-8fc9-edbf481172dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:44.984298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd5d8-c889-420c-8fc9-edbf481172dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:44.984570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd5d8-c889-420c-8fc9-edbf481172dc admin admin] PATH_INFO: `/v3/projects/3abbd9dd9aeb4e5ebef6e3c6d1fc8a19/users/8b1b274a848541da84e7186367e6d897/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:45.020998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcd5d8-c889-420c-8fc9-edbf481172dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abbd9dd9aeb4e5ebef6e3c6d1fc8a19, user_id=8b1b274a848541da84e7186367e6d897, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:45.023888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcd5d8-c889-420c-8fc9-edbf481172dc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:45.036030 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d100-ac26-4ff8-97f1-a01a68bf99a4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:45.038104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e768d100-ac26-4ff8-97f1-a01a68bf99a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:45.063609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d100-ac26-4ff8-97f1-a01a68bf99a4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:45.070087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 889/1803] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:44 2022] PUT /identity/v3/projects/3abbd9dd9aeb4e5ebef6e3c6d1fc8a19/users/8b1b274a848541da84e7186367e6d897/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:10:45.078318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcd5d8-c889-420c-8fc9-edbf481172dc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:45.282648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:45.283613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:45.284025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:45.284433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] PATH_INFO: `/v3/users/56316c76d3a8459b9a8643a5aa808948` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:45.289477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=56316c76d3a8459b9a8643a5aa808948)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:45.293773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcd5d8-c889-420c-8fc9-edbf481172dc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:45.300310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:45.305030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdc239-1d28-44f1-be69-163b2a50d54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:45.333789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc239-1d28-44f1-be69-163b2a50d54f admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:45.334413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc239-1d28-44f1-be69-163b2a50d54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:45.334932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc239-1d28-44f1-be69-163b2a50d54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:45.335764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdc239-1d28-44f1-be69-163b2a50d54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:45.344130 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdc239-1d28-44f1-be69-163b2a50d54f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:45.374252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 890/1804] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:45.375980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdc239-1d28-44f1-be69-163b2a50d54f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:45.454676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdc239-1d28-44f1-be69-163b2a50d54f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:45.506996 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56316c76d3a8459b9a8643a5aa808948'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:45.517877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b6d0f-9537-44ab-9621-6874ef485c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:45.527740 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6d0f-9537-44ab-9621-6874ef485c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:45.530058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6d0f-9537-44ab-9621-6874ef485c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:45.534883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6d0f-9537-44ab-9621-6874ef485c96 admin admin] PATH_INFO: `/v3/projects/3abbd9dd9aeb4e5ebef6e3c6d1fc8a19/users/8b1b274a848541da84e7186367e6d897/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:45.552920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b6d0f-9537-44ab-9621-6874ef485c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abbd9dd9aeb4e5ebef6e3c6d1fc8a19, user_id=8b1b274a848541da84e7186367e6d897, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:45.566372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56316c76d3a8459b9a8643a5aa808948'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:45.568553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56316c76d3a8459b9a8643a5aa808948'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:45.581989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b6d0f-9537-44ab-9621-6874ef485c96 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:45.622704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56316c76d3a8459b9a8643a5aa808948'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:45.646707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 891/1805] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:45 2022] PUT /identity/v3/projects/3abbd9dd9aeb4e5ebef6e3c6d1fc8a19/users/8b1b274a848541da84e7186367e6d897/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:45.651525 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:45.698400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56316c76d3a8459b9a8643a5aa808948'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:45.733741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 915/1806] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:45 2022] DELETE /identity/v3/users/56316c76d3a8459b9a8643a5aa808948 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:10:45.738587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b3e6e-c4b5-4046-b0f9-77fe61d9e84f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:45.739021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b3e6e-c4b5-4046-b0f9-77fe61d9e84f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:45.739387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b3e6e-c4b5-4046-b0f9-77fe61d9e84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:45.817789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7d9b3e6e-c4b5-4046-b0f9-77fe61d9e84f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:45.831131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7d9b3e6e-c4b5-4046-b0f9-77fe61d9e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:45.902051 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:46.038566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 892/1807] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:46.060977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:46.062561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:46.259856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ea46e-2a60-48c6-a3d8-9f40ac49bc3c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:46.272702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a8902-b030-475a-84d4-6deb075adf82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:46.273259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a8902-b030-475a-84d4-6deb075adf82 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:46.273521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a8902-b030-475a-84d4-6deb075adf82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:46.273796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a8902-b030-475a-84d4-6deb075adf82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:46.338401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a8902-b030-475a-84d4-6deb075adf82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:46.341728 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a8902-b030-475a-84d4-6deb075adf82 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:46.381198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 916/1808] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:46.689061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b3e6e-c4b5-4046-b0f9-77fe61d9e84f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:46.691212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7d9b3e6e-c4b5-4046-b0f9-77fe61d9e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:47.019597 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b3e6e-c4b5-4046-b0f9-77fe61d9e84f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:47.054173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe4c00-497c-4d63-a5f5-f943aff03122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:47.058697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe4c00-497c-4d63-a5f5-f943aff03122 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:47.061233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe4c00-497c-4d63-a5f5-f943aff03122 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:47.061681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe4c00-497c-4d63-a5f5-f943aff03122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:47.068208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c8fe4c00-497c-4d63-a5f5-f943aff03122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:47.445483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe4c00-497c-4d63-a5f5-f943aff03122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:47.445483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe4c00-497c-4d63-a5f5-f943aff03122 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:47.478257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 893/1809] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:48.106849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a8902-b030-475a-84d4-6deb075adf82 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:48.109154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9a3a8902-b030-475a-84d4-6deb075adf82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:48.140001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a8902-b030-475a-84d4-6deb075adf82 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:48.174948 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:48.175801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:48.178285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:48.178845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] PATH_INFO: `/v3/projects/095e5304b32b44ab90cebdb30bdb68d1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:48.180526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] RBAC: Authorizing `identity:delete_project(project_id=095e5304b32b44ab90cebdb30bdb68d1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:48.185588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:48.333556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095e5304b32b44ab90cebdb30bdb68d1', 'request_id': 'req-b4b35cac-84d3-476a-b921-a8f1eda5108b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:48.354284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095e5304b32b44ab90cebdb30bdb68d1', 'request_id': 'req-b4b35cac-84d3-476a-b921-a8f1eda5108b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:48.382973 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095e5304b32b44ab90cebdb30bdb68d1', 'request_id': 'req-b4b35cac-84d3-476a-b921-a8f1eda5108b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:48.420072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] The token cache is being invalidate because project 095e5304b32b44ab90cebdb30bdb68d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:48.420167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:48.420834 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b4b35cac-84d3-476a-b921-a8f1eda5108b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:48.458975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 917/1810] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:48 2022] DELETE /identity/v3/projects/095e5304b32b44ab90cebdb30bdb68d1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:48.462515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe4c00-497c-4d63-a5f5-f943aff03122 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:48.484334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe4c00-497c-4d63-a5f5-f943aff03122 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:48.861542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5f8c4-c94f-4ac9-9036-0802d29ffa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:48.862508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f8c4-c94f-4ac9-9036-0802d29ffa7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:48.862940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f8c4-c94f-4ac9-9036-0802d29ffa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:48.863356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f8c4-c94f-4ac9-9036-0802d29ffa7a admin admin] PATH_INFO: `/v3/users/2ac778edd29a4832bb5d4db89acdbdf6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:48.864704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5f8c4-c94f-4ac9-9036-0802d29ffa7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac778edd29a4832bb5d4db89acdbdf6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:48.867113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5f8c4-c94f-4ac9-9036-0802d29ffa7a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:48.898007 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:48.990530 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-35e5f8c4-c94f-4ac9-9036-0802d29ffa7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac778edd29a4832bb5d4db89acdbdf6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:48.991415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-35e5f8c4-c94f-4ac9-9036-0802d29ffa7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac778edd29a4832bb5d4db89acdbdf6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:49.031904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-35e5f8c4-c94f-4ac9-9036-0802d29ffa7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac778edd29a4832bb5d4db89acdbdf6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:49.042684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-35e5f8c4-c94f-4ac9-9036-0802d29ffa7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac778edd29a4832bb5d4db89acdbdf6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:49.050340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-35e5f8c4-c94f-4ac9-9036-0802d29ffa7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac778edd29a4832bb5d4db89acdbdf6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:49.089010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 894/1811] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:48 2022] DELETE /identity/v3/users/2ac778edd29a4832bb5d4db89acdbdf6 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:50.215491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b6221-5764-4d37-8612-8036fb4b3e6f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:50.216546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b6221-5764-4d37-8612-8036fb4b3e6f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:50.217087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b6221-5764-4d37-8612-8036fb4b3e6f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:50.218765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 918/1812] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:10:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:10:50.611900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b19ce9-1a7c-47e0-ab2d-982b5d929dd2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:50.613062 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b19ce9-1a7c-47e0-ab2d-982b5d929dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:50.613062 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b19ce9-1a7c-47e0-ab2d-982b5d929dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:50.666839 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-24b19ce9-1a7c-47e0-ab2d-982b5d929dd2 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:50.668004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-24b19ce9-1a7c-47e0-ab2d-982b5d929dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:50.905140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 895/1813] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:10:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:51.028760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b6221-5764-4d37-8612-8036fb4b3e6f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:51.030577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-645b6221-5764-4d37-8612-8036fb4b3e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:51.065672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b6221-5764-4d37-8612-8036fb4b3e6f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:51.074067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860861f-b0d8-450a-b28a-8ba3a5f6c4a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:51.075164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860861f-b0d8-450a-b28a-8ba3a5f6c4a7 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:51.075611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860861f-b0d8-450a-b28a-8ba3a5f6c4a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:51.076048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860861f-b0d8-450a-b28a-8ba3a5f6c4a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:51.089118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860861f-b0d8-450a-b28a-8ba3a5f6c4a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:51.092458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860861f-b0d8-450a-b28a-8ba3a5f6c4a7 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:51.123482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 919/1814] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:51.708338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b19ce9-1a7c-47e0-ab2d-982b5d929dd2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:51.722207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-24b19ce9-1a7c-47e0-ab2d-982b5d929dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:51.937308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b19ce9-1a7c-47e0-ab2d-982b5d929dd2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:51.967469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:51.968139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:51.968414 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:51.968679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] PATH_INFO: `/v3/projects/481779f57ee6481d87f7eaa204eefaee` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:51.970028 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=481779f57ee6481d87f7eaa204eefaee)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:51.972118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:52.032101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:52.083323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481779f57ee6481d87f7eaa204eefaee', 'request_id': 'req-f4946f22-14b0-4568-b1ce-57c824ab6963'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:52.094582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481779f57ee6481d87f7eaa204eefaee', 'request_id': 'req-f4946f22-14b0-4568-b1ce-57c824ab6963'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:52.100882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c8b9-1169-437e-aabe-b13758d5fb12 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:52.101463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c8b9-1169-437e-aabe-b13758d5fb12 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:52.101463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c8b9-1169-437e-aabe-b13758d5fb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:52.117777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481779f57ee6481d87f7eaa204eefaee', 'request_id': 'req-f4946f22-14b0-4568-b1ce-57c824ab6963'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:52.139661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] The token cache is being invalidate because project 481779f57ee6481d87f7eaa204eefaee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:52.147965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:52.158047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f4946f22-14b0-4568-b1ce-57c824ab6963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:52.168401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 896/1815] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:51 2022] DELETE /identity/v3/projects/481779f57ee6481d87f7eaa204eefaee => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:52.170686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50748-27da-4356-a69b-dceec8e532bf None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:52.171184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50748-27da-4356-a69b-dceec8e532bf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:52.171771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50748-27da-4356-a69b-dceec8e532bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:52.230811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d197c8b9-1169-437e-aabe-b13758d5fb12 None None] MFA Rules not processed for user `8b1b274a848541da84e7186367e6d897`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:52.231125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-91a50748-27da-4356-a69b-dceec8e532bf None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:52.232480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-91a50748-27da-4356-a69b-dceec8e532bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:52.239571 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d197c8b9-1169-437e-aabe-b13758d5fb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:52.418252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 897/1816] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:52.419963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b657c80-87d2-4558-9338-a624ee70de28 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:52.420345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b657c80-87d2-4558-9338-a624ee70de28 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:52.420680 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b657c80-87d2-4558-9338-a624ee70de28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:52.442454 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:52.471819 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3b657c80-87d2-4558-9338-a624ee70de28 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:52.477871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3b657c80-87d2-4558-9338-a624ee70de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:52.503166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 898/1817] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:52.504607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b657c80-87d2-4558-9338-a624ee70de28 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:52.525076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b657c80-87d2-4558-9338-a624ee70de28 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:52.544774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2b633-efbb-4939-b0d4-fbfbbd81c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:52.545774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2b633-efbb-4939-b0d4-fbfbbd81c27d admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:52.546348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2b633-efbb-4939-b0d4-fbfbbd81c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:52.546823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2b633-efbb-4939-b0d4-fbfbbd81c27d admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:52.548283 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2b633-efbb-4939-b0d4-fbfbbd81c27d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:52.548599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 920/1818] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:52.549366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2b633-efbb-4939-b0d4-fbfbbd81c27d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:52.553591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2b633-efbb-4939-b0d4-fbfbbd81c27d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:52.559043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21477b99-e617-4003-aa7f-d19c3d73be28 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:52.559412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21477b99-e617-4003-aa7f-d19c3d73be28 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:52.559760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21477b99-e617-4003-aa7f-d19c3d73be28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:52.601087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 899/1819] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:52.603038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2b633-efbb-4939-b0d4-fbfbbd81c27d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:52.621567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2b633-efbb-4939-b0d4-fbfbbd81c27d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:52.629917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6848fa-9f3c-4d85-b7a2-41cd879c8a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:52.635995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6848fa-9f3c-4d85-b7a2-41cd879c8a48 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:52.637446 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6848fa-9f3c-4d85-b7a2-41cd879c8a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:52.639958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6848fa-9f3c-4d85-b7a2-41cd879c8a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:52.643478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6848fa-9f3c-4d85-b7a2-41cd879c8a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:52.650614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6848fa-9f3c-4d85-b7a2-41cd879c8a48 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:52.653132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-21477b99-e617-4003-aa7f-d19c3d73be28 None None] MFA Rules not processed for user `9890876abbee40d1a4b7c486e795dcf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:52.669854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-21477b99-e617-4003-aa7f-d19c3d73be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:52.766751 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 900/1820] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:52 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:52.777347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6848fa-9f3c-4d85-b7a2-41cd879c8a48 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:52.908944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 921/1821] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:53.040626 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6848fa-9f3c-4d85-b7a2-41cd879c8a48 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:53.066615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61477c72-8977-4463-8d50-4d7f5b8993b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:53.070333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61477c72-8977-4463-8d50-4d7f5b8993b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:53.073400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61477c72-8977-4463-8d50-4d7f5b8993b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:53.074004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61477c72-8977-4463-8d50-4d7f5b8993b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:53.075193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61477c72-8977-4463-8d50-4d7f5b8993b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:53.095636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61477c72-8977-4463-8d50-4d7f5b8993b9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:53.141093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:53.172653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 901/1822] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:52 2022] POST /identity/v3/users => generated 294 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:53.176164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21477b99-e617-4003-aa7f-d19c3d73be28 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:53.191740 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21477b99-e617-4003-aa7f-d19c3d73be28 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:53.204769 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61477c72-8977-4463-8d50-4d7f5b8993b9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:53.207562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-61477c72-8977-4463-8d50-4d7f5b8993b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:53.227776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1671a5-4d3b-4516-99fb-5b8b0fb3250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:53.228964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1671a5-4d3b-4516-99fb-5b8b0fb3250d admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:53.229792 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1671a5-4d3b-4516-99fb-5b8b0fb3250d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:53.229954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1671a5-4d3b-4516-99fb-5b8b0fb3250d admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:53.230747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1671a5-4d3b-4516-99fb-5b8b0fb3250d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:53.233872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1671a5-4d3b-4516-99fb-5b8b0fb3250d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:53.264468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 922/1823] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:53.269358 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1671a5-4d3b-4516-99fb-5b8b0fb3250d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:53.296118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1671a5-4d3b-4516-99fb-5b8b0fb3250d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:53.313151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0b8bf-226e-4b6d-8933-e4fad68bbdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:53.315325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0b8bf-226e-4b6d-8933-e4fad68bbdea admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:53.316982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0b8bf-226e-4b6d-8933-e4fad68bbdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:53.317337 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0b8bf-226e-4b6d-8933-e4fad68bbdea admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:53.319321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0b8bf-226e-4b6d-8933-e4fad68bbdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:53.326807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0b8bf-226e-4b6d-8933-e4fad68bbdea admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:53.360029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 923/1824] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:10:53.363379 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0b8bf-226e-4b6d-8933-e4fad68bbdea admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:53.383036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0b8bf-226e-4b6d-8933-e4fad68bbdea admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:53.397525 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61477c72-8977-4463-8d50-4d7f5b8993b9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:53.400301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27dd4c-34bd-4ba7-9491-75c08cbe88b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:53.401150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27dd4c-34bd-4ba7-9491-75c08cbe88b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:53.401432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27dd4c-34bd-4ba7-9491-75c08cbe88b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:53.401706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27dd4c-34bd-4ba7-9491-75c08cbe88b4 admin admin] PATH_INFO: `/v3/projects/4ddea5a2b8874a2db93b5f022fffac83/users/63ea33e561fa4877b017967d132d575e/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:53.405552 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1232501-8e92-4b4a-990f-3572ee2485cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:53.406492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1232501-8e92-4b4a-990f-3572ee2485cb service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:53.406989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1232501-8e92-4b4a-990f-3572ee2485cb service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:53.407466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1232501-8e92-4b4a-990f-3572ee2485cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:53.409635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a1232501-8e92-4b4a-990f-3572ee2485cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:53.440783 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27dd4c-34bd-4ba7-9491-75c08cbe88b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ddea5a2b8874a2db93b5f022fffac83, user_id=63ea33e561fa4877b017967d132d575e, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:53.444275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27dd4c-34bd-4ba7-9491-75c08cbe88b4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:53.478870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 924/1825] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:53 2022] PUT /identity/v3/projects/4ddea5a2b8874a2db93b5f022fffac83/users/63ea33e561fa4877b017967d132d575e/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:53.490856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8162a5-a9ad-431b-a41a-7f7d255f20ba None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:53.500678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8162a5-a9ad-431b-a41a-7f7d255f20ba None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:53.502174 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8162a5-a9ad-431b-a41a-7f7d255f20ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:53.529742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1232501-8e92-4b4a-990f-3572ee2485cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:53.532349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1232501-8e92-4b4a-990f-3572ee2485cb service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:53.548285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 902/1826] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:53.552783 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9b8162a5-a9ad-431b-a41a-7f7d255f20ba None None] MFA Rules not processed for user `63ea33e561fa4877b017967d132d575e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:53.556734 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9b8162a5-a9ad-431b-a41a-7f7d255f20ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:53.722917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 925/1827] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:53.724500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1232501-8e92-4b4a-990f-3572ee2485cb service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:53.738206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1232501-8e92-4b4a-990f-3572ee2485cb service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:53.924670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c6ace-be7b-4793-9aa1-559d36e44f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:53.926193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c6ace-be7b-4793-9aa1-559d36e44f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:53.926633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c6ace-be7b-4793-9aa1-559d36e44f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:53.927098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c6ace-be7b-4793-9aa1-559d36e44f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:53.928071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c6ace-be7b-4793-9aa1-559d36e44f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:53.936291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c6ace-be7b-4793-9aa1-559d36e44f8c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:53.996686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8162a5-a9ad-431b-a41a-7f7d255f20ba None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:54.005515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 903/1828] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:53 2022] POST /identity/v3/projects => generated 387 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:10:54.019861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8162a5-a9ad-431b-a41a-7f7d255f20ba None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:54.128107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:54.186901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6a740-7ecb-4c36-8656-15b9364408f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:54.187749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6a740-7ecb-4c36-8656-15b9364408f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:54.187855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6a740-7ecb-4c36-8656-15b9364408f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:54.188068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6a740-7ecb-4c36-8656-15b9364408f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:54.188722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6a740-7ecb-4c36-8656-15b9364408f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:54.195267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6a740-7ecb-4c36-8656-15b9364408f4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:54.245766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 926/1829] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:53 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:10:54.246520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c6ace-be7b-4793-9aa1-559d36e44f8c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:54.273659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c6ace-be7b-4793-9aa1-559d36e44f8c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:54.289947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eae6b2-f635-4a11-a03d-e22ab5c672b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:54.290588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eae6b2-f635-4a11-a03d-e22ab5c672b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:54.290986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eae6b2-f635-4a11-a03d-e22ab5c672b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:54.291265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eae6b2-f635-4a11-a03d-e22ab5c672b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:54.291934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eae6b2-f635-4a11-a03d-e22ab5c672b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:54.293620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eae6b2-f635-4a11-a03d-e22ab5c672b3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:54.318335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 904/1830] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:54.331065 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6a740-7ecb-4c36-8656-15b9364408f4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:54.343527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6a740-7ecb-4c36-8656-15b9364408f4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:54.357846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4be472-4a74-46ba-8d8b-86823a9e9873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:54.358525 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4be472-4a74-46ba-8d8b-86823a9e9873 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:54.358808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4be472-4a74-46ba-8d8b-86823a9e9873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:54.359080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4be472-4a74-46ba-8d8b-86823a9e9873 admin admin] PATH_INFO: `/v3/projects/759a43f563c4420190902290beac3f72/users/b3e05c61941c4853a9a19f710f9afc3b/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:54.401088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4be472-4a74-46ba-8d8b-86823a9e9873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759a43f563c4420190902290beac3f72, user_id=b3e05c61941c4853a9a19f710f9afc3b, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:54.404686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4be472-4a74-46ba-8d8b-86823a9e9873 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:54.445142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 927/1831] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:54 2022] PUT /identity/v3/projects/759a43f563c4420190902290beac3f72/users/b3e05c61941c4853a9a19f710f9afc3b/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:54.448859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eae6b2-f635-4a11-a03d-e22ab5c672b3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:54.461391 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eae6b2-f635-4a11-a03d-e22ab5c672b3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:54.498320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:54.669033 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16f856-a855-429e-ae7a-24619c3bff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:54.681872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16f856-a855-429e-ae7a-24619c3bff5a admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:54.682843 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16f856-a855-429e-ae7a-24619c3bff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:54.683309 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16f856-a855-429e-ae7a-24619c3bff5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:54.685590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16f856-a855-429e-ae7a-24619c3bff5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:54.689106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16f856-a855-429e-ae7a-24619c3bff5a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:54.711283 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 905/1832] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:54.715965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4be472-4a74-46ba-8d8b-86823a9e9873 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:54.754759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4be472-4a74-46ba-8d8b-86823a9e9873 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:54.764155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e55b6-5f9c-4a86-b631-c8cd2eb566b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:54.764859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e55b6-5f9c-4a86-b631-c8cd2eb566b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:54.765170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e55b6-5f9c-4a86-b631-c8cd2eb566b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:54.765600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e55b6-5f9c-4a86-b631-c8cd2eb566b0 admin admin] PATH_INFO: `/v3/projects/759a43f563c4420190902290beac3f72/users/b3e05c61941c4853a9a19f710f9afc3b/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:54.770018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e55b6-5f9c-4a86-b631-c8cd2eb566b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759a43f563c4420190902290beac3f72, user_id=b3e05c61941c4853a9a19f710f9afc3b, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:54.774029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e55b6-5f9c-4a86-b631-c8cd2eb566b0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:54.802938 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 928/1833] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:54 2022] PUT /identity/v3/projects/759a43f563c4420190902290beac3f72/users/b3e05c61941c4853a9a19f710f9afc3b/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:54.813452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558868fa-5cf4-49b2-804c-0eea63ad3fac None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:54.813997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558868fa-5cf4-49b2-804c-0eea63ad3fac None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:54.814381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558868fa-5cf4-49b2-804c-0eea63ad3fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:54.927945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-558868fa-5cf4-49b2-804c-0eea63ad3fac None None] MFA Rules not processed for user `b3e05c61941c4853a9a19f710f9afc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:54.930433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-558868fa-5cf4-49b2-804c-0eea63ad3fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:55.211854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 906/1834] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:55.223854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e55b6-5f9c-4a86-b631-c8cd2eb566b0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:55.226158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-529e55b6-5f9c-4a86-b631-c8cd2eb566b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:55.365127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e55b6-5f9c-4a86-b631-c8cd2eb566b0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:55.377462 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47759be-498a-41b1-a421-a37ec0a9ae43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:55.378051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47759be-498a-41b1-a421-a37ec0a9ae43 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:55.378324 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47759be-498a-41b1-a421-a37ec0a9ae43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:55.378589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47759be-498a-41b1-a421-a37ec0a9ae43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:55.394745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47759be-498a-41b1-a421-a37ec0a9ae43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:55.399123 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47759be-498a-41b1-a421-a37ec0a9ae43 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:55.448276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 929/1835] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:55.484593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558868fa-5cf4-49b2-804c-0eea63ad3fac None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:55.649052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558868fa-5cf4-49b2-804c-0eea63ad3fac None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:55.657089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:55.659784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:55.660793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:55.662940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] PATH_INFO: `/v3/users/63ea33e561fa4877b017967d132d575e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:55.681682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ea33e561fa4877b017967d132d575e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:55.689427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:55.845948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:55.864552 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ea33e561fa4877b017967d132d575e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:55.865275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ea33e561fa4877b017967d132d575e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:55.883253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ea33e561fa4877b017967d132d575e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:55.894034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ea33e561fa4877b017967d132d575e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:55.894855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ea33e561fa4877b017967d132d575e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:55.931080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 907/1836] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:55 2022] DELETE /identity/v3/users/63ea33e561fa4877b017967d132d575e => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:55.945341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca9650-efc5-47c9-9224-94839e33e1a5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:55.945885 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca9650-efc5-47c9-9224-94839e33e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:55.946366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca9650-efc5-47c9-9224-94839e33e1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:55.985376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-46ca9650-efc5-47c9-9224-94839e33e1a5 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:55.991200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-46ca9650-efc5-47c9-9224-94839e33e1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:56.221205 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 930/1837] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:56.240301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:56.241925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:56.408868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664db749-d6e9-4618-bd12-356994980d1f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:56.412626 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9b7ef-8b63-4ff8-a65b-c7d9fb5bc33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:56.413333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b7ef-8b63-4ff8-a65b-c7d9fb5bc33f service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:56.413670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b7ef-8b63-4ff8-a65b-c7d9fb5bc33f service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:56.414035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b7ef-8b63-4ff8-a65b-c7d9fb5bc33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:56.425904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9b7ef-8b63-4ff8-a65b-c7d9fb5bc33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:56.428193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9b7ef-8b63-4ff8-a65b-c7d9fb5bc33f service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:56.441279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 908/1838] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:10:56.826425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca9650-efc5-47c9-9224-94839e33e1a5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:56.828091 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-46ca9650-efc5-47c9-9224-94839e33e1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:56.846995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca9650-efc5-47c9-9224-94839e33e1a5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:56.863143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:56.863852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:56.864096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:56.864361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] PATH_INFO: `/v3/projects/4ddea5a2b8874a2db93b5f022fffac83` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:56.865576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ddea5a2b8874a2db93b5f022fffac83)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:56.867617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:56.897304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:56.939957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ddea5a2b8874a2db93b5f022fffac83', 'request_id': 'req-218cc2ee-293f-4580-bdff-22cc6d11ad20'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:56.978572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ddea5a2b8874a2db93b5f022fffac83', 'request_id': 'req-218cc2ee-293f-4580-bdff-22cc6d11ad20'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:56.999443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ddea5a2b8874a2db93b5f022fffac83', 'request_id': 'req-218cc2ee-293f-4580-bdff-22cc6d11ad20'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.016435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] The token cache is being invalidate because project 4ddea5a2b8874a2db93b5f022fffac83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:57.016732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.018006 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-218cc2ee-293f-4580-bdff-22cc6d11ad20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.019631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 931/1839] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:56 2022] DELETE /identity/v3/projects/4ddea5a2b8874a2db93b5f022fffac83 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:57.023922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9b7ef-8b63-4ff8-a65b-c7d9fb5bc33f service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:57.033954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9b7ef-8b63-4ff8-a65b-c7d9fb5bc33f service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:57.098547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d8612-e6d0-43de-bfa7-b2416339c799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:57.099237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d8612-e6d0-43de-bfa7-b2416339c799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:57.099567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d8612-e6d0-43de-bfa7-b2416339c799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:57.099842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d8612-e6d0-43de-bfa7-b2416339c799 admin admin] PATH_INFO: `/v3/users/b3e05c61941c4853a9a19f710f9afc3b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:57.101009 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d8612-e6d0-43de-bfa7-b2416339c799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e05c61941c4853a9a19f710f9afc3b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:57.103347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d8612-e6d0-43de-bfa7-b2416339c799 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:57.172145 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4c3d8612-e6d0-43de-bfa7-b2416339c799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e05c61941c4853a9a19f710f9afc3b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.173442 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4c3d8612-e6d0-43de-bfa7-b2416339c799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e05c61941c4853a9a19f710f9afc3b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.185822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4c3d8612-e6d0-43de-bfa7-b2416339c799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e05c61941c4853a9a19f710f9afc3b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.191278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:57.204217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4c3d8612-e6d0-43de-bfa7-b2416339c799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e05c61941c4853a9a19f710f9afc3b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.218278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4c3d8612-e6d0-43de-bfa7-b2416339c799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e05c61941c4853a9a19f710f9afc3b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.256477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 909/1840] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:10:57 2022] DELETE /identity/v3/users/b3e05c61941c4853a9a19f710f9afc3b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:57.593652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31248-0d58-412f-a684-86221af2def4 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:57.594005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31248-0d58-412f-a684-86221af2def4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:57.595104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31248-0d58-412f-a684-86221af2def4 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:57.597722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 932/1841] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:10:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 22:10:57.630586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ea6e-639d-400f-8934-81ed8796d491 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:57.630880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ea6e-639d-400f-8934-81ed8796d491 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:57.631186 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ea6e-639d-400f-8934-81ed8796d491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:57.642828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f31248-0d58-412f-a684-86221af2def4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:57.644565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b4f31248-0d58-412f-a684-86221af2def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:57.686706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bb76ea6e-639d-400f-8934-81ed8796d491 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:57.687968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bb76ea6e-639d-400f-8934-81ed8796d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:57.802387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f31248-0d58-412f-a684-86221af2def4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:57.806291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:57.806959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:57.807239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:57.807514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] PATH_INFO: `/v3/projects/759a43f563c4420190902290beac3f72` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:57.809678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759a43f563c4420190902290beac3f72)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:57.811665 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:57.874322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759a43f563c4420190902290beac3f72', 'request_id': 'req-e5772150-6ac2-4aba-a456-0348ee5d9646'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.882690 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 910/1842] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:10:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:57.889094 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759a43f563c4420190902290beac3f72', 'request_id': 'req-e5772150-6ac2-4aba-a456-0348ee5d9646'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.896827 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759a43f563c4420190902290beac3f72', 'request_id': 'req-e5772150-6ac2-4aba-a456-0348ee5d9646'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.911959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] The token cache is being invalidate because project 759a43f563c4420190902290beac3f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:10:57.912247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.913150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e5772150-6ac2-4aba-a456-0348ee5d9646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:10:57.914952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 933/1843] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:10:57 2022] DELETE /identity/v3/projects/759a43f563c4420190902290beac3f72 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:57.924728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d993a5-70bd-484c-89d9-a4032ee49086 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:57.924728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d993a5-70bd-484c-89d9-a4032ee49086 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:57.924728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d993a5-70bd-484c-89d9-a4032ee49086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:57.952921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d9d993a5-70bd-484c-89d9-a4032ee49086 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:57.954424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d9d993a5-70bd-484c-89d9-a4032ee49086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:58.032673 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 911/1844] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:58.034614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735579ae-8fd5-43bf-ad2a-ae894f1961a1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:58.034899 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735579ae-8fd5-43bf-ad2a-ae894f1961a1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:58.035270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735579ae-8fd5-43bf-ad2a-ae894f1961a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:58.080214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-735579ae-8fd5-43bf-ad2a-ae894f1961a1 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:58.081793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-735579ae-8fd5-43bf-ad2a-ae894f1961a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:58.095535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 934/1845] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:58.101700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d993a5-70bd-484c-89d9-a4032ee49086 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:58.115775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d993a5-70bd-484c-89d9-a4032ee49086 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:58.124804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9eda32-0ea3-4fde-a3be-fc5dad6e8496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:58.125495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eda32-0ea3-4fde-a3be-fc5dad6e8496 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:58.125770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eda32-0ea3-4fde-a3be-fc5dad6e8496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:58.126087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eda32-0ea3-4fde-a3be-fc5dad6e8496 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:58.127067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eda32-0ea3-4fde-a3be-fc5dad6e8496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:10:58.127420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eda32-0ea3-4fde-a3be-fc5dad6e8496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:58.130940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eda32-0ea3-4fde-a3be-fc5dad6e8496 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:58.150794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 912/1846] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:10:58.155412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735579ae-8fd5-43bf-ad2a-ae894f1961a1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:58.165516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735579ae-8fd5-43bf-ad2a-ae894f1961a1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:58.170638 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2629b-d0ee-4046-9e62-937863b5299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:58.171255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2629b-d0ee-4046-9e62-937863b5299f admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:58.171527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2629b-d0ee-4046-9e62-937863b5299f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:58.171859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2629b-d0ee-4046-9e62-937863b5299f admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:58.172859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2629b-d0ee-4046-9e62-937863b5299f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:58.175024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2629b-d0ee-4046-9e62-937863b5299f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:58.212767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 935/1847] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:58 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:10:58.216905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9eda32-0ea3-4fde-a3be-fc5dad6e8496 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:58.230480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9eda32-0ea3-4fde-a3be-fc5dad6e8496 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:58.372940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:58.393029 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7280f5-a28e-49ca-98d8-219060a27f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:58.393723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7280f5-a28e-49ca-98d8-219060a27f9c admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:58.394080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7280f5-a28e-49ca-98d8-219060a27f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:58.396713 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7280f5-a28e-49ca-98d8-219060a27f9c admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:58.396713 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7280f5-a28e-49ca-98d8-219060a27f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:58.402350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7280f5-a28e-49ca-98d8-219060a27f9c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:58.466905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 913/1848] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:58 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:10:58.471146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2629b-d0ee-4046-9e62-937863b5299f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:58.485302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2629b-d0ee-4046-9e62-937863b5299f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:58.493425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b4dcd-6931-4d0b-84c4-91020267702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:58.494338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b4dcd-6931-4d0b-84c4-91020267702e admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:58.494733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b4dcd-6931-4d0b-84c4-91020267702e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:58.495070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b4dcd-6931-4d0b-84c4-91020267702e admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:58.495272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7280f5-a28e-49ca-98d8-219060a27f9c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:58.496691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b4dcd-6931-4d0b-84c4-91020267702e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:58.497249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6c7280f5-a28e-49ca-98d8-219060a27f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:58.498730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b4dcd-6931-4d0b-84c4-91020267702e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:58.513279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 936/1849] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:58.517434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b4dcd-6931-4d0b-84c4-91020267702e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:58.528750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:58.540005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b4dcd-6931-4d0b-84c4-91020267702e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:58.557163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feb8b2-d237-463e-b1d7-dd55a9b9ddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:58.557163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feb8b2-d237-463e-b1d7-dd55a9b9ddfd admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:58.557727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feb8b2-d237-463e-b1d7-dd55a9b9ddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:58.557967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feb8b2-d237-463e-b1d7-dd55a9b9ddfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:58.558825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08feb8b2-d237-463e-b1d7-dd55a9b9ddfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:58.560396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08feb8b2-d237-463e-b1d7-dd55a9b9ddfd admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:58.585072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 937/1850] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:10:58.598404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feb8b2-d237-463e-b1d7-dd55a9b9ddfd admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:58.631966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feb8b2-d237-463e-b1d7-dd55a9b9ddfd admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:58.657895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a851ffb-e37f-42ab-a00b-625317b983dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:58.658605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a851ffb-e37f-42ab-a00b-625317b983dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:58.658875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a851ffb-e37f-42ab-a00b-625317b983dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:58.659148 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a851ffb-e37f-42ab-a00b-625317b983dc admin admin] PATH_INFO: `/v3/projects/69cee53c63d44091a6ea8b93e7915b80/users/180760b25ffb450bbbf0b9f431a6696e/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:58.688592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7280f5-a28e-49ca-98d8-219060a27f9c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:58.704755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bac1f-3b0a-4650-8b97-bedaaa95142e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:58.705694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bac1f-3b0a-4650-8b97-bedaaa95142e service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:58.707319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bac1f-3b0a-4650-8b97-bedaaa95142e service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:58.707613 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bac1f-3b0a-4650-8b97-bedaaa95142e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:58.712212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-892bac1f-3b0a-4650-8b97-bedaaa95142e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:58.718253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a851ffb-e37f-42ab-a00b-625317b983dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cee53c63d44091a6ea8b93e7915b80, user_id=180760b25ffb450bbbf0b9f431a6696e, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:58.728902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a851ffb-e37f-42ab-a00b-625317b983dc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:58.749685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bac1f-3b0a-4650-8b97-bedaaa95142e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:58.752684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bac1f-3b0a-4650-8b97-bedaaa95142e service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:58.770607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 938/1851] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:58 2022] PUT /identity/v3/projects/69cee53c63d44091a6ea8b93e7915b80/users/180760b25ffb450bbbf0b9f431a6696e/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:58.781639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105643c-114e-4eb3-b0f1-0d587ede5caf None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:58.781984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105643c-114e-4eb3-b0f1-0d587ede5caf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:58.782220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105643c-114e-4eb3-b0f1-0d587ede5caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:58.802728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 914/1852] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:10:58.872790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c105643c-114e-4eb3-b0f1-0d587ede5caf None None] MFA Rules not processed for user `180760b25ffb450bbbf0b9f431a6696e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:58.878700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c105643c-114e-4eb3-b0f1-0d587ede5caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:58.964109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 939/1853] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:10:58.968684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bac1f-3b0a-4650-8b97-bedaaa95142e service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:58.997483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bac1f-3b0a-4650-8b97-bedaaa95142e service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:59.102445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e2d79-827f-48ad-ad3c-7d911725bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:59.103153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e2d79-827f-48ad-ad3c-7d911725bb79 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:59.103365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e2d79-827f-48ad-ad3c-7d911725bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:59.104482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e2d79-827f-48ad-ad3c-7d911725bb79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:59.105311 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e2d79-827f-48ad-ad3c-7d911725bb79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:59.107679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e2d79-827f-48ad-ad3c-7d911725bb79 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:59.138771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 915/1854] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:10:58 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:10:59.142941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105643c-114e-4eb3-b0f1-0d587ede5caf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:59.154491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105643c-114e-4eb3-b0f1-0d587ede5caf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:59.230366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f21f-8f99-4620-912b-a1a0f9a0edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:59.232025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f21f-8f99-4620-912b-a1a0f9a0edea admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:59.232025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f21f-8f99-4620-912b-a1a0f9a0edea admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:59.232025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f21f-8f99-4620-912b-a1a0f9a0edea admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:59.232389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07f21f-8f99-4620-912b-a1a0f9a0edea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:59.234417 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07f21f-8f99-4620-912b-a1a0f9a0edea admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:59.275341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 940/1855] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:10:59 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:10:59.279543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e2d79-827f-48ad-ad3c-7d911725bb79 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:59.302900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e2d79-827f-48ad-ad3c-7d911725bb79 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:59.314760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e6098-51f7-4184-9425-5d9f3529036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:59.315403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6098-51f7-4184-9425-5d9f3529036d admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:59.315687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6098-51f7-4184-9425-5d9f3529036d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:59.315957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6098-51f7-4184-9425-5d9f3529036d admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:59.316657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e6098-51f7-4184-9425-5d9f3529036d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:59.318345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e6098-51f7-4184-9425-5d9f3529036d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:59.332164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 916/1856] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:59.336825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f21f-8f99-4620-912b-a1a0f9a0edea admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:59.349318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f21f-8f99-4620-912b-a1a0f9a0edea admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:59.355798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b9ace-d578-43b3-9128-a4b6fd7f6cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:59.356643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9ace-d578-43b3-9128-a4b6fd7f6cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:59.356754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9ace-d578-43b3-9128-a4b6fd7f6cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:59.357067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9ace-d578-43b3-9128-a4b6fd7f6cca admin admin] PATH_INFO: `/v3/projects/6d608964c7ae4af58e845947485c02ac/users/a8b2c30a53b14bd8bbc592ea5c0883fd/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:59.388854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b9ace-d578-43b3-9128-a4b6fd7f6cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d608964c7ae4af58e845947485c02ac, user_id=a8b2c30a53b14bd8bbc592ea5c0883fd, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:59.391980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b9ace-d578-43b3-9128-a4b6fd7f6cca admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:59.422130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 941/1857] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:59 2022] PUT /identity/v3/projects/6d608964c7ae4af58e845947485c02ac/users/a8b2c30a53b14bd8bbc592ea5c0883fd/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:59.427059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e6098-51f7-4184-9425-5d9f3529036d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:59.461052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e6098-51f7-4184-9425-5d9f3529036d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:59.536620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:59.565467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128195-9f8e-44f9-9208-a27818fe5395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:59.567211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128195-9f8e-44f9-9208-a27818fe5395 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:59.567588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128195-9f8e-44f9-9208-a27818fe5395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:59.568071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128195-9f8e-44f9-9208-a27818fe5395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:59.569127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128195-9f8e-44f9-9208-a27818fe5395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:59.571140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128195-9f8e-44f9-9208-a27818fe5395 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:59.590846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b9ace-d578-43b3-9128-a4b6fd7f6cca admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:59.590997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 917/1858] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:10:59.606979 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b9ace-d578-43b3-9128-a4b6fd7f6cca admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:59.612340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf50667-8a3b-462c-b91f-9d86b2eb7465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:59.613350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50667-8a3b-462c-b91f-9d86b2eb7465 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:59.614233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50667-8a3b-462c-b91f-9d86b2eb7465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:59.614233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50667-8a3b-462c-b91f-9d86b2eb7465 admin admin] PATH_INFO: `/v3/projects/6d608964c7ae4af58e845947485c02ac/users/a8b2c30a53b14bd8bbc592ea5c0883fd/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:59.616635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf50667-8a3b-462c-b91f-9d86b2eb7465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d608964c7ae4af58e845947485c02ac, user_id=a8b2c30a53b14bd8bbc592ea5c0883fd, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:59.620045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf50667-8a3b-462c-b91f-9d86b2eb7465 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:59.634962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 942/1859] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:10:59 2022] PUT /identity/v3/projects/6d608964c7ae4af58e845947485c02ac/users/a8b2c30a53b14bd8bbc592ea5c0883fd/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:10:59.645296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb697c2-c564-49ea-bbbe-957401a4eb9c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:59.645883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb697c2-c564-49ea-bbbe-957401a4eb9c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:59.646419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb697c2-c564-49ea-bbbe-957401a4eb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:59.679289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5bb697c2-c564-49ea-bbbe-957401a4eb9c None None] MFA Rules not processed for user `a8b2c30a53b14bd8bbc592ea5c0883fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:10:59.680505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5bb697c2-c564-49ea-bbbe-957401a4eb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:59.773794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 918/1860] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:10:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:10:59.788776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf50667-8a3b-462c-b91f-9d86b2eb7465 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:10:59.791156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4bf50667-8a3b-462c-b91f-9d86b2eb7465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:10:59.804490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:59.872616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf50667-8a3b-462c-b91f-9d86b2eb7465 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:10:59.888660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e29dd-6be5-4eb2-b578-fa9e336e66e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:10:59.890071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e29dd-6be5-4eb2-b578-fa9e336e66e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:10:59.892195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e29dd-6be5-4eb2-b578-fa9e336e66e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:10:59.898382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e29dd-6be5-4eb2-b578-fa9e336e66e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:10:59.933918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e29dd-6be5-4eb2-b578-fa9e336e66e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:10:59.933918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e29dd-6be5-4eb2-b578-fa9e336e66e9 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:10:59.977774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 943/1861] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:10:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:00.641733 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb697c2-c564-49ea-bbbe-957401a4eb9c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:00.654024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb697c2-c564-49ea-bbbe-957401a4eb9c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:00.659336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542412d7-b58f-4601-9123-7807eea79bbe tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b2c30a53b14bd8bbc592ea5c0883fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d608964c7ae4af58e845947485c02ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:00.660303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542412d7-b58f-4601-9123-7807eea79bbe tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:00.660564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542412d7-b58f-4601-9123-7807eea79bbe tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:00.660961 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542412d7-b58f-4601-9123-7807eea79bbe tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:00.661634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542412d7-b58f-4601-9123-7807eea79bbe tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:00.662056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542412d7-b58f-4601-9123-7807eea79bbe tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:00.663795 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542412d7-b58f-4601-9123-7807eea79bbe tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:00.681286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 919/1862] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:00.682836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e29dd-6be5-4eb2-b578-fa9e336e66e9 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:00.697602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e29dd-6be5-4eb2-b578-fa9e336e66e9 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:00.721997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a30f7-4145-49ab-8d17-4e66dfbba700 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b2c30a53b14bd8bbc592ea5c0883fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d608964c7ae4af58e845947485c02ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:00.722708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a30f7-4145-49ab-8d17-4e66dfbba700 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:00.723068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a30f7-4145-49ab-8d17-4e66dfbba700 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:00.723435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a30f7-4145-49ab-8d17-4e66dfbba700 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:00.724095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a30f7-4145-49ab-8d17-4e66dfbba700 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:00.726194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a30f7-4145-49ab-8d17-4e66dfbba700 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:00.767892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 944/1863] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:00 2022] POST /identity/v3/projects => generated 353 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:00.769354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542412d7-b58f-4601-9123-7807eea79bbe tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:00.781512 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542412d7-b58f-4601-9123-7807eea79bbe tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:00.879808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f18a-64dc-4cd7-8705-e5169d290a29 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b2c30a53b14bd8bbc592ea5c0883fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d608964c7ae4af58e845947485c02ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:00.880466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f18a-64dc-4cd7-8705-e5169d290a29 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:00.880750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f18a-64dc-4cd7-8705-e5169d290a29 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:00.881025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f18a-64dc-4cd7-8705-e5169d290a29 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:00.881694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48f18a-64dc-4cd7-8705-e5169d290a29 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:00.882032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48f18a-64dc-4cd7-8705-e5169d290a29 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:00.883632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48f18a-64dc-4cd7-8705-e5169d290a29 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:00.900236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 920/1864] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:00.959951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a30f7-4145-49ab-8d17-4e66dfbba700 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:00.974345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a30f7-4145-49ab-8d17-4e66dfbba700 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:00.982404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b2c30a53b14bd8bbc592ea5c0883fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d608964c7ae4af58e845947485c02ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:00.983319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:00.983714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:00.984130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] PATH_INFO: `/v3/projects/18c43beee7264f319b3c0fadf2428992` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:00.985426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: Authorizing `identity:delete_project(project_id=18c43beee7264f319b3c0fadf2428992)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:00.987518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:01.049409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c43beee7264f319b3c0fadf2428992', 'request_id': 'req-d676860c-1231-45ad-9e4f-dc679e9cadf9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:01.060246 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c43beee7264f319b3c0fadf2428992', 'request_id': 'req-d676860c-1231-45ad-9e4f-dc679e9cadf9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:01.067935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c43beee7264f319b3c0fadf2428992', 'request_id': 'req-d676860c-1231-45ad-9e4f-dc679e9cadf9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:01.080780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] The token cache is being invalidate because project 18c43beee7264f319b3c0fadf2428992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:01.081153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:01.081912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d676860c-1231-45ad-9e4f-dc679e9cadf9 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:01.083472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 945/1865] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:00 2022] DELETE /identity/v3/projects/18c43beee7264f319b3c0fadf2428992 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:01.401493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f18a-64dc-4cd7-8705-e5169d290a29 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:01.403241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3d48f18a-64dc-4cd7-8705-e5169d290a29 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:01.453260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:01.472626 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f18a-64dc-4cd7-8705-e5169d290a29 tempest-VolumeQuotaClassesTest-1328777860 tempest-VolumeQuotaClassesTest-1328777860-project-admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:01.537203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:01.545864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:01.545864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:01.545864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] PATH_INFO: `/v3/users/180760b25ffb450bbbf0b9f431a6696e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:01.545864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=180760b25ffb450bbbf0b9f431a6696e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:01.546684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:01.765130 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '180760b25ffb450bbbf0b9f431a6696e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:01.766327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '180760b25ffb450bbbf0b9f431a6696e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:01.777217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '180760b25ffb450bbbf0b9f431a6696e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:01.788524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '180760b25ffb450bbbf0b9f431a6696e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:01.789568 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '180760b25ffb450bbbf0b9f431a6696e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:01.828907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 921/1866] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:01 2022] DELETE /identity/v3/users/180760b25ffb450bbbf0b9f431a6696e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:01.833911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36db3d-3f90-48f1-8e97-da8a208b7c1d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:01.836199 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36db3d-3f90-48f1-8e97-da8a208b7c1d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:01.836641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36db3d-3f90-48f1-8e97-da8a208b7c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:01.882372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3b36db3d-3f90-48f1-8e97-da8a208b7c1d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:01.887785 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3b36db3d-3f90-48f1-8e97-da8a208b7c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:01.983715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 946/1867] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:02.004944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:02.006674 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:02.123960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56e11-ef21-4ca3-9fa4-19a6e7961afd admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:02.135167 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffc23e-0cfc-4101-bd8d-ac2c87b73585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:02.135848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc23e-0cfc-4101-bd8d-ac2c87b73585 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:02.137578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc23e-0cfc-4101-bd8d-ac2c87b73585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:02.137578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc23e-0cfc-4101-bd8d-ac2c87b73585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:02.152275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffc23e-0cfc-4101-bd8d-ac2c87b73585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:02.154102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffc23e-0cfc-4101-bd8d-ac2c87b73585 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:02.167663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 922/1868] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:02.382931 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378ae8-683c-4a4d-99d2-48d0ec2487f9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:02.383931 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378ae8-683c-4a4d-99d2-48d0ec2487f9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:02.384434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378ae8-683c-4a4d-99d2-48d0ec2487f9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:02.390628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 947/1869] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:11:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:11:02.419161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002cc95-e70b-4ddf-b25a-83b6b066dda3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:02.419493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002cc95-e70b-4ddf-b25a-83b6b066dda3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:02.419805 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002cc95-e70b-4ddf-b25a-83b6b066dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:02.460664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4002cc95-e70b-4ddf-b25a-83b6b066dda3 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:02.469082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4002cc95-e70b-4ddf-b25a-83b6b066dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:02.499621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:02.616891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 923/1870] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:11:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:02.756080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d378ae8-683c-4a4d-99d2-48d0ec2487f9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:02.759866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6d378ae8-683c-4a4d-99d2-48d0ec2487f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:02.783942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d378ae8-683c-4a4d-99d2-48d0ec2487f9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:02.790731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee34f3-546d-4658-9c6a-a9681d3ba5e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:02.791662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee34f3-546d-4658-9c6a-a9681d3ba5e2 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:02.792088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee34f3-546d-4658-9c6a-a9681d3ba5e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:02.792503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee34f3-546d-4658-9c6a-a9681d3ba5e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:02.803109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee34f3-546d-4658-9c6a-a9681d3ba5e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:02.805037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee34f3-546d-4658-9c6a-a9681d3ba5e2 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:02.813324 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:02.823466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 948/1871] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:03.298337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002cc95-e70b-4ddf-b25a-83b6b066dda3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:03.298337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4002cc95-e70b-4ddf-b25a-83b6b066dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:03.310621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002cc95-e70b-4ddf-b25a-83b6b066dda3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:03.319603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15849353-ce99-459b-90ec-2a2384580c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:03.322935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849353-ce99-459b-90ec-2a2384580c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:03.323312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849353-ce99-459b-90ec-2a2384580c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:03.325028 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849353-ce99-459b-90ec-2a2384580c52 admin admin] PATH_INFO: `/v3/users/75b1d9c4f4154af49a80a20a719d1035` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:03.327030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15849353-ce99-459b-90ec-2a2384580c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b1d9c4f4154af49a80a20a719d1035)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:03.329424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15849353-ce99-459b-90ec-2a2384580c52 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:03.411321 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-15849353-ce99-459b-90ec-2a2384580c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b1d9c4f4154af49a80a20a719d1035'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.412260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-15849353-ce99-459b-90ec-2a2384580c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b1d9c4f4154af49a80a20a719d1035'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.427776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-15849353-ce99-459b-90ec-2a2384580c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b1d9c4f4154af49a80a20a719d1035'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.429596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee34f3-546d-4658-9c6a-a9681d3ba5e2 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:03.434034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-83ee34f3-546d-4658-9c6a-a9681d3ba5e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:03.440899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-15849353-ce99-459b-90ec-2a2384580c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b1d9c4f4154af49a80a20a719d1035'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.441650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-15849353-ce99-459b-90ec-2a2384580c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b1d9c4f4154af49a80a20a719d1035'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.471059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 924/1872] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:03 2022] DELETE /identity/v3/users/75b1d9c4f4154af49a80a20a719d1035 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:03.472877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c205-3d57-4270-adf8-b27837356e75 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:03.473204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c205-3d57-4270-adf8-b27837356e75 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:03.473481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c205-3d57-4270-adf8-b27837356e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:03.477078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee34f3-546d-4658-9c6a-a9681d3ba5e2 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:03.522587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4eb6c205-3d57-4270-adf8-b27837356e75 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:03.524070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4eb6c205-3d57-4270-adf8-b27837356e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:03.556627 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:03.557701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:03.558040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:03.558582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] PATH_INFO: `/v3/projects/69cee53c63d44091a6ea8b93e7915b80` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:03.559727 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cee53c63d44091a6ea8b93e7915b80)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:03.561749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:03.595695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 925/1873] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:03.608577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6c205-3d57-4270-adf8-b27837356e75 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:03.610617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4eb6c205-3d57-4270-adf8-b27837356e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:03.620728 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cee53c63d44091a6ea8b93e7915b80', 'request_id': 'req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.630426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cee53c63d44091a6ea8b93e7915b80', 'request_id': 'req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.642982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cee53c63d44091a6ea8b93e7915b80', 'request_id': 'req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.653192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:03.654951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] The token cache is being invalidate because project 69cee53c63d44091a6ea8b93e7915b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:03.655445 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.656351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.658807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 949/1874] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:03 2022] DELETE /identity/v3/projects/69cee53c63d44091a6ea8b93e7915b80 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:03.663032 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:03.665260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:03.727919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6c205-3d57-4270-adf8-b27837356e75 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:03.746629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58ff8a-7529-4d9a-885e-1e4feb48b1e8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:03.767848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:03.768391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:03.768733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:03.771152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] PATH_INFO: `/v3/users/a8b2c30a53b14bd8bbc592ea5c0883fd` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:03.773066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b2c30a53b14bd8bbc592ea5c0883fd)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:03.775121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:03.848798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:03.852702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fef93-e689-46a3-ab91-319e02501c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:03.853335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fef93-e689-46a3-ab91-319e02501c87 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:03.853611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fef93-e689-46a3-ab91-319e02501c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:03.853904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fef93-e689-46a3-ab91-319e02501c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:03.861410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-205fef93-e689-46a3-ab91-319e02501c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:03.872600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b2c30a53b14bd8bbc592ea5c0883fd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.884236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b2c30a53b14bd8bbc592ea5c0883fd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.885139 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b2c30a53b14bd8bbc592ea5c0883fd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.891499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fef93-e689-46a3-ab91-319e02501c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:03.892960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fef93-e689-46a3-ab91-319e02501c87 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:03.893973 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b2c30a53b14bd8bbc592ea5c0883fd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.909570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b2c30a53b14bd8bbc592ea5c0883fd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:03.914728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 926/1875] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:11:03.927862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 950/1876] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:03 2022] DELETE /identity/v3/users/a8b2c30a53b14bd8bbc592ea5c0883fd => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:04.866293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fef93-e689-46a3-ab91-319e02501c87 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:04.868687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-205fef93-e689-46a3-ab91-319e02501c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:04.885287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fef93-e689-46a3-ab91-319e02501c87 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:05.006536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:05.008831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:05.010065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:05.011578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.011971 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.012297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] PATH_INFO: `/v3/projects/56b8c202d67b4aaba68540132ac6cc24` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.013732 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b8c202d67b4aaba68540132ac6cc24)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:05.017005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:05.025641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1a2a0-dabe-4f6d-af8a-e785dd41405d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:05.041673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:05.042642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.056289 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.056994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] PATH_INFO: `/v3/projects/6d608964c7ae4af58e845947485c02ac` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.058701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d608964c7ae4af58e845947485c02ac)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:05.060731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:05.099276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b8c202d67b4aaba68540132ac6cc24', 'request_id': 'req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.109317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b8c202d67b4aaba68540132ac6cc24', 'request_id': 'req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.124593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b8c202d67b4aaba68540132ac6cc24', 'request_id': 'req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.129272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d608964c7ae4af58e845947485c02ac', 'request_id': 'req-396fdb33-142b-4be8-ae05-d8b58fa333e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.143215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d608964c7ae4af58e845947485c02ac', 'request_id': 'req-396fdb33-142b-4be8-ae05-d8b58fa333e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.150216 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] The token cache is being invalidate because project 56b8c202d67b4aaba68540132ac6cc24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:05.150758 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.151315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.152435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d608964c7ae4af58e845947485c02ac', 'request_id': 'req-396fdb33-142b-4be8-ae05-d8b58fa333e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.153104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 927/1877] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:04 2022] DELETE /identity/v3/projects/56b8c202d67b4aaba68540132ac6cc24 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:05.157052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:05.159928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:05.180446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] The token cache is being invalidate because project 6d608964c7ae4af58e845947485c02ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:05.181034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.181912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-396fdb33-142b-4be8-ae05-d8b58fa333e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.184832 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 951/1878] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:05 2022] DELETE /identity/v3/projects/6d608964c7ae4af58e845947485c02ac => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:05.192032 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389d165-bbae-4781-a605-4f7bc1d6e4c5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.193666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389d165-bbae-4781-a605-4f7bc1d6e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.196207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389d165-bbae-4781-a605-4f7bc1d6e4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.200592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:05.235801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c389d165-bbae-4781-a605-4f7bc1d6e4c5 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:05.238246 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c389d165-bbae-4781-a605-4f7bc1d6e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:05.315985 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29957-202c-4e50-b5ac-4d7bb00c8a42 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:05.330734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:05.331715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.332000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.332278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] PATH_INFO: `/v3/users/a29a2b69e4a244c0ae96b3e80deb9cd8` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.340381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 952/1879] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:05.340603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a29a2b69e4a244c0ae96b3e80deb9cd8)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:05.340603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:05.342603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111fbc1-abea-420b-9ad3-4c67a2f3690d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.342885 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111fbc1-abea-420b-9ad3-4c67a2f3690d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.343156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111fbc1-abea-420b-9ad3-4c67a2f3690d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.378204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1111fbc1-abea-420b-9ad3-4c67a2f3690d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:05.379671 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1111fbc1-abea-420b-9ad3-4c67a2f3690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:05.390485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 953/1880] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:05.394527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111fbc1-abea-420b-9ad3-4c67a2f3690d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:05.405343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111fbc1-abea-420b-9ad3-4c67a2f3690d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:05.415136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a29a2b69e4a244c0ae96b3e80deb9cd8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.415964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a29a2b69e4a244c0ae96b3e80deb9cd8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.417128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35dcfe-aa1e-47d8-8ea4-e185ac400958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:05.417764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35dcfe-aa1e-47d8-8ea4-e185ac400958 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.418052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35dcfe-aa1e-47d8-8ea4-e185ac400958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.418321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35dcfe-aa1e-47d8-8ea4-e185ac400958 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.418998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35dcfe-aa1e-47d8-8ea4-e185ac400958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:05.419271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35dcfe-aa1e-47d8-8ea4-e185ac400958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:05.420925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35dcfe-aa1e-47d8-8ea4-e185ac400958 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:05.429032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a29a2b69e4a244c0ae96b3e80deb9cd8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.435714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 954/1881] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:05.440648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35dcfe-aa1e-47d8-8ea4-e185ac400958 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:05.442084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a29a2b69e4a244c0ae96b3e80deb9cd8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.442900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a29a2b69e4a244c0ae96b3e80deb9cd8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:05.455473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35dcfe-aa1e-47d8-8ea4-e185ac400958 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:05.462084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5acbe3-3681-4861-8a53-4eabec92d733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:05.462720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5acbe3-3681-4861-8a53-4eabec92d733 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.463158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5acbe3-3681-4861-8a53-4eabec92d733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.463441 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5acbe3-3681-4861-8a53-4eabec92d733 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.464264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5acbe3-3681-4861-8a53-4eabec92d733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:05.466137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 928/1882] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:05 2022] DELETE /identity/v3/users/a29a2b69e4a244c0ae96b3e80deb9cd8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:05.466430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5acbe3-3681-4861-8a53-4eabec92d733 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:05.499674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:05.535984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 955/1883] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:05 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:11:05.536958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:05.538905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:05.617335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61067fbc-ac60-4a0b-b7eb-df0ba7cc3eb5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:05.654759 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:05.691207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f4df0-b723-4036-8378-d8ce7c6b317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:05.691875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f4df0-b723-4036-8378-d8ce7c6b317b admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.692198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f4df0-b723-4036-8378-d8ce7c6b317b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.692471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f4df0-b723-4036-8378-d8ce7c6b317b admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.693308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f4df0-b723-4036-8378-d8ce7c6b317b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:05.695466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f4df0-b723-4036-8378-d8ce7c6b317b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:05.728049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 929/1884] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:05 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:11:05.732162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5acbe3-3681-4861-8a53-4eabec92d733 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:05.745163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5acbe3-3681-4861-8a53-4eabec92d733 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:05.750538 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072124f-9c5a-45a7-931c-a561bc5519ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:05.751245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072124f-9c5a-45a7-931c-a561bc5519ea admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.751743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072124f-9c5a-45a7-931c-a561bc5519ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.752084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072124f-9c5a-45a7-931c-a561bc5519ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.752808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072124f-9c5a-45a7-931c-a561bc5519ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:05.754656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072124f-9c5a-45a7-931c-a561bc5519ea admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:05.769481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 956/1885] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:05.771107 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f4df0-b723-4036-8378-d8ce7c6b317b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:05.784368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f4df0-b723-4036-8378-d8ce7c6b317b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:05.789822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf0916-c6aa-49ea-a1f4-b0691f5873c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:05.790611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf0916-c6aa-49ea-a1f4-b0691f5873c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.790890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf0916-c6aa-49ea-a1f4-b0691f5873c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.791168 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf0916-c6aa-49ea-a1f4-b0691f5873c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.791817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf0916-c6aa-49ea-a1f4-b0691f5873c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:05.793441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf0916-c6aa-49ea-a1f4-b0691f5873c2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:05.809197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 930/1886] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:05.813001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072124f-9c5a-45a7-931c-a561bc5519ea admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:05.825064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072124f-9c5a-45a7-931c-a561bc5519ea admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:05.830087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad9b6-447f-46b8-b6dc-7b75c2e675f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:05.830757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad9b6-447f-46b8-b6dc-7b75c2e675f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.831172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad9b6-447f-46b8-b6dc-7b75c2e675f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.831449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad9b6-447f-46b8-b6dc-7b75c2e675f0 admin admin] PATH_INFO: `/v3/projects/95ee730fa7de4a0e8ed3c70e96f0728c/users/61fdc4c7f8cd4bc7bd2e41d66fce6ca5/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.847887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ad9b6-447f-46b8-b6dc-7b75c2e675f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ee730fa7de4a0e8ed3c70e96f0728c, user_id=61fdc4c7f8cd4bc7bd2e41d66fce6ca5, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:05.850035 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ad9b6-447f-46b8-b6dc-7b75c2e675f0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:05.869680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 957/1887] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:05 2022] PUT /identity/v3/projects/95ee730fa7de4a0e8ed3c70e96f0728c/users/61fdc4c7f8cd4bc7bd2e41d66fce6ca5/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:05.882972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74919063-fbf4-468f-961b-f7a2318a2e9c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:05.884076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74919063-fbf4-468f-961b-f7a2318a2e9c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:05.884573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74919063-fbf4-468f-961b-f7a2318a2e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:05.921078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-74919063-fbf4-468f-961b-f7a2318a2e9c None None] MFA Rules not processed for user `61fdc4c7f8cd4bc7bd2e41d66fce6ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:05.922762 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-74919063-fbf4-468f-961b-f7a2318a2e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:06.014700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad9b6-447f-46b8-b6dc-7b75c2e675f0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.016689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a35ad9b6-447f-46b8-b6dc-7b75c2e675f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:06.029318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 931/1888] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:06.033806 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74919063-fbf4-468f-961b-f7a2318a2e9c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.118861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad9b6-447f-46b8-b6dc-7b75c2e675f0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.125715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.126398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.126676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.126947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] PATH_INFO: `/v3/projects/debce276d78a4dcda1071d44f0ce2a92` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.128071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=debce276d78a4dcda1071d44f0ce2a92)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.130028 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.149057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74919063-fbf4-468f-961b-f7a2318a2e9c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.157025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cd476-005c-437f-b7bd-7c4bd38d1f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.158468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cd476-005c-437f-b7bd-7c4bd38d1f3f admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.158906 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cd476-005c-437f-b7bd-7c4bd38d1f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.162195 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cd476-005c-437f-b7bd-7c4bd38d1f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.163295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cd476-005c-437f-b7bd-7c4bd38d1f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.166357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cd476-005c-437f-b7bd-7c4bd38d1f3f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.200685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'debce276d78a4dcda1071d44f0ce2a92', 'request_id': 'req-606df57d-321c-4e2a-b2c3-d5a3108678a3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:06.206522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 932/1889] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:06 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:06.211039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'debce276d78a4dcda1071d44f0ce2a92', 'request_id': 'req-606df57d-321c-4e2a-b2c3-d5a3108678a3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:06.212090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cd476-005c-437f-b7bd-7c4bd38d1f3f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.223255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'debce276d78a4dcda1071d44f0ce2a92', 'request_id': 'req-606df57d-321c-4e2a-b2c3-d5a3108678a3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:06.243010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] The token cache is being invalidate because project debce276d78a4dcda1071d44f0ce2a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:06.243220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:06.243848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-606df57d-321c-4e2a-b2c3-d5a3108678a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:06.250284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 958/1890] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:06 2022] DELETE /identity/v3/projects/debce276d78a4dcda1071d44f0ce2a92 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:06.252254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d829-4e66-4079-8149-77ef0fef2957 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.252533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d829-4e66-4079-8149-77ef0fef2957 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.253509 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d829-4e66-4079-8149-77ef0fef2957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.276542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:06.303858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1547d829-4e66-4079-8149-77ef0fef2957 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:06.305381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1547d829-4e66-4079-8149-77ef0fef2957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:06.327844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cd476-005c-437f-b7bd-7c4bd38d1f3f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.335391 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717e53a-abe9-4f70-9ecb-1d13de4a5947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.336027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717e53a-abe9-4f70-9ecb-1d13de4a5947 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.336310 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717e53a-abe9-4f70-9ecb-1d13de4a5947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.336594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717e53a-abe9-4f70-9ecb-1d13de4a5947 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.338261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717e53a-abe9-4f70-9ecb-1d13de4a5947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.340785 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717e53a-abe9-4f70-9ecb-1d13de4a5947 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.373995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:06.383822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 933/1891] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:06 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:11:06.390789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717e53a-abe9-4f70-9ecb-1d13de4a5947 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.393064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e717e53a-abe9-4f70-9ecb-1d13de4a5947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:06.406330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 959/1892] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:06.407444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717e53a-abe9-4f70-9ecb-1d13de4a5947 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.408500 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536bf16-9af2-4789-ab97-b4a87a95cce5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.408773 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536bf16-9af2-4789-ab97-b4a87a95cce5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.409155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536bf16-9af2-4789-ab97-b4a87a95cce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.412285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7693e00-c6dc-4ef9-9fe1-4a03279f10ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.412851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7693e00-c6dc-4ef9-9fe1-4a03279f10ab admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.413253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7693e00-c6dc-4ef9-9fe1-4a03279f10ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.413523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7693e00-c6dc-4ef9-9fe1-4a03279f10ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.414208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7693e00-c6dc-4ef9-9fe1-4a03279f10ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.415797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7693e00-c6dc-4ef9-9fe1-4a03279f10ab admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.429607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 934/1893] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:06.434489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1536bf16-9af2-4789-ab97-b4a87a95cce5 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:06.434737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7693e00-c6dc-4ef9-9fe1-4a03279f10ab admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.436355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1536bf16-9af2-4789-ab97-b4a87a95cce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:06.447579 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7693e00-c6dc-4ef9-9fe1-4a03279f10ab admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.453305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 960/1894] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:06.454559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536bf16-9af2-4789-ab97-b4a87a95cce5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.455660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c8ed8-c627-445d-bdc3-cb6820d75fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.456399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8ed8-c627-445d-bdc3-cb6820d75fda admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.456678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8ed8-c627-445d-bdc3-cb6820d75fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.456952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8ed8-c627-445d-bdc3-cb6820d75fda admin admin] PATH_INFO: `/v3/projects/df2653af0ca2479aa49e9509d6950da0/users/4ee2c0211b0845b4b0144fc7b90c98e6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.466136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536bf16-9af2-4789-ab97-b4a87a95cce5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.471605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7f2c-0e60-4698-92c6-c7ad6fff5a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.472298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7f2c-0e60-4698-92c6-c7ad6fff5a48 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.472639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7f2c-0e60-4698-92c6-c7ad6fff5a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.472972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7f2c-0e60-4698-92c6-c7ad6fff5a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.473691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c7f2c-0e60-4698-92c6-c7ad6fff5a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:06.474092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c7f2c-0e60-4698-92c6-c7ad6fff5a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.474612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c8ed8-c627-445d-bdc3-cb6820d75fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2653af0ca2479aa49e9509d6950da0, user_id=4ee2c0211b0845b4b0144fc7b90c98e6, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.475913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c7f2c-0e60-4698-92c6-c7ad6fff5a48 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.478450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c8ed8-c627-445d-bdc3-cb6820d75fda admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.494141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 961/1895] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:06.495157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7f2c-0e60-4698-92c6-c7ad6fff5a48 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.496939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 935/1896] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:06 2022] PUT /identity/v3/projects/df2653af0ca2479aa49e9509d6950da0/users/4ee2c0211b0845b4b0144fc7b90c98e6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:06.502155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c8ed8-c627-445d-bdc3-cb6820d75fda admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.505865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7f2c-0e60-4698-92c6-c7ad6fff5a48 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.574792 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ccd24-3edf-4cf3-9c5c-3df12023a379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.575559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ccd24-3edf-4cf3-9c5c-3df12023a379 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.576023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ccd24-3edf-4cf3-9c5c-3df12023a379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.576391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ccd24-3edf-4cf3-9c5c-3df12023a379 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.577415 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ccd24-3edf-4cf3-9c5c-3df12023a379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.579646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ccd24-3edf-4cf3-9c5c-3df12023a379 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.589272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c8ed8-c627-445d-bdc3-cb6820d75fda admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.596999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c712f7-1f60-4ee2-ac36-c5498fc9ab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.597685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c712f7-1f60-4ee2-ac36-c5498fc9ab9a admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.598045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c712f7-1f60-4ee2-ac36-c5498fc9ab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.598380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c712f7-1f60-4ee2-ac36-c5498fc9ab9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.599100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c712f7-1f60-4ee2-ac36-c5498fc9ab9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.601816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c712f7-1f60-4ee2-ac36-c5498fc9ab9a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.620344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 936/1897] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:06.621303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c712f7-1f60-4ee2-ac36-c5498fc9ab9a admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.622588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 962/1898] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:06 2022] POST /identity/v3/projects => generated 401 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:06.626652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ccd24-3edf-4cf3-9c5c-3df12023a379 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.637124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c712f7-1f60-4ee2-ac36-c5498fc9ab9a admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.697455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ccd24-3edf-4cf3-9c5c-3df12023a379 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.702271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69495363-671a-4f9b-9505-12025480bdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.703030 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69495363-671a-4f9b-9505-12025480bdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.703310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69495363-671a-4f9b-9505-12025480bdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.703577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69495363-671a-4f9b-9505-12025480bdd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.704315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69495363-671a-4f9b-9505-12025480bdd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.706414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69495363-671a-4f9b-9505-12025480bdd8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.735468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0e065-085d-425f-9d19-897b38a13159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.735890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e065-085d-425f-9d19-897b38a13159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.736242 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e065-085d-425f-9d19-897b38a13159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.736566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e065-085d-425f-9d19-897b38a13159 admin admin] PATH_INFO: `/v3/projects/df2653af0ca2479aa49e9509d6950da0/users/4ee2c0211b0845b4b0144fc7b90c98e6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.738012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 963/1899] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:06 2022] POST /identity/v3/users => generated 301 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:06.741017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69495363-671a-4f9b-9505-12025480bdd8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.742350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0e065-085d-425f-9d19-897b38a13159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2653af0ca2479aa49e9509d6950da0, user_id=4ee2c0211b0845b4b0144fc7b90c98e6, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.745576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0e065-085d-425f-9d19-897b38a13159 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.755576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69495363-671a-4f9b-9505-12025480bdd8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.761362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958d07b-2ad3-4d09-b23f-0751c5f4ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.762298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d07b-2ad3-4d09-b23f-0751c5f4ea87 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.762639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d07b-2ad3-4d09-b23f-0751c5f4ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.763309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d07b-2ad3-4d09-b23f-0751c5f4ea87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.764159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958d07b-2ad3-4d09-b23f-0751c5f4ea87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.766036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958d07b-2ad3-4d09-b23f-0751c5f4ea87 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.771966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 937/1900] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:06 2022] PUT /identity/v3/projects/df2653af0ca2479aa49e9509d6950da0/users/4ee2c0211b0845b4b0144fc7b90c98e6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:06.784397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 964/1901] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:06.784662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c0036-4ebd-4d21-a956-66567078160c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.785064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c0036-4ebd-4d21-a956-66567078160c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.785337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c0036-4ebd-4d21-a956-66567078160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.788698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958d07b-2ad3-4d09-b23f-0751c5f4ea87 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.805771 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958d07b-2ad3-4d09-b23f-0751c5f4ea87 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.811505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:06.825238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-451c0036-4ebd-4d21-a956-66567078160c None None] MFA Rules not processed for user `4ee2c0211b0845b4b0144fc7b90c98e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:06.826584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-451c0036-4ebd-4d21-a956-66567078160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:06.884070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:06.929341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a2298-2ccb-4cfb-a56c-bb9476cccde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.930056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a2298-2ccb-4cfb-a56c-bb9476cccde1 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.930478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a2298-2ccb-4cfb-a56c-bb9476cccde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.930750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a2298-2ccb-4cfb-a56c-bb9476cccde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.931397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a2298-2ccb-4cfb-a56c-bb9476cccde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:06.934016 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a2298-2ccb-4cfb-a56c-bb9476cccde1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:06.951550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 965/1902] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:06.952772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a2298-2ccb-4cfb-a56c-bb9476cccde1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:06.969717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a2298-2ccb-4cfb-a56c-bb9476cccde1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:06.984857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f148e-b02b-49e8-968e-6a38c3364e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:06.987340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f148e-b02b-49e8-968e-6a38c3364e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:06.987340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f148e-b02b-49e8-968e-6a38c3364e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:06.987340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f148e-b02b-49e8-968e-6a38c3364e50 admin admin] PATH_INFO: `/v3/projects/2838efa993b74166a1164e7469e9fe87/users/5ff184c6214540fda64003fbfed594f2/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:06.991684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 938/1903] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:07.009059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c0036-4ebd-4d21-a956-66567078160c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:07.011777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-451c0036-4ebd-4d21-a956-66567078160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:07.037535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f148e-b02b-49e8-968e-6a38c3364e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2838efa993b74166a1164e7469e9fe87, user_id=5ff184c6214540fda64003fbfed594f2, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:07.043140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f148e-b02b-49e8-968e-6a38c3364e50 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:07.077559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 966/1904] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:06 2022] PUT /identity/v3/projects/2838efa993b74166a1164e7469e9fe87/users/5ff184c6214540fda64003fbfed594f2/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:07.079447 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde5910-ac3c-4bbe-bcab-8b4a343229b6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:07.079853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde5910-ac3c-4bbe-bcab-8b4a343229b6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:07.080072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde5910-ac3c-4bbe-bcab-8b4a343229b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:07.142874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bfde5910-ac3c-4bbe-bcab-8b4a343229b6 None None] MFA Rules not processed for user `5ff184c6214540fda64003fbfed594f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:07.144200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bfde5910-ac3c-4bbe-bcab-8b4a343229b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:07.148400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c0036-4ebd-4d21-a956-66567078160c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:07.237809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10b3a2-0a72-4387-ad9c-0816adcf2140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:07.239189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10b3a2-0a72-4387-ad9c-0816adcf2140 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:07.239189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10b3a2-0a72-4387-ad9c-0816adcf2140 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:07.239586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10b3a2-0a72-4387-ad9c-0816adcf2140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:07.261958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 967/1905] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:07 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:07.267941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde5910-ac3c-4bbe-bcab-8b4a343229b6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:07.336400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10b3a2-0a72-4387-ad9c-0816adcf2140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:07.354768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10b3a2-0a72-4387-ad9c-0816adcf2140 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:07.380583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 939/1906] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:07.382591 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde5910-ac3c-4bbe-bcab-8b4a343229b6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:07.396806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c5673-566e-40d1-bbed-6e85a1697b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:07.397719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c5673-566e-40d1-bbed-6e85a1697b9b admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:07.398046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c5673-566e-40d1-bbed-6e85a1697b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:07.398314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c5673-566e-40d1-bbed-6e85a1697b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:07.399073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c5673-566e-40d1-bbed-6e85a1697b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:07.401872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c5673-566e-40d1-bbed-6e85a1697b9b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:07.475397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 968/1907] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:07 2022] POST /identity/v3/projects => generated 401 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:07.480100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10b3a2-0a72-4387-ad9c-0816adcf2140 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:07.486699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:07.496424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10b3a2-0a72-4387-ad9c-0816adcf2140 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:07.518972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c5673-566e-40d1-bbed-6e85a1697b9b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:07.562961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:07.591276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658d2c2-36cd-4ab7-b58f-7d7fe2f29967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:07.591897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658d2c2-36cd-4ab7-b58f-7d7fe2f29967 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:07.592174 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658d2c2-36cd-4ab7-b58f-7d7fe2f29967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:07.592448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658d2c2-36cd-4ab7-b58f-7d7fe2f29967 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:07.593139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658d2c2-36cd-4ab7-b58f-7d7fe2f29967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:07.595083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658d2c2-36cd-4ab7-b58f-7d7fe2f29967 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:07.617369 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c5673-566e-40d1-bbed-6e85a1697b9b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:07.620655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 940/1908] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:07 2022] POST /identity/v3/users => generated 307 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:11:07.621516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49660e7b-d8c6-4f9b-95aa-f4ee07448b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:07.622172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49660e7b-d8c6-4f9b-95aa-f4ee07448b27 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:07.622455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49660e7b-d8c6-4f9b-95aa-f4ee07448b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:07.622729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49660e7b-d8c6-4f9b-95aa-f4ee07448b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:07.624100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658d2c2-36cd-4ab7-b58f-7d7fe2f29967 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:07.625914 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-49660e7b-d8c6-4f9b-95aa-f4ee07448b27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:07.634916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658d2c2-36cd-4ab7-b58f-7d7fe2f29967 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:07.640800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29517895-77d4-400c-9e7b-ccf803b86393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:07.641738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29517895-77d4-400c-9e7b-ccf803b86393 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:07.642150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29517895-77d4-400c-9e7b-ccf803b86393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:07.642519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29517895-77d4-400c-9e7b-ccf803b86393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:07.643266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29517895-77d4-400c-9e7b-ccf803b86393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:07.644959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29517895-77d4-400c-9e7b-ccf803b86393 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:07.658039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 941/1909] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:07.662082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29517895-77d4-400c-9e7b-ccf803b86393 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:07.672562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29517895-77d4-400c-9e7b-ccf803b86393 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:07.677418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48c335-1c87-4215-a705-45dd2cbad518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:07.678294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48c335-1c87-4215-a705-45dd2cbad518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:07.678704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48c335-1c87-4215-a705-45dd2cbad518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:07.679044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48c335-1c87-4215-a705-45dd2cbad518 admin admin] PATH_INFO: `/v3/projects/5e21388a21924c95a985b371df60c314/users/9206fc956391449b86985cdb5a3f17f5/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:07.698495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48c335-1c87-4215-a705-45dd2cbad518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e21388a21924c95a985b371df60c314, user_id=9206fc956391449b86985cdb5a3f17f5, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:07.699008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49660e7b-d8c6-4f9b-95aa-f4ee07448b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:07.700507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49660e7b-d8c6-4f9b-95aa-f4ee07448b27 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:07.701271 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48c335-1c87-4215-a705-45dd2cbad518 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:07.711680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 969/1910] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:11:07.732838 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 942/1911] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:07 2022] PUT /identity/v3/projects/5e21388a21924c95a985b371df60c314/users/9206fc956391449b86985cdb5a3f17f5/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:07.736713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49660e7b-d8c6-4f9b-95aa-f4ee07448b27 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:07.749537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49660e7b-d8c6-4f9b-95aa-f4ee07448b27 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:07.821098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17e129-00d0-43c3-84ff-16047d8dbf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:07.821703 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e129-00d0-43c3-84ff-16047d8dbf1a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:07.822358 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e129-00d0-43c3-84ff-16047d8dbf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:07.822358 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e129-00d0-43c3-84ff-16047d8dbf1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:07.824468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17e129-00d0-43c3-84ff-16047d8dbf1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:07.824816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17e129-00d0-43c3-84ff-16047d8dbf1a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:07.837166 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 970/1912] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:07.843991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48c335-1c87-4215-a705-45dd2cbad518 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:07.855122 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48c335-1c87-4215-a705-45dd2cbad518 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:07.861302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a989bd-b6f9-4092-8e87-9017088251ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:07.861302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a989bd-b6f9-4092-8e87-9017088251ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:07.861535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a989bd-b6f9-4092-8e87-9017088251ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:07.861872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a989bd-b6f9-4092-8e87-9017088251ae admin admin] PATH_INFO: `/v3/projects/5e21388a21924c95a985b371df60c314/users/9206fc956391449b86985cdb5a3f17f5/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:07.864943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a989bd-b6f9-4092-8e87-9017088251ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e21388a21924c95a985b371df60c314, user_id=9206fc956391449b86985cdb5a3f17f5, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:07.868013 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a989bd-b6f9-4092-8e87-9017088251ae admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:07.883693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 943/1913] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:07 2022] PUT /identity/v3/projects/5e21388a21924c95a985b371df60c314/users/9206fc956391449b86985cdb5a3f17f5/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:07.894941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7259-cf3c-4941-9def-2a8265406ca7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:07.895229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7259-cf3c-4941-9def-2a8265406ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:07.895562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7259-cf3c-4941-9def-2a8265406ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:07.935258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7d6b7259-cf3c-4941-9def-2a8265406ca7 None None] MFA Rules not processed for user `9206fc956391449b86985cdb5a3f17f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:07.936514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7d6b7259-cf3c-4941-9def-2a8265406ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:08.023506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:08.043049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 971/1914] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:07 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:08.059237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a989bd-b6f9-4092-8e87-9017088251ae admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:08.062151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-10a989bd-b6f9-4092-8e87-9017088251ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:08.139771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a989bd-b6f9-4092-8e87-9017088251ae admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:08.146128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c789857-3704-44bf-a714-040476eb8196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:08.147297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789857-3704-44bf-a714-040476eb8196 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:08.147766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789857-3704-44bf-a714-040476eb8196 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:08.148192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789857-3704-44bf-a714-040476eb8196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:08.168947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c789857-3704-44bf-a714-040476eb8196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:08.170646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c789857-3704-44bf-a714-040476eb8196 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:08.185043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b7259-cf3c-4941-9def-2a8265406ca7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:08.197190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 944/1915] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:08 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:08.333417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c789857-3704-44bf-a714-040476eb8196 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:08.341972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c789857-3704-44bf-a714-040476eb8196 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:08.345421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b7259-cf3c-4941-9def-2a8265406ca7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:08.350158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15e959-bb0a-4d40-8a8a-c7278cebd8fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:08.351114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15e959-bb0a-4d40-8a8a-c7278cebd8fd service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:08.351243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:08.351391 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15e959-bb0a-4d40-8a8a-c7278cebd8fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:08.351657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15e959-bb0a-4d40-8a8a-c7278cebd8fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:08.351887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:08.352164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:08.352767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] PATH_INFO: `/v3/users/61fdc4c7f8cd4bc7bd2e41d66fce6ca5` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:08.357605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fdc4c7f8cd4bc7bd2e41d66fce6ca5)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:08.360349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:08.423748 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:08.470318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fdc4c7f8cd4bc7bd2e41d66fce6ca5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:08.477078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15e959-bb0a-4d40-8a8a-c7278cebd8fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:08.480053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15e959-bb0a-4d40-8a8a-c7278cebd8fd service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:08.497817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fdc4c7f8cd4bc7bd2e41d66fce6ca5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:08.499105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fdc4c7f8cd4bc7bd2e41d66fce6ca5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:08.507061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 945/1916] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:08 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:11:08.524239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fdc4c7f8cd4bc7bd2e41d66fce6ca5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:08.555833 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fdc4c7f8cd4bc7bd2e41d66fce6ca5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:08.569148 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 972/1917] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:08 2022] DELETE /identity/v3/users/61fdc4c7f8cd4bc7bd2e41d66fce6ca5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:08.574312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c6226-10c6-4a9c-8ca0-470ee088a248 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:08.575533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c6226-10c6-4a9c-8ca0-470ee088a248 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:08.575967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c6226-10c6-4a9c-8ca0-470ee088a248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:08.673987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-935c6226-10c6-4a9c-8ca0-470ee088a248 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:08.675846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-935c6226-10c6-4a9c-8ca0-470ee088a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:08.865553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 946/1918] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:08.866382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:08.868138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:08.961424 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e741b-a67f-4209-96b6-755c7c7590a7 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:08.966121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb7f5a-19e9-46f5-b609-40ebb3e15ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:08.967293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7f5a-19e9-46f5-b609-40ebb3e15ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:08.967670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7f5a-19e9-46f5-b609-40ebb3e15ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:08.969447 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7f5a-19e9-46f5-b609-40ebb3e15ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:08.981497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb7f5a-19e9-46f5-b609-40ebb3e15ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:08.983109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb7f5a-19e9-46f5-b609-40ebb3e15ba6 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:08.997801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 973/1919] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:11:09.304776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c6226-10c6-4a9c-8ca0-470ee088a248 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:09.306465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-935c6226-10c6-4a9c-8ca0-470ee088a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:09.319812 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c6226-10c6-4a9c-8ca0-470ee088a248 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:09.324674 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:09.325319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:09.325798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:09.326105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] PATH_INFO: `/v3/projects/95ee730fa7de4a0e8ed3c70e96f0728c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:09.327233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ee730fa7de4a0e8ed3c70e96f0728c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:09.329280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:09.389541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ee730fa7de4a0e8ed3c70e96f0728c', 'request_id': 'req-d3e684d3-308f-4499-8b9a-9d7e1fe85163'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:09.404370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ee730fa7de4a0e8ed3c70e96f0728c', 'request_id': 'req-d3e684d3-308f-4499-8b9a-9d7e1fe85163'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:09.422336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ee730fa7de4a0e8ed3c70e96f0728c', 'request_id': 'req-d3e684d3-308f-4499-8b9a-9d7e1fe85163'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:09.437985 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] The token cache is being invalidate because project 95ee730fa7de4a0e8ed3c70e96f0728c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:09.438390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:09.439124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:09.440838 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 947/1920] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:09 2022] DELETE /identity/v3/projects/95ee730fa7de4a0e8ed3c70e96f0728c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:09.445305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb7f5a-19e9-46f5-b609-40ebb3e15ba6 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:09.455485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb7f5a-19e9-46f5-b609-40ebb3e15ba6 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:09.467313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:09.517532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd46f6-9d9e-4ec1-a49b-e3788150dbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:09.518217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd46f6-9d9e-4ec1-a49b-e3788150dbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:09.518497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd46f6-9d9e-4ec1-a49b-e3788150dbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:09.518769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd46f6-9d9e-4ec1-a49b-e3788150dbe2 admin admin] PATH_INFO: `/v3/users/4ee2c0211b0845b4b0144fc7b90c98e6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:09.519952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd46f6-9d9e-4ec1-a49b-e3788150dbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee2c0211b0845b4b0144fc7b90c98e6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:09.522023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd46f6-9d9e-4ec1-a49b-e3788150dbe2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:09.576145 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-dcbd46f6-9d9e-4ec1-a49b-e3788150dbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee2c0211b0845b4b0144fc7b90c98e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:09.585090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-dcbd46f6-9d9e-4ec1-a49b-e3788150dbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee2c0211b0845b4b0144fc7b90c98e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:09.585692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-dcbd46f6-9d9e-4ec1-a49b-e3788150dbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee2c0211b0845b4b0144fc7b90c98e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:09.592847 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-dcbd46f6-9d9e-4ec1-a49b-e3788150dbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee2c0211b0845b4b0144fc7b90c98e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:09.606169 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-dcbd46f6-9d9e-4ec1-a49b-e3788150dbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee2c0211b0845b4b0144fc7b90c98e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:09.612243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 974/1921] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:09 2022] DELETE /identity/v3/users/4ee2c0211b0845b4b0144fc7b90c98e6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:09.904455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:09.906049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:09.922481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e684d3-308f-4499-8b9a-9d7e1fe85163 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:09.997602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:09.998293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:09.998588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:09.998878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] PATH_INFO: `/v3/projects/df2653af0ca2479aa49e9509d6950da0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:10.000093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] RBAC: Authorizing `identity:delete_project(project_id=df2653af0ca2479aa49e9509d6950da0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:10.002037 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:10.013252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:10.060740 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df2653af0ca2479aa49e9509d6950da0', 'request_id': 'req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:10.070700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df2653af0ca2479aa49e9509d6950da0', 'request_id': 'req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:10.081899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df2653af0ca2479aa49e9509d6950da0', 'request_id': 'req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:10.094994 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] The token cache is being invalidate because project df2653af0ca2479aa49e9509d6950da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:10.095452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:10.096093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cb80e34b-dc0d-4c8f-9b4b-c3c528a6593b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:10.097580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 948/1922] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:09 2022] DELETE /identity/v3/projects/df2653af0ca2479aa49e9509d6950da0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:10.103874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18820113-0f9d-4624-b831-2a045a829d48 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:10.104157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18820113-0f9d-4624-b831-2a045a829d48 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:10.104429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18820113-0f9d-4624-b831-2a045a829d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:10.135878 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-18820113-0f9d-4624-b831-2a045a829d48 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:10.137145 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-18820113-0f9d-4624-b831-2a045a829d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:10.230388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 975/1923] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:10.237968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7338620-7731-4db9-ab7e-433248f5df20 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:10.238737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7338620-7731-4db9-ab7e-433248f5df20 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:10.238737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7338620-7731-4db9-ab7e-433248f5df20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:10.275160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a7338620-7731-4db9-ab7e-433248f5df20 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:10.277916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a7338620-7731-4db9-ab7e-433248f5df20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:10.293566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 949/1924] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:10.294928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18820113-0f9d-4624-b831-2a045a829d48 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:10.309938 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18820113-0f9d-4624-b831-2a045a829d48 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:10.318103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b807-38eb-4cb9-8c68-19f04c87cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:10.318844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b807-38eb-4cb9-8c68-19f04c87cea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:10.319136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b807-38eb-4cb9-8c68-19f04c87cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:10.320387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b807-38eb-4cb9-8c68-19f04c87cea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:10.321210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389b807-38eb-4cb9-8c68-19f04c87cea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:10.322064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389b807-38eb-4cb9-8c68-19f04c87cea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:10.346808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389b807-38eb-4cb9-8c68-19f04c87cea6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:10.387851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 976/1925] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:10.392339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7338620-7731-4db9-ab7e-433248f5df20 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:10.406645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7338620-7731-4db9-ab7e-433248f5df20 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:10.414592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2afbbb-e29e-4d9f-9392-a2731bad8417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:10.415257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2afbbb-e29e-4d9f-9392-a2731bad8417 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:10.415715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2afbbb-e29e-4d9f-9392-a2731bad8417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:10.415990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2afbbb-e29e-4d9f-9392-a2731bad8417 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:10.438524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2afbbb-e29e-4d9f-9392-a2731bad8417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:10.446178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2afbbb-e29e-4d9f-9392-a2731bad8417 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:10.508534 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 950/1926] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:10 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:10.513250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b807-38eb-4cb9-8c68-19f04c87cea6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:10.529432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b807-38eb-4cb9-8c68-19f04c87cea6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:10.613212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:10.687759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007298d-0b77-4fc5-9ebf-3232f972f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:10.688612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007298d-0b77-4fc5-9ebf-3232f972f3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:10.688894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007298d-0b77-4fc5-9ebf-3232f972f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:10.689455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007298d-0b77-4fc5-9ebf-3232f972f3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:10.690301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007298d-0b77-4fc5-9ebf-3232f972f3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:10.692356 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007298d-0b77-4fc5-9ebf-3232f972f3c8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:10.721131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 977/1927] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:10 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:10.726766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2afbbb-e29e-4d9f-9392-a2731bad8417 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:10.738625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2afbbb-e29e-4d9f-9392-a2731bad8417 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:10.745477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d0030-f370-4081-be5b-127a33de1afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:10.746162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d0030-f370-4081-be5b-127a33de1afc admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:10.746617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d0030-f370-4081-be5b-127a33de1afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:10.746874 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d0030-f370-4081-be5b-127a33de1afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:10.747520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d0030-f370-4081-be5b-127a33de1afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:10.749165 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d0030-f370-4081-be5b-127a33de1afc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:10.760336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 951/1928] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:10.765031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007298d-0b77-4fc5-9ebf-3232f972f3c8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:10.777814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007298d-0b77-4fc5-9ebf-3232f972f3c8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:10.792474 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810ef94-32d3-4c7f-8009-a91e3fdc1624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:10.793334 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810ef94-32d3-4c7f-8009-a91e3fdc1624 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:10.793656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810ef94-32d3-4c7f-8009-a91e3fdc1624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:10.794116 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810ef94-32d3-4c7f-8009-a91e3fdc1624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:10.794786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810ef94-32d3-4c7f-8009-a91e3fdc1624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:10.797133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810ef94-32d3-4c7f-8009-a91e3fdc1624 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:10.822240 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 978/1929] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:10.826835 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d0030-f370-4081-be5b-127a33de1afc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:10.840798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d0030-f370-4081-be5b-127a33de1afc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:10.848059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1dff3-a8c4-4448-a2fc-7937406bf896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:10.848059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1dff3-a8c4-4448-a2fc-7937406bf896 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:10.848347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1dff3-a8c4-4448-a2fc-7937406bf896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:10.848507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1dff3-a8c4-4448-a2fc-7937406bf896 admin admin] PATH_INFO: `/v3/projects/4ba20cb6492549019f53af8799e47784/users/2581141af0924dc9b2c8390dce2f8b80/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:10.872065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1dff3-a8c4-4448-a2fc-7937406bf896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba20cb6492549019f53af8799e47784, user_id=2581141af0924dc9b2c8390dce2f8b80, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:10.875623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1dff3-a8c4-4448-a2fc-7937406bf896 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:10.907502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 952/1930] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:10 2022] PUT /identity/v3/projects/4ba20cb6492549019f53af8799e47784/users/2581141af0924dc9b2c8390dce2f8b80/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:10.919622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f85ea-5f36-415f-9d40-f6e0767d10ed None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:10.920204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f85ea-5f36-415f-9d40-f6e0767d10ed None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:10.920778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f85ea-5f36-415f-9d40-f6e0767d10ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:10.965124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b51f85ea-5f36-415f-9d40-f6e0767d10ed None None] MFA Rules not processed for user `2581141af0924dc9b2c8390dce2f8b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:10.966681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b51f85ea-5f36-415f-9d40-f6e0767d10ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:11.036341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 979/1931] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:11.049766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1dff3-a8c4-4448-a2fc-7937406bf896 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:11.051759 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eca1dff3-a8c4-4448-a2fc-7937406bf896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:11.155681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1dff3-a8c4-4448-a2fc-7937406bf896 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:11.159888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fafd2a-e316-4237-b1a9-38a1fc4ed5d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22e60fc95af4a0a94b15f9ed9e3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:11.160520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fafd2a-e316-4237-b1a9-38a1fc4ed5d7 service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:11.160773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fafd2a-e316-4237-b1a9-38a1fc4ed5d7 service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:11.161035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fafd2a-e316-4237-b1a9-38a1fc4ed5d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:11.170437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fafd2a-e316-4237-b1a9-38a1fc4ed5d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:11.172038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fafd2a-e316-4237-b1a9-38a1fc4ed5d7 service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:11.181426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 953/1932] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:13.436555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f85ea-5f36-415f-9d40-f6e0767d10ed None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:13.438162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b51f85ea-5f36-415f-9d40-f6e0767d10ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:13.602960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f85ea-5f36-415f-9d40-f6e0767d10ed None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:13.610573 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:13.611426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:13.611829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:13.612163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] PATH_INFO: `/v3/users/5ff184c6214540fda64003fbfed594f2` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:13.613557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ff184c6214540fda64003fbfed594f2)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:13.616526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:13.667821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:13.690124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ff184c6214540fda64003fbfed594f2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:13.707923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ff184c6214540fda64003fbfed594f2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:13.709080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ff184c6214540fda64003fbfed594f2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:13.734364 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ff184c6214540fda64003fbfed594f2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:13.750916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ff184c6214540fda64003fbfed594f2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:13.761873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 980/1933] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:13 2022] DELETE /identity/v3/users/5ff184c6214540fda64003fbfed594f2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:13.764640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce360-f469-4732-9338-1faad049370e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:13.765183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce360-f469-4732-9338-1faad049370e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:13.765183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce360-f469-4732-9338-1faad049370e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:13.788126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b91ce360-f469-4732-9338-1faad049370e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:13.789417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b91ce360-f469-4732-9338-1faad049370e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:13.803543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:13.881043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 954/1934] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:13.911362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:13.913857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:14.020209 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807f6e-6ad4-46b3-a495-efe6add0a670 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:14.024075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adec88-0cb5-4239-b187-5f2b089c132d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:14.024818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adec88-0cb5-4239-b187-5f2b089c132d service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:14.025098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adec88-0cb5-4239-b187-5f2b089c132d service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:14.025370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adec88-0cb5-4239-b187-5f2b089c132d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:14.046800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adec88-0cb5-4239-b187-5f2b089c132d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:14.048368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adec88-0cb5-4239-b187-5f2b089c132d service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:14.060043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 981/1935] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:11:14.391501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ce360-f469-4732-9338-1faad049370e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:14.392986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b91ce360-f469-4732-9338-1faad049370e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:14.416609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ce360-f469-4732-9338-1faad049370e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:14.421594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:14.423229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:14.423537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:14.423792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] PATH_INFO: `/v3/projects/2838efa993b74166a1164e7469e9fe87` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:14.425248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2838efa993b74166a1164e7469e9fe87)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:14.429151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:14.513259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2838efa993b74166a1164e7469e9fe87', 'request_id': 'req-7ea40308-5d4a-4709-91a6-c7ab0bc82463'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:14.525456 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2838efa993b74166a1164e7469e9fe87', 'request_id': 'req-7ea40308-5d4a-4709-91a6-c7ab0bc82463'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:14.544732 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2838efa993b74166a1164e7469e9fe87', 'request_id': 'req-7ea40308-5d4a-4709-91a6-c7ab0bc82463'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:14.564016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] The token cache is being invalidate because project 2838efa993b74166a1164e7469e9fe87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:14.564738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:14.565935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:14.573152 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 955/1936] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:14 2022] DELETE /identity/v3/projects/2838efa993b74166a1164e7469e9fe87 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:14.574210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adec88-0cb5-4239-b187-5f2b089c132d service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:14.602362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adec88-0cb5-4239-b187-5f2b089c132d service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:14.766022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e0064-1094-4e4e-8322-6e7810117147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:14.766683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0064-1094-4e4e-8322-6e7810117147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:14.767099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0064-1094-4e4e-8322-6e7810117147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:14.767752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0064-1094-4e4e-8322-6e7810117147 admin admin] PATH_INFO: `/v3/users/9206fc956391449b86985cdb5a3f17f5` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:14.768581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e0064-1094-4e4e-8322-6e7810117147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9206fc956391449b86985cdb5a3f17f5)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:14.772119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e0064-1094-4e4e-8322-6e7810117147 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:14.850684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4f1e0064-1094-4e4e-8322-6e7810117147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9206fc956391449b86985cdb5a3f17f5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:14.861662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4f1e0064-1094-4e4e-8322-6e7810117147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9206fc956391449b86985cdb5a3f17f5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:14.862720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4f1e0064-1094-4e4e-8322-6e7810117147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9206fc956391449b86985cdb5a3f17f5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:14.864654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:14.874806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4f1e0064-1094-4e4e-8322-6e7810117147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9206fc956391449b86985cdb5a3f17f5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:14.893003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4f1e0064-1094-4e4e-8322-6e7810117147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9206fc956391449b86985cdb5a3f17f5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:14.900014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 982/1937] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:14 2022] DELETE /identity/v3/users/9206fc956391449b86985cdb5a3f17f5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:15.304886 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:15.307236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:15.328432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40308-5d4a-4709-91a6-c7ab0bc82463 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:15.401924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:15.402692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:15.402965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:15.403333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] PATH_INFO: `/v3/projects/5e21388a21924c95a985b371df60c314` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:15.404585 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e21388a21924c95a985b371df60c314)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:15.406774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:15.473734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:15.480223 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e21388a21924c95a985b371df60c314', 'request_id': 'req-faa3c111-e06b-4bae-8ed6-b804a28cea67'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:15.487225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e21388a21924c95a985b371df60c314', 'request_id': 'req-faa3c111-e06b-4bae-8ed6-b804a28cea67'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:15.498696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e21388a21924c95a985b371df60c314', 'request_id': 'req-faa3c111-e06b-4bae-8ed6-b804a28cea67'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:15.512739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] The token cache is being invalidate because project 5e21388a21924c95a985b371df60c314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:15.513073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:15.513933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-faa3c111-e06b-4bae-8ed6-b804a28cea67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:15.515442 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 956/1938] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:15 2022] DELETE /identity/v3/projects/5e21388a21924c95a985b371df60c314 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:15.520638 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04be01-e0cf-42bf-bed9-2779070a7c27 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:15.520927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04be01-e0cf-42bf-bed9-2779070a7c27 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:15.521241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04be01-e0cf-42bf-bed9-2779070a7c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:15.541638 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5a04be01-e0cf-42bf-bed9-2779070a7c27 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:15.542968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5a04be01-e0cf-42bf-bed9-2779070a7c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:15.618554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 983/1939] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:15.627151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9d8d-e67a-4804-b52d-79c18d73aeeb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:15.627520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9d8d-e67a-4804-b52d-79c18d73aeeb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:15.627887 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9d8d-e67a-4804-b52d-79c18d73aeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:15.653474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-474a9d8d-e67a-4804-b52d-79c18d73aeeb None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:15.655037 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-474a9d8d-e67a-4804-b52d-79c18d73aeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:15.673676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 957/1940] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:15.678018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04be01-e0cf-42bf-bed9-2779070a7c27 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:15.687829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04be01-e0cf-42bf-bed9-2779070a7c27 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:15.692692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b677e5-4213-4b71-a247-3c77af01a715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:15.693447 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b677e5-4213-4b71-a247-3c77af01a715 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:15.693717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b677e5-4213-4b71-a247-3c77af01a715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:15.694250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b677e5-4213-4b71-a247-3c77af01a715 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:15.695218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b677e5-4213-4b71-a247-3c77af01a715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:15.695612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b677e5-4213-4b71-a247-3c77af01a715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:15.697287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b677e5-4213-4b71-a247-3c77af01a715 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:15.721739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 984/1941] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:11:15.726528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9d8d-e67a-4804-b52d-79c18d73aeeb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:15.737258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9d8d-e67a-4804-b52d-79c18d73aeeb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:15.742939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d5961-b5b0-4210-9483-faeb06896de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:15.743564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d5961-b5b0-4210-9483-faeb06896de7 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:15.743842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d5961-b5b0-4210-9483-faeb06896de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:15.744110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d5961-b5b0-4210-9483-faeb06896de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:15.744758 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d5961-b5b0-4210-9483-faeb06896de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:15.746714 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d5961-b5b0-4210-9483-faeb06896de7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:15.787825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 958/1942] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:15 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:15.792665 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b677e5-4213-4b71-a247-3c77af01a715 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:15.806523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b677e5-4213-4b71-a247-3c77af01a715 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:15.873776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83d068-e045-43d2-89ef-57911afb5113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:15.874805 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83d068-e045-43d2-89ef-57911afb5113 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:15.875253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83d068-e045-43d2-89ef-57911afb5113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:15.875708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83d068-e045-43d2-89ef-57911afb5113 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:15.876506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83d068-e045-43d2-89ef-57911afb5113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:15.878893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83d068-e045-43d2-89ef-57911afb5113 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:15.920675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 985/1943] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:15 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:15.924935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d5961-b5b0-4210-9483-faeb06896de7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:15.937472 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d5961-b5b0-4210-9483-faeb06896de7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:15.945073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af23776-3cbb-4185-bd1c-22f5de6a0812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:15.946076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af23776-3cbb-4185-bd1c-22f5de6a0812 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:15.946076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af23776-3cbb-4185-bd1c-22f5de6a0812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:15.946270 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af23776-3cbb-4185-bd1c-22f5de6a0812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:15.946933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af23776-3cbb-4185-bd1c-22f5de6a0812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:15.953795 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af23776-3cbb-4185-bd1c-22f5de6a0812 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:15.971548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 959/1944] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:15.975743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83d068-e045-43d2-89ef-57911afb5113 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:15.990136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83d068-e045-43d2-89ef-57911afb5113 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:16.011778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e16251-b92e-428a-ad58-60791878eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:16.012436 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e16251-b92e-428a-ad58-60791878eed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:16.013530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e16251-b92e-428a-ad58-60791878eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:16.013828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e16251-b92e-428a-ad58-60791878eed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:16.014612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e16251-b92e-428a-ad58-60791878eed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:16.016246 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e16251-b92e-428a-ad58-60791878eed7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:16.033709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 986/1945] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:16.038818 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af23776-3cbb-4185-bd1c-22f5de6a0812 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:16.052497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af23776-3cbb-4185-bd1c-22f5de6a0812 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:16.058955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45106691-5735-4e78-a70c-5c59024c3d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:16.060789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45106691-5735-4e78-a70c-5c59024c3d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:16.060789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45106691-5735-4e78-a70c-5c59024c3d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:16.061363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45106691-5735-4e78-a70c-5c59024c3d21 admin admin] PATH_INFO: `/v3/projects/1b2da96828da4a2d8763d3663bf9cb28/users/52492e54dd2c43d3838340ab73cb96ca/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:16.082849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45106691-5735-4e78-a70c-5c59024c3d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2da96828da4a2d8763d3663bf9cb28, user_id=52492e54dd2c43d3838340ab73cb96ca, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:16.086086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45106691-5735-4e78-a70c-5c59024c3d21 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:16.109053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 960/1946] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:16 2022] PUT /identity/v3/projects/1b2da96828da4a2d8763d3663bf9cb28/users/52492e54dd2c43d3838340ab73cb96ca/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:16.122311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237a52f-3dec-4f3e-b82f-37f30d9051f3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:16.122617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237a52f-3dec-4f3e-b82f-37f30d9051f3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:16.123152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237a52f-3dec-4f3e-b82f-37f30d9051f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:16.159724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a237a52f-3dec-4f3e-b82f-37f30d9051f3 None None] MFA Rules not processed for user `52492e54dd2c43d3838340ab73cb96ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:16.160960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a237a52f-3dec-4f3e-b82f-37f30d9051f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:16.210000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:16.301586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 987/1947] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:16.317074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45106691-5735-4e78-a70c-5c59024c3d21 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:16.319235 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-45106691-5735-4e78-a70c-5c59024c3d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:16.406271 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45106691-5735-4e78-a70c-5c59024c3d21 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:16.410178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833666a2-af79-4364-b1df-ef21bd6adb78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:16.410797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833666a2-af79-4364-b1df-ef21bd6adb78 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:16.411141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833666a2-af79-4364-b1df-ef21bd6adb78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:16.411417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833666a2-af79-4364-b1df-ef21bd6adb78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:16.429602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833666a2-af79-4364-b1df-ef21bd6adb78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:16.431172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833666a2-af79-4364-b1df-ef21bd6adb78 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:16.456312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 961/1948] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:17.986174 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237a52f-3dec-4f3e-b82f-37f30d9051f3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:17.999001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a237a52f-3dec-4f3e-b82f-37f30d9051f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:18.011908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237a52f-3dec-4f3e-b82f-37f30d9051f3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:18.015681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f2a0e-9f6f-4778-95f1-10a32d6caf43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:18.016296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2a0e-9f6f-4778-95f1-10a32d6caf43 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:18.016819 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2a0e-9f6f-4778-95f1-10a32d6caf43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:18.017196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2a0e-9f6f-4778-95f1-10a32d6caf43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:18.019007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ae0f2a0e-9f6f-4778-95f1-10a32d6caf43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:18.101415 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f2a0e-9f6f-4778-95f1-10a32d6caf43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:18.103403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f2a0e-9f6f-4778-95f1-10a32d6caf43 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:18.113191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 988/1949] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:19.943328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833666a2-af79-4364-b1df-ef21bd6adb78 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:19.945581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-833666a2-af79-4364-b1df-ef21bd6adb78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:20.073957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833666a2-af79-4364-b1df-ef21bd6adb78 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:20.080330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:20.081257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:20.081388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:20.081692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] PATH_INFO: `/v3/users/f16ce9ab4cff40b986277044b65ef478` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:20.082850 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16ce9ab4cff40b986277044b65ef478)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:20.085321 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:20.123531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:20.165689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16ce9ab4cff40b986277044b65ef478'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:20.166393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16ce9ab4cff40b986277044b65ef478'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:20.179085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16ce9ab4cff40b986277044b65ef478'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:20.191822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16ce9ab4cff40b986277044b65ef478'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:20.193202 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16ce9ab4cff40b986277044b65ef478'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:20.219518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 962/1950] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:19 2022] DELETE /identity/v3/users/f16ce9ab4cff40b986277044b65ef478 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:20.224622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0f4fd-ac86-4998-ae86-194317cb0f98 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:20.225621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0f4fd-ac86-4998-ae86-194317cb0f98 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:20.225621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0f4fd-ac86-4998-ae86-194317cb0f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:20.250825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7dd0f4fd-ac86-4998-ae86-194317cb0f98 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:20.252035 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7dd0f4fd-ac86-4998-ae86-194317cb0f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:20.316646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 989/1951] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:20.327763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:20.329187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:20.392152 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c661c6e-8d4d-4533-8af4-0c6595c23102 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:20.398118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686be5ab-1bf9-427a-8ff4-f24735ee8be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:20.398771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686be5ab-1bf9-427a-8ff4-f24735ee8be4 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:20.399053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686be5ab-1bf9-427a-8ff4-f24735ee8be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:20.399320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686be5ab-1bf9-427a-8ff4-f24735ee8be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:20.409232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686be5ab-1bf9-427a-8ff4-f24735ee8be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:20.410715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686be5ab-1bf9-427a-8ff4-f24735ee8be4 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:20.421342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 963/1952] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:20.742075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0f4fd-ac86-4998-ae86-194317cb0f98 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:20.746138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7dd0f4fd-ac86-4998-ae86-194317cb0f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:20.776702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0f4fd-ac86-4998-ae86-194317cb0f98 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:20.788478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:20.789777 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:20.790402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:20.791115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] PATH_INFO: `/v3/projects/d918075b5db047418857958b26eb448a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:20.792751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d918075b5db047418857958b26eb448a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:20.795095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:20.850263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd918075b5db047418857958b26eb448a', 'request_id': 'req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:20.859996 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd918075b5db047418857958b26eb448a', 'request_id': 'req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:20.861705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:20.867855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd918075b5db047418857958b26eb448a', 'request_id': 'req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:20.881974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] The token cache is being invalidate because project d918075b5db047418857958b26eb448a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:20.882344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:20.883173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:20.887089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 990/1953] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:20 2022] DELETE /identity/v3/projects/d918075b5db047418857958b26eb448a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:20.893870 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686be5ab-1bf9-427a-8ff4-f24735ee8be4 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:20.901452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686be5ab-1bf9-427a-8ff4-f24735ee8be4 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:20.964566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e93fe-1d17-4530-b0d0-5002219472f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:20.965375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e93fe-1d17-4530-b0d0-5002219472f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:20.965474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e93fe-1d17-4530-b0d0-5002219472f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:20.965722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e93fe-1d17-4530-b0d0-5002219472f0 admin admin] PATH_INFO: `/v3/users/aaa34027f78b4659a563c58092762a3c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:20.966964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e93fe-1d17-4530-b0d0-5002219472f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa34027f78b4659a563c58092762a3c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:20.968886 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e93fe-1d17-4530-b0d0-5002219472f0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:21.016020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:21.027386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-956e93fe-1d17-4530-b0d0-5002219472f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa34027f78b4659a563c58092762a3c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:21.028069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-956e93fe-1d17-4530-b0d0-5002219472f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa34027f78b4659a563c58092762a3c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:21.038574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-956e93fe-1d17-4530-b0d0-5002219472f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa34027f78b4659a563c58092762a3c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:21.046971 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-956e93fe-1d17-4530-b0d0-5002219472f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa34027f78b4659a563c58092762a3c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:21.047670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-956e93fe-1d17-4530-b0d0-5002219472f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa34027f78b4659a563c58092762a3c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:21.088676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 964/1954] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:20 2022] DELETE /identity/v3/users/aaa34027f78b4659a563c58092762a3c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:21.453882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:21.455630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:21.476912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954e7fe-b4f8-4ab3-98cb-8009653ce1ba admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:21.574239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:21.575005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:21.575265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:21.575855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] PATH_INFO: `/v3/projects/905cfc088efc4dceac8fbcaf9d217317` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:21.576863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=905cfc088efc4dceac8fbcaf9d217317)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:21.578930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:21.648005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905cfc088efc4dceac8fbcaf9d217317', 'request_id': 'req-07c51be2-7309-4229-aa2b-455285dd07d4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:21.656903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905cfc088efc4dceac8fbcaf9d217317', 'request_id': 'req-07c51be2-7309-4229-aa2b-455285dd07d4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:21.663848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905cfc088efc4dceac8fbcaf9d217317', 'request_id': 'req-07c51be2-7309-4229-aa2b-455285dd07d4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:21.676075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] The token cache is being invalidate because project 905cfc088efc4dceac8fbcaf9d217317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:21.676370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:21.677240 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07c51be2-7309-4229-aa2b-455285dd07d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:21.679218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 991/1955] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:21 2022] DELETE /identity/v3/projects/905cfc088efc4dceac8fbcaf9d217317 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:21.684505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590518b-40f2-4877-bfd4-6df6edd2d7e9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:21.684794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590518b-40f2-4877-bfd4-6df6edd2d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:21.685066 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590518b-40f2-4877-bfd4-6df6edd2d7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:21.713904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2590518b-40f2-4877-bfd4-6df6edd2d7e9 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:21.713904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2590518b-40f2-4877-bfd4-6df6edd2d7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:21.779325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 965/1956] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:21.788499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a666a8d-0d64-45d5-9ec6-a6cebd8df3fe None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:21.790422 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a666a8d-0d64-45d5-9ec6-a6cebd8df3fe None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:21.790799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a666a8d-0d64-45d5-9ec6-a6cebd8df3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:21.811880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3a666a8d-0d64-45d5-9ec6-a6cebd8df3fe None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:21.813063 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3a666a8d-0d64-45d5-9ec6-a6cebd8df3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:21.821003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 992/1957] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:21.825502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590518b-40f2-4877-bfd4-6df6edd2d7e9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:21.835306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590518b-40f2-4877-bfd4-6df6edd2d7e9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:21.840147 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5ebbb-94f3-4f8b-88db-ef9d9efee022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:21.840757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5ebbb-94f3-4f8b-88db-ef9d9efee022 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:21.841052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5ebbb-94f3-4f8b-88db-ef9d9efee022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:21.841291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5ebbb-94f3-4f8b-88db-ef9d9efee022 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:21.841976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5ebbb-94f3-4f8b-88db-ef9d9efee022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:21.842263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5ebbb-94f3-4f8b-88db-ef9d9efee022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:21.843927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5ebbb-94f3-4f8b-88db-ef9d9efee022 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:21.857407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 966/1958] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:21.863973 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a666a8d-0d64-45d5-9ec6-a6cebd8df3fe None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:21.876956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a666a8d-0d64-45d5-9ec6-a6cebd8df3fe None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:21.888322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1acdf4-ee54-498a-be3b-f23218e2c40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:21.889391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1acdf4-ee54-498a-be3b-f23218e2c40f admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:21.889391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1acdf4-ee54-498a-be3b-f23218e2c40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:21.889593 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1acdf4-ee54-498a-be3b-f23218e2c40f admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:21.890308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1acdf4-ee54-498a-be3b-f23218e2c40f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:21.892262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1acdf4-ee54-498a-be3b-f23218e2c40f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:21.931375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 993/1959] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:21 2022] POST /identity/v3/projects => generated 357 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:21.938305 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5ebbb-94f3-4f8b-88db-ef9d9efee022 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:21.948638 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5ebbb-94f3-4f8b-88db-ef9d9efee022 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:22.045239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5b7d3-c698-443b-ba67-10d8bdbdc3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:22.046079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5b7d3-c698-443b-ba67-10d8bdbdc3fe admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:22.046454 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5b7d3-c698-443b-ba67-10d8bdbdc3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:22.046829 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5b7d3-c698-443b-ba67-10d8bdbdc3fe admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:22.047581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5b7d3-c698-443b-ba67-10d8bdbdc3fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:22.049627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5b7d3-c698-443b-ba67-10d8bdbdc3fe admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:22.074522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 967/1960] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:21 2022] POST /identity/v3/users => generated 279 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:22.078605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1acdf4-ee54-498a-be3b-f23218e2c40f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:22.091987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1acdf4-ee54-498a-be3b-f23218e2c40f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:22.096806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723782a4-02c2-4fb7-8264-37cf076e51c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:22.097544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723782a4-02c2-4fb7-8264-37cf076e51c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:22.097947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723782a4-02c2-4fb7-8264-37cf076e51c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:22.098309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723782a4-02c2-4fb7-8264-37cf076e51c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:22.099620 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723782a4-02c2-4fb7-8264-37cf076e51c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:22.101616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723782a4-02c2-4fb7-8264-37cf076e51c4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:22.120530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 994/1961] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:22.124830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5b7d3-c698-443b-ba67-10d8bdbdc3fe admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:22.136149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5b7d3-c698-443b-ba67-10d8bdbdc3fe admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:22.141131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e7cd4-bd01-418f-9f1d-386119c44140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:22.141750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e7cd4-bd01-418f-9f1d-386119c44140 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:22.142069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e7cd4-bd01-418f-9f1d-386119c44140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:22.142356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e7cd4-bd01-418f-9f1d-386119c44140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:22.142997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e7cd4-bd01-418f-9f1d-386119c44140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:22.144593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e7cd4-bd01-418f-9f1d-386119c44140 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:22.159998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 968/1962] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:22.162854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723782a4-02c2-4fb7-8264-37cf076e51c4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:22.187175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723782a4-02c2-4fb7-8264-37cf076e51c4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:22.191928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142108fd-b479-4c79-a37c-3c6a31b0e687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:22.192677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142108fd-b479-4c79-a37c-3c6a31b0e687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:22.193010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142108fd-b479-4c79-a37c-3c6a31b0e687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:22.193268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142108fd-b479-4c79-a37c-3c6a31b0e687 admin admin] PATH_INFO: `/v3/projects/223614f7d9004b80afbd55b84e818421/users/103c2ed96ebb4953ade9c5b3f814ff71/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:22.213495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142108fd-b479-4c79-a37c-3c6a31b0e687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223614f7d9004b80afbd55b84e818421, user_id=103c2ed96ebb4953ade9c5b3f814ff71, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:22.218029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142108fd-b479-4c79-a37c-3c6a31b0e687 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:22.248838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 995/1963] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:22 2022] PUT /identity/v3/projects/223614f7d9004b80afbd55b84e818421/users/103c2ed96ebb4953ade9c5b3f814ff71/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:22.261919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf598-c156-4e33-aeb2-5f923cbbb9c7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:22.262553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf598-c156-4e33-aeb2-5f923cbbb9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:22.263034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf598-c156-4e33-aeb2-5f923cbbb9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:22.325667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6febf598-c156-4e33-aeb2-5f923cbbb9c7 None None] MFA Rules not processed for user `103c2ed96ebb4953ade9c5b3f814ff71`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:22.330514 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6febf598-c156-4e33-aeb2-5f923cbbb9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:22.347151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:22.449757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 969/1964] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:22.454438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142108fd-b479-4c79-a37c-3c6a31b0e687 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:22.487383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:22.497669 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febf598-c156-4e33-aeb2-5f923cbbb9c7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:22.500552 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6febf598-c156-4e33-aeb2-5f923cbbb9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:22.606945 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142108fd-b479-4c79-a37c-3c6a31b0e687 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:22.629641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2e6d-a8f3-4a6f-a0d4-b344e3040ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:22.630525 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2e6d-a8f3-4a6f-a0d4-b344e3040ccc admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:22.630870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2e6d-a8f3-4a6f-a0d4-b344e3040ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:22.631226 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2e6d-a8f3-4a6f-a0d4-b344e3040ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:22.631941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2e6d-a8f3-4a6f-a0d4-b344e3040ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:22.634247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2e6d-a8f3-4a6f-a0d4-b344e3040ccc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:22.662865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febf598-c156-4e33-aeb2-5f923cbbb9c7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:22.673078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb5371-8c07-4fba-a4a9-f126915249a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:22.673977 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb5371-8c07-4fba-a4a9-f126915249a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:22.674743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb5371-8c07-4fba-a4a9-f126915249a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:22.674743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb5371-8c07-4fba-a4a9-f126915249a4 admin admin] PATH_INFO: `/v3/users/52492e54dd2c43d3838340ab73cb96ca` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:22.676023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb5371-8c07-4fba-a4a9-f126915249a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52492e54dd2c43d3838340ab73cb96ca)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:22.679188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb5371-8c07-4fba-a4a9-f126915249a4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:22.688550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 996/1965] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:22 2022] POST /identity/v3/projects => generated 355 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:11:22.691108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2e6d-a8f3-4a6f-a0d4-b344e3040ccc admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:22.759665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c7bb5371-8c07-4fba-a4a9-f126915249a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52492e54dd2c43d3838340ab73cb96ca'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:22.760896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c7bb5371-8c07-4fba-a4a9-f126915249a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52492e54dd2c43d3838340ab73cb96ca'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:22.772946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c7bb5371-8c07-4fba-a4a9-f126915249a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52492e54dd2c43d3838340ab73cb96ca'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:22.782575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c7bb5371-8c07-4fba-a4a9-f126915249a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52492e54dd2c43d3838340ab73cb96ca'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:22.783688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c7bb5371-8c07-4fba-a4a9-f126915249a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52492e54dd2c43d3838340ab73cb96ca'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:22.783874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2e6d-a8f3-4a6f-a0d4-b344e3040ccc admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:22.790200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ec855-e206-47d3-8069-214f35c44325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:22.790979 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec855-e206-47d3-8069-214f35c44325 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:22.791390 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec855-e206-47d3-8069-214f35c44325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:22.791677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec855-e206-47d3-8069-214f35c44325 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:22.792362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ec855-e206-47d3-8069-214f35c44325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:22.794546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ec855-e206-47d3-8069-214f35c44325 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:22.804398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 970/1966] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:22 2022] DELETE /identity/v3/users/52492e54dd2c43d3838340ab73cb96ca => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:22.808855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061202d5-340b-469c-a33a-dee9105d50d8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:22.809287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061202d5-340b-469c-a33a-dee9105d50d8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:22.809612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061202d5-340b-469c-a33a-dee9105d50d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:22.831794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-061202d5-340b-469c-a33a-dee9105d50d8 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:22.832744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 997/1967] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:22 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:11:22.833159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-061202d5-340b-469c-a33a-dee9105d50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:22.837596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ec855-e206-47d3-8069-214f35c44325 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:22.839270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-779ec855-e206-47d3-8069-214f35c44325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:22.852111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ec855-e206-47d3-8069-214f35c44325 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:22.853979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:22.912100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 971/1968] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:22.919922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061202d5-340b-469c-a33a-dee9105d50d8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:22.922896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-061202d5-340b-469c-a33a-dee9105d50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:22.924073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e5429-9f37-4eae-8283-d82863299695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:22.924810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e5429-9f37-4eae-8283-d82863299695 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:22.925157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e5429-9f37-4eae-8283-d82863299695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:22.925497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e5429-9f37-4eae-8283-d82863299695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:22.926279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e5429-9f37-4eae-8283-d82863299695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:22.928826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e5429-9f37-4eae-8283-d82863299695 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:22.942068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 998/1969] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:22.948937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e5429-9f37-4eae-8283-d82863299695 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:22.977024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e5429-9f37-4eae-8283-d82863299695 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:22.986955 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fb1ba-ccf0-4569-8069-2a9d9fc0670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:22.987880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fb1ba-ccf0-4569-8069-2a9d9fc0670f admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:22.988388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fb1ba-ccf0-4569-8069-2a9d9fc0670f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:22.988809 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fb1ba-ccf0-4569-8069-2a9d9fc0670f admin admin] PATH_INFO: `/v3/projects/6a5e5830b6b346b7b58e023a2264d16e/users/0e03488700374e4c82d7ff1b9fb2d41c/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.005897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061202d5-340b-469c-a33a-dee9105d50d8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:23.007207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fb1ba-ccf0-4569-8069-2a9d9fc0670f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5e5830b6b346b7b58e023a2264d16e, user_id=0e03488700374e4c82d7ff1b9fb2d41c, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:23.009993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fb1ba-ccf0-4569-8069-2a9d9fc0670f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:23.013412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6464ad-696d-4e0b-b472-55c242ed49d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:23.014287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6464ad-696d-4e0b-b472-55c242ed49d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.014839 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6464ad-696d-4e0b-b472-55c242ed49d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.015183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6464ad-696d-4e0b-b472-55c242ed49d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.022865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:23.029635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6464ad-696d-4e0b-b472-55c242ed49d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:23.029890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 999/1970] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:22 2022] PUT /identity/v3/projects/6a5e5830b6b346b7b58e023a2264d16e/users/0e03488700374e4c82d7ff1b9fb2d41c/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:23.031573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6464ad-696d-4e0b-b472-55c242ed49d5 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:23.033888 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fb1ba-ccf0-4569-8069-2a9d9fc0670f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:23.044081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 972/1971] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:23.106344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fb1ba-ccf0-4569-8069-2a9d9fc0670f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:23.111658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb74f9e-6d2e-4816-b1ab-c96b3be44185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:23.112287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb74f9e-6d2e-4816-b1ab-c96b3be44185 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.112587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb74f9e-6d2e-4816-b1ab-c96b3be44185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.112838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb74f9e-6d2e-4816-b1ab-c96b3be44185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.113526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb74f9e-6d2e-4816-b1ab-c96b3be44185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:23.115921 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb74f9e-6d2e-4816-b1ab-c96b3be44185 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:23.137027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1000/1972] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:23.138263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6464ad-696d-4e0b-b472-55c242ed49d5 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:23.150652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6464ad-696d-4e0b-b472-55c242ed49d5 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:23.169045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27632964-7eaa-4c88-b42d-c12718b4d260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:23.170546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27632964-7eaa-4c88-b42d-c12718b4d260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.171241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27632964-7eaa-4c88-b42d-c12718b4d260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.171735 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27632964-7eaa-4c88-b42d-c12718b4d260 admin admin] PATH_INFO: `/v3/projects/6a5e5830b6b346b7b58e023a2264d16e/users/0e03488700374e4c82d7ff1b9fb2d41c/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.174499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27632964-7eaa-4c88-b42d-c12718b4d260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5e5830b6b346b7b58e023a2264d16e, user_id=0e03488700374e4c82d7ff1b9fb2d41c, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:23.177575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27632964-7eaa-4c88-b42d-c12718b4d260 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:23.189416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 973/1973] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:23 2022] PUT /identity/v3/projects/6a5e5830b6b346b7b58e023a2264d16e/users/0e03488700374e4c82d7ff1b9fb2d41c/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:23.203237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecf9de-e381-4aaf-99af-e30b3d8994f2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.203696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecf9de-e381-4aaf-99af-e30b3d8994f2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.203986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecf9de-e381-4aaf-99af-e30b3d8994f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.233972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2cecf9de-e381-4aaf-99af-e30b3d8994f2 None None] MFA Rules not processed for user `0e03488700374e4c82d7ff1b9fb2d41c`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:23.235407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2cecf9de-e381-4aaf-99af-e30b3d8994f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:23.330408 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1001/1974] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:23.343632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27632964-7eaa-4c88-b42d-c12718b4d260 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:23.346223 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-27632964-7eaa-4c88-b42d-c12718b4d260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:23.393058 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecf9de-e381-4aaf-99af-e30b3d8994f2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:23.394553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2cecf9de-e381-4aaf-99af-e30b3d8994f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:23.419656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27632964-7eaa-4c88-b42d-c12718b4d260 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:23.424154 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77010ea2-f079-453c-8198-6f9bb91f2b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:23.424879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77010ea2-f079-453c-8198-6f9bb91f2b91 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.425153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77010ea2-f079-453c-8198-6f9bb91f2b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.425418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77010ea2-f079-453c-8198-6f9bb91f2b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.438693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77010ea2-f079-453c-8198-6f9bb91f2b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:23.440436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77010ea2-f079-453c-8198-6f9bb91f2b91 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:23.452161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 974/1975] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:23.498881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecf9de-e381-4aaf-99af-e30b3d8994f2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:23.504012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:23.504745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.505024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.505294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] PATH_INFO: `/v3/projects/1b2da96828da4a2d8763d3663bf9cb28` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.506745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2da96828da4a2d8763d3663bf9cb28)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:23.509353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:23.542343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77010ea2-f079-453c-8198-6f9bb91f2b91 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:23.550109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:23.553526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77010ea2-f079-453c-8198-6f9bb91f2b91 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:23.559904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e79c-42c9-4fe7-9735-78c6a260d032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:23.560743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e79c-42c9-4fe7-9735-78c6a260d032 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.561022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e79c-42c9-4fe7-9735-78c6a260d032 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.561360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e79c-42c9-4fe7-9735-78c6a260d032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.564054 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a636e79c-42c9-4fe7-9735-78c6a260d032 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:23.580457 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2da96828da4a2d8763d3663bf9cb28', 'request_id': 'req-6ebfa669-7557-467c-b5ef-940413edf491'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:23.588823 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2da96828da4a2d8763d3663bf9cb28', 'request_id': 'req-6ebfa669-7557-467c-b5ef-940413edf491'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:23.604147 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2da96828da4a2d8763d3663bf9cb28', 'request_id': 'req-6ebfa669-7557-467c-b5ef-940413edf491'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:23.617026 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] The token cache is being invalidate because project 1b2da96828da4a2d8763d3663bf9cb28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:23.617714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:23.618171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6ebfa669-7557-467c-b5ef-940413edf491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:23.619698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1002/1976] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:23 2022] DELETE /identity/v3/projects/1b2da96828da4a2d8763d3663bf9cb28 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:23.624414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d2cb-aad8-4e98-9e41-189255043949 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.624742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d2cb-aad8-4e98-9e41-189255043949 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.625009 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d2cb-aad8-4e98-9e41-189255043949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.636577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636e79c-42c9-4fe7-9735-78c6a260d032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:23.638152 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636e79c-42c9-4fe7-9735-78c6a260d032 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:23.642687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:23.646375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-45d2d2cb-aad8-4e98-9e41-189255043949 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:23.647671 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-45d2d2cb-aad8-4e98-9e41-189255043949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:23.661903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 975/1977] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:23.732145 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1003/1978] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:23.740421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8441-0414-4e46-a89a-0506aed5ed0a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.740775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8441-0414-4e46-a89a-0506aed5ed0a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.740976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8441-0414-4e46-a89a-0506aed5ed0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.763071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0bbc8441-0414-4e46-a89a-0506aed5ed0a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:23.764303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0bbc8441-0414-4e46-a89a-0506aed5ed0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:23.772876 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 976/1979] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:23.777319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2d2cb-aad8-4e98-9e41-189255043949 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:23.787445 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2d2cb-aad8-4e98-9e41-189255043949 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:23.793111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0372df9-93ef-480b-a046-efbd98b9fec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:23.793950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0372df9-93ef-480b-a046-efbd98b9fec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.794291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0372df9-93ef-480b-a046-efbd98b9fec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.794622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0372df9-93ef-480b-a046-efbd98b9fec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.797453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0372df9-93ef-480b-a046-efbd98b9fec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:23.797453 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0372df9-93ef-480b-a046-efbd98b9fec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:23.804003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0372df9-93ef-480b-a046-efbd98b9fec8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:23.819274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc8441-0414-4e46-a89a-0506aed5ed0a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:23.824898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1004/1980] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:23.831243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc8441-0414-4e46-a89a-0506aed5ed0a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:23.836896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa42f4-ce20-405b-81b1-8d89d33d3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:23.837620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa42f4-ce20-405b-81b1-8d89d33d3b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.838011 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa42f4-ce20-405b-81b1-8d89d33d3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.838461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa42f4-ce20-405b-81b1-8d89d33d3b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.839244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa42f4-ce20-405b-81b1-8d89d33d3b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:23.845426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa42f4-ce20-405b-81b1-8d89d33d3b82 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:23.877444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 977/1981] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:23 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:23.882520 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0372df9-93ef-480b-a046-efbd98b9fec8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:23.894001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0372df9-93ef-480b-a046-efbd98b9fec8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:23.966617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f589f6-7deb-4c4a-82dc-66c6ef6e3092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:23.967167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f589f6-7deb-4c4a-82dc-66c6ef6e3092 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:23.967446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f589f6-7deb-4c4a-82dc-66c6ef6e3092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:23.967732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f589f6-7deb-4c4a-82dc-66c6ef6e3092 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:23.968356 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f589f6-7deb-4c4a-82dc-66c6ef6e3092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:23.970493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f589f6-7deb-4c4a-82dc-66c6ef6e3092 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:24.002074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1005/1982] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:23 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:24.003258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa42f4-ce20-405b-81b1-8d89d33d3b82 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:24.014076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa42f4-ce20-405b-81b1-8d89d33d3b82 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:24.020107 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dcacc-f809-4222-973f-d6be0e1edef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:24.021246 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dcacc-f809-4222-973f-d6be0e1edef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:24.021651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dcacc-f809-4222-973f-d6be0e1edef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:24.022036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dcacc-f809-4222-973f-d6be0e1edef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:24.022806 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dcacc-f809-4222-973f-d6be0e1edef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:24.024562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dcacc-f809-4222-973f-d6be0e1edef1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:24.041396 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 978/1983] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:24.045206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f589f6-7deb-4c4a-82dc-66c6ef6e3092 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:24.062872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f589f6-7deb-4c4a-82dc-66c6ef6e3092 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:24.073991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8884f6-3103-47e3-818f-41761dbc5048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:24.073991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8884f6-3103-47e3-818f-41761dbc5048 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:24.073991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8884f6-3103-47e3-818f-41761dbc5048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:24.073991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8884f6-3103-47e3-818f-41761dbc5048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:24.074394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8884f6-3103-47e3-818f-41761dbc5048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:24.074394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8884f6-3103-47e3-818f-41761dbc5048 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:24.085889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1006/1984] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:24.088807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dcacc-f809-4222-973f-d6be0e1edef1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:24.099384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dcacc-f809-4222-973f-d6be0e1edef1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:24.104424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc975a7-bde2-4500-a7e1-065a64d54118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:24.105104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc975a7-bde2-4500-a7e1-065a64d54118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:24.105519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc975a7-bde2-4500-a7e1-065a64d54118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:24.105796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc975a7-bde2-4500-a7e1-065a64d54118 admin admin] PATH_INFO: `/v3/projects/4b14b60411e1402397ee18361dd37d5f/users/185d7c5b2949486585ecd3ebb45673c4/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:24.125648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc975a7-bde2-4500-a7e1-065a64d54118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b14b60411e1402397ee18361dd37d5f, user_id=185d7c5b2949486585ecd3ebb45673c4, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:24.128405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc975a7-bde2-4500-a7e1-065a64d54118 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:24.145946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 979/1985] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:24 2022] PUT /identity/v3/projects/4b14b60411e1402397ee18361dd37d5f/users/185d7c5b2949486585ecd3ebb45673c4/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:24.156753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77458d7-c2cb-4cd5-bcf0-db0172257935 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:24.157040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77458d7-c2cb-4cd5-bcf0-db0172257935 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:24.157312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77458d7-c2cb-4cd5-bcf0-db0172257935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:24.188748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c77458d7-c2cb-4cd5-bcf0-db0172257935 None None] MFA Rules not processed for user `185d7c5b2949486585ecd3ebb45673c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:24.190031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c77458d7-c2cb-4cd5-bcf0-db0172257935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:24.194360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:24.284983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1007/1986] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:24.286450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc975a7-bde2-4500-a7e1-065a64d54118 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:24.367595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc975a7-bde2-4500-a7e1-065a64d54118 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:24.372505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc22c8-4a95-4b75-8c19-a268b9f1e58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:24.373457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc22c8-4a95-4b75-8c19-a268b9f1e58d admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:24.374243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc22c8-4a95-4b75-8c19-a268b9f1e58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:24.374696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc22c8-4a95-4b75-8c19-a268b9f1e58d admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:24.375614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc22c8-4a95-4b75-8c19-a268b9f1e58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:24.378302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc22c8-4a95-4b75-8c19-a268b9f1e58d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:24.413772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 980/1987] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:24 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:24.418567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77458d7-c2cb-4cd5-bcf0-db0172257935 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:24.431461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77458d7-c2cb-4cd5-bcf0-db0172257935 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:24.507407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e046c-fdbe-4e59-94a9-a4de091cb422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:24.508055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e046c-fdbe-4e59-94a9-a4de091cb422 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:24.508342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e046c-fdbe-4e59-94a9-a4de091cb422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:24.508584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e046c-fdbe-4e59-94a9-a4de091cb422 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:24.509184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e046c-fdbe-4e59-94a9-a4de091cb422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:24.511361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e046c-fdbe-4e59-94a9-a4de091cb422 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:24.554166 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1008/1988] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:24 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:24.558264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc22c8-4a95-4b75-8c19-a268b9f1e58d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:24.568716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc22c8-4a95-4b75-8c19-a268b9f1e58d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:24.573457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa996fb-8541-4437-a751-7e22e26ac154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:24.574098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa996fb-8541-4437-a751-7e22e26ac154 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:24.574372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa996fb-8541-4437-a751-7e22e26ac154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:24.574641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa996fb-8541-4437-a751-7e22e26ac154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:24.575288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa996fb-8541-4437-a751-7e22e26ac154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:24.576853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa996fb-8541-4437-a751-7e22e26ac154 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:24.592355 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 981/1989] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:24.597199 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e046c-fdbe-4e59-94a9-a4de091cb422 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:24.607605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e046c-fdbe-4e59-94a9-a4de091cb422 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:24.612410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebd129-2abf-4a6d-be00-294eb2d866a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:24.613095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebd129-2abf-4a6d-be00-294eb2d866a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:24.613301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebd129-2abf-4a6d-be00-294eb2d866a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:24.613669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebd129-2abf-4a6d-be00-294eb2d866a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:24.614378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebd129-2abf-4a6d-be00-294eb2d866a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:24.616128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebd129-2abf-4a6d-be00-294eb2d866a3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:24.630315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1009/1990] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:24.634347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa996fb-8541-4437-a751-7e22e26ac154 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:24.651650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa996fb-8541-4437-a751-7e22e26ac154 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:24.657249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923b6c2-414b-42f5-9f27-a3d0254ea7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:24.657950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923b6c2-414b-42f5-9f27-a3d0254ea7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:24.658225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923b6c2-414b-42f5-9f27-a3d0254ea7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:24.658495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923b6c2-414b-42f5-9f27-a3d0254ea7ed admin admin] PATH_INFO: `/v3/projects/f1f54be82dc8431db9f0127184f46c9e/users/b0aabe0d3ba14ea0a5fc66892d9c0bf5/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:24.674169 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923b6c2-414b-42f5-9f27-a3d0254ea7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f54be82dc8431db9f0127184f46c9e, user_id=b0aabe0d3ba14ea0a5fc66892d9c0bf5, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:24.676985 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923b6c2-414b-42f5-9f27-a3d0254ea7ed admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:24.692672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 982/1991] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:24 2022] PUT /identity/v3/projects/f1f54be82dc8431db9f0127184f46c9e/users/b0aabe0d3ba14ea0a5fc66892d9c0bf5/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:24.704342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258292c4-68a6-47a2-bd93-c1fc49451172 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:24.704960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258292c4-68a6-47a2-bd93-c1fc49451172 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:24.705227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258292c4-68a6-47a2-bd93-c1fc49451172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:24.745205 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-258292c4-68a6-47a2-bd93-c1fc49451172 None None] MFA Rules not processed for user `b0aabe0d3ba14ea0a5fc66892d9c0bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:24.746606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-258292c4-68a6-47a2-bd93-c1fc49451172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:24.815672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1010/1992] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:24.820576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923b6c2-414b-42f5-9f27-a3d0254ea7ed admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:24.889046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:24.914897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923b6c2-414b-42f5-9f27-a3d0254ea7ed admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:24.921640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cbacb-7fb7-4cc1-bee6-14276b6f69dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:24.922258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cbacb-7fb7-4cc1-bee6-14276b6f69dc admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:24.922470 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cbacb-7fb7-4cc1-bee6-14276b6f69dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:24.922741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cbacb-7fb7-4cc1-bee6-14276b6f69dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:24.923527 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cbacb-7fb7-4cc1-bee6-14276b6f69dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:24.926384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cbacb-7fb7-4cc1-bee6-14276b6f69dc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:24.963080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 983/1993] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:24 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:24.967622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258292c4-68a6-47a2-bd93-c1fc49451172 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:24.983783 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258292c4-68a6-47a2-bd93-c1fc49451172 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:25.007672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:25.063064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d010-8367-4be0-bb69-766c9fdad382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:25.063697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d010-8367-4be0-bb69-766c9fdad382 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:25.063969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d010-8367-4be0-bb69-766c9fdad382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:25.064239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d010-8367-4be0-bb69-766c9fdad382 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:25.064952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107d010-8367-4be0-bb69-766c9fdad382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:25.066870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107d010-8367-4be0-bb69-766c9fdad382 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:25.095033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1011/1994] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:24 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:25.097553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cbacb-7fb7-4cc1-bee6-14276b6f69dc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:25.111535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cbacb-7fb7-4cc1-bee6-14276b6f69dc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:25.117206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27df01-d53b-4b5a-b8e1-b0e8fa5063d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:25.119138 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27df01-d53b-4b5a-b8e1-b0e8fa5063d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:25.119590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27df01-d53b-4b5a-b8e1-b0e8fa5063d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:25.119884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27df01-d53b-4b5a-b8e1-b0e8fa5063d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:25.120516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27df01-d53b-4b5a-b8e1-b0e8fa5063d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:25.122567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27df01-d53b-4b5a-b8e1-b0e8fa5063d5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:25.134338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 984/1995] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:25.138448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d010-8367-4be0-bb69-766c9fdad382 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:25.148937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d010-8367-4be0-bb69-766c9fdad382 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:25.154987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64fda2-6bcd-4750-a40d-07653d1f8ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:25.155683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64fda2-6bcd-4750-a40d-07653d1f8ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:25.155962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64fda2-6bcd-4750-a40d-07653d1f8ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:25.156285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64fda2-6bcd-4750-a40d-07653d1f8ca6 admin admin] PATH_INFO: `/v3/projects/883ece4af9714a1da0b9507d8f302fdb/users/bf69fbc9712e4f63b7b948cc700e02c9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:25.172738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64fda2-6bcd-4750-a40d-07653d1f8ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883ece4af9714a1da0b9507d8f302fdb, user_id=bf69fbc9712e4f63b7b948cc700e02c9, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:25.175619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64fda2-6bcd-4750-a40d-07653d1f8ca6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:25.193083 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1012/1996] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:25 2022] PUT /identity/v3/projects/883ece4af9714a1da0b9507d8f302fdb/users/bf69fbc9712e4f63b7b948cc700e02c9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:25.197451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27df01-d53b-4b5a-b8e1-b0e8fa5063d5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:25.208114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27df01-d53b-4b5a-b8e1-b0e8fa5063d5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:25.289451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852db4df-7b7f-4b61-88db-6d77e3fb90ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:25.290110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db4df-7b7f-4b61-88db-6d77e3fb90ab admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:25.290510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db4df-7b7f-4b61-88db-6d77e3fb90ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:25.290910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db4df-7b7f-4b61-88db-6d77e3fb90ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:25.291567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852db4df-7b7f-4b61-88db-6d77e3fb90ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:25.293172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852db4df-7b7f-4b61-88db-6d77e3fb90ab admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:25.307177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 985/1997] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:25.308516 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64fda2-6bcd-4750-a40d-07653d1f8ca6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:25.319543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64fda2-6bcd-4750-a40d-07653d1f8ca6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:25.324789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a96dc1-e039-4f6f-b6bb-26a8f53491fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:25.329963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a96dc1-e039-4f6f-b6bb-26a8f53491fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:25.329963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a96dc1-e039-4f6f-b6bb-26a8f53491fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:25.329963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a96dc1-e039-4f6f-b6bb-26a8f53491fa admin admin] PATH_INFO: `/v3/projects/883ece4af9714a1da0b9507d8f302fdb/users/bf69fbc9712e4f63b7b948cc700e02c9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:25.332085 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a96dc1-e039-4f6f-b6bb-26a8f53491fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=883ece4af9714a1da0b9507d8f302fdb, user_id=bf69fbc9712e4f63b7b948cc700e02c9, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:25.335040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a96dc1-e039-4f6f-b6bb-26a8f53491fa admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:25.350961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1013/1998] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:25 2022] PUT /identity/v3/projects/883ece4af9714a1da0b9507d8f302fdb/users/bf69fbc9712e4f63b7b948cc700e02c9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:25.361909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4754f-dcad-46a0-83fd-0d3d1f03c07d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:25.362264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4754f-dcad-46a0-83fd-0d3d1f03c07d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:25.362592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4754f-dcad-46a0-83fd-0d3d1f03c07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:25.405651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-caa4754f-dcad-46a0-83fd-0d3d1f03c07d None None] MFA Rules not processed for user `bf69fbc9712e4f63b7b948cc700e02c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:25.406942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-caa4754f-dcad-46a0-83fd-0d3d1f03c07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:25.499896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 986/1999] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:25.511724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a96dc1-e039-4f6f-b6bb-26a8f53491fa admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:25.513675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-93a96dc1-e039-4f6f-b6bb-26a8f53491fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:25.576246 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a96dc1-e039-4f6f-b6bb-26a8f53491fa admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:25.579877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5a354-9b09-416d-8920-d50e59d76b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:25.580593 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a354-9b09-416d-8920-d50e59d76b59 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:25.580938 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a354-9b09-416d-8920-d50e59d76b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:25.581212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a354-9b09-416d-8920-d50e59d76b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:25.654626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5a354-9b09-416d-8920-d50e59d76b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:25.657642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5a354-9b09-416d-8920-d50e59d76b59 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:25.669871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1014/2000] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:27.352336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4754f-dcad-46a0-83fd-0d3d1f03c07d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:27.354498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-caa4754f-dcad-46a0-83fd-0d3d1f03c07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:27.390848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4754f-dcad-46a0-83fd-0d3d1f03c07d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:27.404014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644f366-c0fb-4c76-b208-6d056cb7c3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:27.405790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f366-c0fb-4c76-b208-6d056cb7c3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:27.405790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f366-c0fb-4c76-b208-6d056cb7c3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:27.405790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f366-c0fb-4c76-b208-6d056cb7c3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:27.510326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:27.552210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644f366-c0fb-4c76-b208-6d056cb7c3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:27.554375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644f366-c0fb-4c76-b208-6d056cb7c3e5 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:27.569202 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 987/2001] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:28.234098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969835c5-84ce-45fd-8b11-94817b6df744 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:28.234701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969835c5-84ce-45fd-8b11-94817b6df744 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:28.234803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969835c5-84ce-45fd-8b11-94817b6df744 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:28.236675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1015/2002] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:11:28.248856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcef4d-8e38-4e7a-9709-0f15641138d8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:28.249255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcef4d-8e38-4e7a-9709-0f15641138d8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:28.249603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcef4d-8e38-4e7a-9709-0f15641138d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:28.286641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d4fcef4d-8e38-4e7a-9709-0f15641138d8 None None] MFA Rules not processed for user `2c7f2566918b4c719486d1ce285724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:28.288292 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d4fcef4d-8e38-4e7a-9709-0f15641138d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:28.322193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969835c5-84ce-45fd-8b11-94817b6df744 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:28.324207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-969835c5-84ce-45fd-8b11-94817b6df744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:28.368411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:28.446643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 988/2003] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:11:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:28.469531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf3148-6967-4697-be43-950a68413eb5 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:28.470390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf3148-6967-4697-be43-950a68413eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:28.471028 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf3148-6967-4697-be43-950a68413eb5 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:28.473191 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 989/2004] 10.222.0.20 () {54 vars in 961 bytes} [Thu Sep 22 22:11:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:11:28.478905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710d251-cce8-47b7-ac6f-13427053d6ed None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:28.479376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710d251-cce8-47b7-ac6f-13427053d6ed None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:28.481247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710d251-cce8-47b7-ac6f-13427053d6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:28.497214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969835c5-84ce-45fd-8b11-94817b6df744 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:28.508155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:28.511741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c710d251-cce8-47b7-ac6f-13427053d6ed None None] MFA Rules not processed for user `2c7f2566918b4c719486d1ce285724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:28.512237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:28.512628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:28.512954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] PATH_INFO: `/v3/users/f09e5e57f5d54fbca1f4adb91781aaff` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:28.514007 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c710d251-cce8-47b7-ac6f-13427053d6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:28.518476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09e5e57f5d54fbca1f4adb91781aaff)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:28.524614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:28.525349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 990/2005] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Sep 22 22:11:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:28.534420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710d251-cce8-47b7-ac6f-13427053d6ed None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:28.554783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710d251-cce8-47b7-ac6f-13427053d6ed None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:28.561324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3cea9-c7c6-42de-be06-dd96b758ab4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:28.562354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3cea9-c7c6-42de-be06-dd96b758ab4a service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:28.562772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3cea9-c7c6-42de-be06-dd96b758ab4a service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:28.563180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3cea9-c7c6-42de-be06-dd96b758ab4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:28.574806 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3cea9-c7c6-42de-be06-dd96b758ab4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:28.577035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3cea9-c7c6-42de-be06-dd96b758ab4a service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:28.594710 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 991/2006] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:11:28.659204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09e5e57f5d54fbca1f4adb91781aaff'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:28.671870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09e5e57f5d54fbca1f4adb91781aaff'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:28.673148 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09e5e57f5d54fbca1f4adb91781aaff'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:28.682818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09e5e57f5d54fbca1f4adb91781aaff'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:28.699965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09e5e57f5d54fbca1f4adb91781aaff'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:28.706187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1016/2007] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:28 2022] DELETE /identity/v3/users/f09e5e57f5d54fbca1f4adb91781aaff => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:28.740045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3cea9-c7c6-42de-be06-dd96b758ab4a service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:28.750029 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3cea9-c7c6-42de-be06-dd96b758ab4a service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:28.808660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed3235-4af8-44d5-a7e0-aa0f6989a10d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:28.809338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed3235-4af8-44d5-a7e0-aa0f6989a10d service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:28.809677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed3235-4af8-44d5-a7e0-aa0f6989a10d service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:28.810092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed3235-4af8-44d5-a7e0-aa0f6989a10d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:28.811946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d7ed3235-4af8-44d5-a7e0-aa0f6989a10d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:28.892551 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:28.894104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:28.896215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed3235-4af8-44d5-a7e0-aa0f6989a10d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:28.898601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed3235-4af8-44d5-a7e0-aa0f6989a10d service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:28.909916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 992/2008] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:28.979302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c93cb2-0b9d-4553-ab6c-031c5fb0b276 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:28.988801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:28.989642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:28.990167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:28.990693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] PATH_INFO: `/v3/projects/83571a1fae8643a7a7603ff20a27b211` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:28.993015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=83571a1fae8643a7a7603ff20a27b211)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:28.995800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:29.064065 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:29.073174 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83571a1fae8643a7a7603ff20a27b211', 'request_id': 'req-09e3f2ea-a57b-4831-827a-589ccbb478ed'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:29.082040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83571a1fae8643a7a7603ff20a27b211', 'request_id': 'req-09e3f2ea-a57b-4831-827a-589ccbb478ed'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:29.088339 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83571a1fae8643a7a7603ff20a27b211', 'request_id': 'req-09e3f2ea-a57b-4831-827a-589ccbb478ed'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:29.099845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] The token cache is being invalidate because project 83571a1fae8643a7a7603ff20a27b211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:29.100157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:29.100848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-09e3f2ea-a57b-4831-827a-589ccbb478ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:29.102624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1017/2009] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:28 2022] DELETE /identity/v3/projects/83571a1fae8643a7a7603ff20a27b211 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:29.108348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a24a-754d-4a30-8ab3-786f9efd9592 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:29.108681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a24a-754d-4a30-8ab3-786f9efd9592 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:29.108948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a24a-754d-4a30-8ab3-786f9efd9592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:29.118325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:29.131841 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a948a24a-754d-4a30-8ab3-786f9efd9592 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:29.133156 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a948a24a-754d-4a30-8ab3-786f9efd9592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:29.194495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 993/2010] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:29.202753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7527b1b-77dd-4092-abad-bc57b32c5b8f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:29.203036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7527b1b-77dd-4092-abad-bc57b32c5b8f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:29.203307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7527b1b-77dd-4092-abad-bc57b32c5b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:29.225918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b7527b1b-77dd-4092-abad-bc57b32c5b8f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:29.227139 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b7527b1b-77dd-4092-abad-bc57b32c5b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:29.237958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1018/2011] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:29.242644 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a24a-754d-4a30-8ab3-786f9efd9592 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:29.252916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a24a-754d-4a30-8ab3-786f9efd9592 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:29.258431 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb53724-86c0-4488-8112-cbf0ec081d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:29.259277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb53724-86c0-4488-8112-cbf0ec081d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:29.259571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb53724-86c0-4488-8112-cbf0ec081d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:29.259840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb53724-86c0-4488-8112-cbf0ec081d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:29.260532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb53724-86c0-4488-8112-cbf0ec081d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:29.260832 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb53724-86c0-4488-8112-cbf0ec081d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:29.262462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb53724-86c0-4488-8112-cbf0ec081d9e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:29.277820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 994/2012] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:29.280096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7527b1b-77dd-4092-abad-bc57b32c5b8f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:29.289806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7527b1b-77dd-4092-abad-bc57b32c5b8f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:29.295001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efb7a0-5712-4638-9506-ed91c5f0e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:29.295659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb7a0-5712-4638-9506-ed91c5f0e103 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:29.295969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb7a0-5712-4638-9506-ed91c5f0e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:29.296240 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb7a0-5712-4638-9506-ed91c5f0e103 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:29.296870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efb7a0-5712-4638-9506-ed91c5f0e103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:29.298871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efb7a0-5712-4638-9506-ed91c5f0e103 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:29.330120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1019/2013] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:29 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:29.334696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb53724-86c0-4488-8112-cbf0ec081d9e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:29.345137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb53724-86c0-4488-8112-cbf0ec081d9e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:29.406548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41963d3-7540-4543-a380-f2f818865981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:29.407197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41963d3-7540-4543-a380-f2f818865981 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:29.407469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41963d3-7540-4543-a380-f2f818865981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:29.407739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41963d3-7540-4543-a380-f2f818865981 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:29.408366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41963d3-7540-4543-a380-f2f818865981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:29.410330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41963d3-7540-4543-a380-f2f818865981 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:29.444970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 995/2014] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:29 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:29.449538 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efb7a0-5712-4638-9506-ed91c5f0e103 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:29.460299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efb7a0-5712-4638-9506-ed91c5f0e103 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:29.464886 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531ac8e-9a49-40d2-a141-a8b6eba4601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:29.465486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531ac8e-9a49-40d2-a141-a8b6eba4601c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:29.465758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531ac8e-9a49-40d2-a141-a8b6eba4601c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:29.466052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531ac8e-9a49-40d2-a141-a8b6eba4601c admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:29.466699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531ac8e-9a49-40d2-a141-a8b6eba4601c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:29.468296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531ac8e-9a49-40d2-a141-a8b6eba4601c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:29.479851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1020/2015] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:29.484453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41963d3-7540-4543-a380-f2f818865981 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:29.495290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41963d3-7540-4543-a380-f2f818865981 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:29.501056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45a949-bc91-4761-bcb2-b92f5dfa71fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:29.501739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45a949-bc91-4761-bcb2-b92f5dfa71fa admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:29.502069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45a949-bc91-4761-bcb2-b92f5dfa71fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:29.502335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45a949-bc91-4761-bcb2-b92f5dfa71fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:29.502984 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45a949-bc91-4761-bcb2-b92f5dfa71fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:29.504609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45a949-bc91-4761-bcb2-b92f5dfa71fa admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:29.516376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 996/2016] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:29.520417 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531ac8e-9a49-40d2-a141-a8b6eba4601c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:29.531621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531ac8e-9a49-40d2-a141-a8b6eba4601c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:29.536627 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c704f8b-700e-4b5e-97cf-6c0ed9f6dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:29.537329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c704f8b-700e-4b5e-97cf-6c0ed9f6dd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:29.537603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c704f8b-700e-4b5e-97cf-6c0ed9f6dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:29.537963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c704f8b-700e-4b5e-97cf-6c0ed9f6dd64 admin admin] PATH_INFO: `/v3/projects/43f41f8eaf9e414a8eca5e39763c9455/users/fb6cbee941b24530bb6c1bfd61a64a30/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:29.553504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c704f8b-700e-4b5e-97cf-6c0ed9f6dd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f41f8eaf9e414a8eca5e39763c9455, user_id=fb6cbee941b24530bb6c1bfd61a64a30, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:29.556175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c704f8b-700e-4b5e-97cf-6c0ed9f6dd64 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:29.570854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1021/2017] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:29 2022] PUT /identity/v3/projects/43f41f8eaf9e414a8eca5e39763c9455/users/fb6cbee941b24530bb6c1bfd61a64a30/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:29.576225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8199-339e-4866-9482-073a3dbc5f12 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:29.576572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8199-339e-4866-9482-073a3dbc5f12 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:29.576905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8199-339e-4866-9482-073a3dbc5f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:29.597122 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c04a8199-339e-4866-9482-073a3dbc5f12 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:29.598409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c04a8199-339e-4866-9482-073a3dbc5f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:29.662505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 997/2018] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:29.672465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c704f8b-700e-4b5e-97cf-6c0ed9f6dd64 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:29.674395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5c704f8b-700e-4b5e-97cf-6c0ed9f6dd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:29.734267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c704f8b-700e-4b5e-97cf-6c0ed9f6dd64 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:29.738048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01f7c5-7676-41c5-a601-ef9e3bd42a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:29.738659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01f7c5-7676-41c5-a601-ef9e3bd42a1a service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:29.738970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01f7c5-7676-41c5-a601-ef9e3bd42a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:29.739238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01f7c5-7676-41c5-a601-ef9e3bd42a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:29.748348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01f7c5-7676-41c5-a601-ef9e3bd42a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:29.749796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01f7c5-7676-41c5-a601-ef9e3bd42a1a service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:29.759663 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1022/2019] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:33.171057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8199-339e-4866-9482-073a3dbc5f12 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:33.178821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c04a8199-339e-4866-9482-073a3dbc5f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:33.237363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8199-339e-4866-9482-073a3dbc5f12 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:33.247289 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:33.248055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:33.248386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:33.248672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] PATH_INFO: `/v3/users/185d7c5b2949486585ecd3ebb45673c4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:33.251032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=185d7c5b2949486585ecd3ebb45673c4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:33.253474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:33.260718 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:33.354051 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '185d7c5b2949486585ecd3ebb45673c4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:33.354842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '185d7c5b2949486585ecd3ebb45673c4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:33.366710 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '185d7c5b2949486585ecd3ebb45673c4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:33.386008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '185d7c5b2949486585ecd3ebb45673c4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:33.389658 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '185d7c5b2949486585ecd3ebb45673c4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:33.428852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 998/2020] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:33 2022] DELETE /identity/v3/users/185d7c5b2949486585ecd3ebb45673c4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:33.434246 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf929fa-03a3-4bd2-ab55-ffebaf56bf69 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:33.435299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf929fa-03a3-4bd2-ab55-ffebaf56bf69 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:33.435596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf929fa-03a3-4bd2-ab55-ffebaf56bf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:33.457512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-acf929fa-03a3-4bd2-ab55-ffebaf56bf69 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:33.461028 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-acf929fa-03a3-4bd2-ab55-ffebaf56bf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:33.550493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1023/2021] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:33.563597 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:33.565228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:33.644861 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34413b6c-97c6-425e-a915-d4b6b632b4c3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:33.666729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe67d9-c2cc-4dfa-8c88-fd918c94b37d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:33.667373 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe67d9-c2cc-4dfa-8c88-fd918c94b37d service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:33.667656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe67d9-c2cc-4dfa-8c88-fd918c94b37d service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:33.667928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe67d9-c2cc-4dfa-8c88-fd918c94b37d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:33.679739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe67d9-c2cc-4dfa-8c88-fd918c94b37d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:33.681320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe67d9-c2cc-4dfa-8c88-fd918c94b37d service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:33.694478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 999/2022] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:34.115517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf929fa-03a3-4bd2-ab55-ffebaf56bf69 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:34.117498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-acf929fa-03a3-4bd2-ab55-ffebaf56bf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:34.144506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf929fa-03a3-4bd2-ab55-ffebaf56bf69 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:34.150183 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:34.150908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:34.151188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:34.151461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] PATH_INFO: `/v3/projects/4b14b60411e1402397ee18361dd37d5f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:34.152627 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b14b60411e1402397ee18361dd37d5f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:34.161958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:34.172291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:34.271810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b14b60411e1402397ee18361dd37d5f', 'request_id': 'req-25bdb180-2a97-421d-b71c-b15f5a924fdf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:34.286935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b14b60411e1402397ee18361dd37d5f', 'request_id': 'req-25bdb180-2a97-421d-b71c-b15f5a924fdf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:34.304670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b14b60411e1402397ee18361dd37d5f', 'request_id': 'req-25bdb180-2a97-421d-b71c-b15f5a924fdf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:34.324978 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] The token cache is being invalidate because project 4b14b60411e1402397ee18361dd37d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:34.325488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:34.326227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:34.330131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1024/2023] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:34 2022] DELETE /identity/v3/projects/4b14b60411e1402397ee18361dd37d5f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:34.334562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe67d9-c2cc-4dfa-8c88-fd918c94b37d service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:34.365164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe67d9-c2cc-4dfa-8c88-fd918c94b37d service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:34.478863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7735a7-3142-42f2-ae34-d9e37fb4e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:34.480008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7735a7-3142-42f2-ae34-d9e37fb4e84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:34.480375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7735a7-3142-42f2-ae34-d9e37fb4e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:34.480717 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7735a7-3142-42f2-ae34-d9e37fb4e84c admin admin] PATH_INFO: `/v3/users/b0aabe0d3ba14ea0a5fc66892d9c0bf5` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:34.482201 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7735a7-3142-42f2-ae34-d9e37fb4e84c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0aabe0d3ba14ea0a5fc66892d9c0bf5)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:34.484574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7735a7-3142-42f2-ae34-d9e37fb4e84c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:34.547299 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:34.592169 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ca7735a7-3142-42f2-ae34-d9e37fb4e84c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0aabe0d3ba14ea0a5fc66892d9c0bf5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:34.593356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ca7735a7-3142-42f2-ae34-d9e37fb4e84c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0aabe0d3ba14ea0a5fc66892d9c0bf5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:34.612541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ca7735a7-3142-42f2-ae34-d9e37fb4e84c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0aabe0d3ba14ea0a5fc66892d9c0bf5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:34.631379 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ca7735a7-3142-42f2-ae34-d9e37fb4e84c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0aabe0d3ba14ea0a5fc66892d9c0bf5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:34.632384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ca7735a7-3142-42f2-ae34-d9e37fb4e84c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0aabe0d3ba14ea0a5fc66892d9c0bf5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:34.674533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1000/2024] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:34 2022] DELETE /identity/v3/users/b0aabe0d3ba14ea0a5fc66892d9c0bf5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:35.103683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:35.109552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:35.139302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdb180-2a97-421d-b71c-b15f5a924fdf admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:35.240418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:35.241212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:35.242642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:35.242642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] PATH_INFO: `/v3/projects/f1f54be82dc8431db9f0127184f46c9e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:35.254588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f54be82dc8431db9f0127184f46c9e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:35.254588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:35.256800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74b4e4-fe25-4b6c-bfbb-11065590094f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:35.257147 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74b4e4-fe25-4b6c-bfbb-11065590094f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:35.257489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74b4e4-fe25-4b6c-bfbb-11065590094f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:35.288038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fa74b4e4-fe25-4b6c-bfbb-11065590094f None None] MFA Rules not processed for user `fb6cbee941b24530bb6c1bfd61a64a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:35.289413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fa74b4e4-fe25-4b6c-bfbb-11065590094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:35.307720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f54be82dc8431db9f0127184f46c9e', 'request_id': 'req-3ac7b17a-4102-4f24-a24b-294985f88114'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:35.316774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f54be82dc8431db9f0127184f46c9e', 'request_id': 'req-3ac7b17a-4102-4f24-a24b-294985f88114'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:35.323737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f54be82dc8431db9f0127184f46c9e', 'request_id': 'req-3ac7b17a-4102-4f24-a24b-294985f88114'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:35.341855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] The token cache is being invalidate because project f1f54be82dc8431db9f0127184f46c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:35.342179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:35.343284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:35.347641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1025/2025] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:35 2022] DELETE /identity/v3/projects/f1f54be82dc8431db9f0127184f46c9e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:35.348680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:35.350106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:35.367742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1001/2026] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:35.380909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:35.383688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74b4e4-fe25-4b6c-bfbb-11065590094f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:35.385376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fa74b4e4-fe25-4b6c-bfbb-11065590094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:35.430878 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7b17a-4102-4f24-a24b-294985f88114 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:35.437355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:35.438182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:35.438535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:35.438910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] PATH_INFO: `/v3/users/bf69fbc9712e4f63b7b948cc700e02c9` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:35.440276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf69fbc9712e4f63b7b948cc700e02c9)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:35.442499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:35.487914 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74b4e4-fe25-4b6c-bfbb-11065590094f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:35.523986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf69fbc9712e4f63b7b948cc700e02c9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:35.526614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:35.543866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf69fbc9712e4f63b7b948cc700e02c9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:35.546020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf69fbc9712e4f63b7b948cc700e02c9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:35.560421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf69fbc9712e4f63b7b948cc700e02c9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:35.579460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbdb00-99fd-4d12-aa28-54d9b3dcb5e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:35.580117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbdb00-99fd-4d12-aa28-54d9b3dcb5e4 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:35.580253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf69fbc9712e4f63b7b948cc700e02c9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:35.580376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbdb00-99fd-4d12-aa28-54d9b3dcb5e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:35.580647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbdb00-99fd-4d12-aa28-54d9b3dcb5e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:35.583158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e8bbdb00-99fd-4d12-aa28-54d9b3dcb5e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:35.587232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1026/2027] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:35 2022] DELETE /identity/v3/users/bf69fbc9712e4f63b7b948cc700e02c9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:35.654873 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbdb00-99fd-4d12-aa28-54d9b3dcb5e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:35.656743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbdb00-99fd-4d12-aa28-54d9b3dcb5e4 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:35.672293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1002/2028] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:11:36.095781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:36.097483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:36.210853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4cd81-7d09-4b84-bfb3-d617b73cd03b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:36.215722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:36.216576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:36.217000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:36.217560 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] PATH_INFO: `/v3/projects/883ece4af9714a1da0b9507d8f302fdb` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:36.220484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=883ece4af9714a1da0b9507d8f302fdb)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:36.222656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:36.291484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:36.301011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883ece4af9714a1da0b9507d8f302fdb', 'request_id': 'req-72f05f69-4b32-4137-85b2-5358af792e35'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:36.332180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883ece4af9714a1da0b9507d8f302fdb', 'request_id': 'req-72f05f69-4b32-4137-85b2-5358af792e35'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:36.350367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883ece4af9714a1da0b9507d8f302fdb', 'request_id': 'req-72f05f69-4b32-4137-85b2-5358af792e35'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:36.382444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] The token cache is being invalidate because project 883ece4af9714a1da0b9507d8f302fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:36.382916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:36.385854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72f05f69-4b32-4137-85b2-5358af792e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:36.390986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1027/2029] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:36 2022] DELETE /identity/v3/projects/883ece4af9714a1da0b9507d8f302fdb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:36.392591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d20b7-1356-43d2-957c-72faf45e016b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:36.393047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d20b7-1356-43d2-957c-72faf45e016b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:36.394179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d20b7-1356-43d2-957c-72faf45e016b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:36.450230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-020d20b7-1356-43d2-957c-72faf45e016b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:36.452308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-020d20b7-1356-43d2-957c-72faf45e016b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:36.549557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1003/2030] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:36.557794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0010a1-d5b7-408e-a243-43f19ae87df1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:36.558367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0010a1-d5b7-408e-a243-43f19ae87df1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:36.558820 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0010a1-d5b7-408e-a243-43f19ae87df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:36.582351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cd0010a1-d5b7-408e-a243-43f19ae87df1 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:36.583579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cd0010a1-d5b7-408e-a243-43f19ae87df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:36.601768 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1028/2031] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:36.606471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d20b7-1356-43d2-957c-72faf45e016b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:36.617989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d20b7-1356-43d2-957c-72faf45e016b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:36.624070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054643a2-7546-4957-b76e-6865126a5760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:36.626561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054643a2-7546-4957-b76e-6865126a5760 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:36.626904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054643a2-7546-4957-b76e-6865126a5760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:36.627333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054643a2-7546-4957-b76e-6865126a5760 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:36.628052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054643a2-7546-4957-b76e-6865126a5760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:36.628426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054643a2-7546-4957-b76e-6865126a5760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:36.630081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054643a2-7546-4957-b76e-6865126a5760 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:36.644832 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1004/2032] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:36.651069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0010a1-d5b7-408e-a243-43f19ae87df1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:36.661966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0010a1-d5b7-408e-a243-43f19ae87df1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:36.667750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebaead-96ab-49c3-afc6-a9ec40c68726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:36.668377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebaead-96ab-49c3-afc6-a9ec40c68726 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:36.668649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebaead-96ab-49c3-afc6-a9ec40c68726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:36.668910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebaead-96ab-49c3-afc6-a9ec40c68726 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:36.670408 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebaead-96ab-49c3-afc6-a9ec40c68726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:36.672602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebaead-96ab-49c3-afc6-a9ec40c68726 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:36.743503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1029/2033] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:36 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:36.748386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054643a2-7546-4957-b76e-6865126a5760 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:36.765617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054643a2-7546-4957-b76e-6865126a5760 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:36.912147 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:36.921918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c852f3d-2dbb-4102-9583-4dc6526daf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:36.922682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c852f3d-2dbb-4102-9583-4dc6526daf19 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:36.923179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c852f3d-2dbb-4102-9583-4dc6526daf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:36.923517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c852f3d-2dbb-4102-9583-4dc6526daf19 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:36.924231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c852f3d-2dbb-4102-9583-4dc6526daf19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:36.926395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c852f3d-2dbb-4102-9583-4dc6526daf19 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:36.960689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1005/2034] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:36 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:36.962645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebaead-96ab-49c3-afc6-a9ec40c68726 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:36.973429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebaead-96ab-49c3-afc6-a9ec40c68726 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:36.983767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57d1fd-451d-4733-b6cd-a83fcba95e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:36.984472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d1fd-451d-4733-b6cd-a83fcba95e7d admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:36.984754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d1fd-451d-4733-b6cd-a83fcba95e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:36.985007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d1fd-451d-4733-b6cd-a83fcba95e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:36.985735 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57d1fd-451d-4733-b6cd-a83fcba95e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:36.987347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57d1fd-451d-4733-b6cd-a83fcba95e7d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:37.001689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1030/2035] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:37.003260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c852f3d-2dbb-4102-9583-4dc6526daf19 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:37.016205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c852f3d-2dbb-4102-9583-4dc6526daf19 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:37.021428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c69a04-2031-4b3b-acc0-be19c5d9a557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:37.022137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c69a04-2031-4b3b-acc0-be19c5d9a557 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:37.022419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c69a04-2031-4b3b-acc0-be19c5d9a557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:37.022850 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c69a04-2031-4b3b-acc0-be19c5d9a557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:37.023520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c69a04-2031-4b3b-acc0-be19c5d9a557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:37.025185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c69a04-2031-4b3b-acc0-be19c5d9a557 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:37.038892 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1006/2036] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:37.043515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57d1fd-451d-4733-b6cd-a83fcba95e7d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:37.055020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57d1fd-451d-4733-b6cd-a83fcba95e7d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:37.060258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d1ec-4dfb-4103-a245-017541634a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:37.061176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d1ec-4dfb-4103-a245-017541634a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:37.061587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d1ec-4dfb-4103-a245-017541634a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:37.061970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d1ec-4dfb-4103-a245-017541634a23 admin admin] PATH_INFO: `/v3/projects/8f7ccd7f7ae046f0a9cf3d735fbc88db/users/01308343d2ae4469acdb056a9f186b3d/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:37.082164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508d1ec-4dfb-4103-a245-017541634a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7ccd7f7ae046f0a9cf3d735fbc88db, user_id=01308343d2ae4469acdb056a9f186b3d, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:37.084894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508d1ec-4dfb-4103-a245-017541634a23 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:37.111285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1031/2037] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:37 2022] PUT /identity/v3/projects/8f7ccd7f7ae046f0a9cf3d735fbc88db/users/01308343d2ae4469acdb056a9f186b3d/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:37.130286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296e7f9-c673-4550-aada-992250383d49 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:37.130286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296e7f9-c673-4550-aada-992250383d49 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:37.130286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296e7f9-c673-4550-aada-992250383d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:37.170479 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b296e7f9-c673-4550-aada-992250383d49 None None] MFA Rules not processed for user `01308343d2ae4469acdb056a9f186b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:37.171727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b296e7f9-c673-4550-aada-992250383d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:37.285881 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1007/2038] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:37.299438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d1ec-4dfb-4103-a245-017541634a23 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:37.301236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0508d1ec-4dfb-4103-a245-017541634a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:37.365706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d1ec-4dfb-4103-a245-017541634a23 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:37.371229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16737fe-d5f8-4997-8a51-26d66aa0bf36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:37.372366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16737fe-d5f8-4997-8a51-26d66aa0bf36 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:37.372867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16737fe-d5f8-4997-8a51-26d66aa0bf36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:37.373307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16737fe-d5f8-4997-8a51-26d66aa0bf36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:37.384770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16737fe-d5f8-4997-8a51-26d66aa0bf36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:37.386435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16737fe-d5f8-4997-8a51-26d66aa0bf36 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:37.410018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1032/2039] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:37.899585 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6d8b5-c010-42b6-b2df-d236e46e5ba1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:37.900081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6d8b5-c010-42b6-b2df-d236e46e5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:37.900081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6d8b5-c010-42b6-b2df-d236e46e5ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:37.919797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0ea6d8b5-c010-42b6-b2df-d236e46e5ba1 None None] MFA Rules not processed for user `fb6cbee941b24530bb6c1bfd61a64a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:37.921001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0ea6d8b5-c010-42b6-b2df-d236e46e5ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:38.009086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1008/2040] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:40.636001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16737fe-d5f8-4997-8a51-26d66aa0bf36 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:40.638461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c16737fe-d5f8-4997-8a51-26d66aa0bf36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:40.810921 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16737fe-d5f8-4997-8a51-26d66aa0bf36 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:40.824778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:40.825655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:40.826334 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:40.826754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] PATH_INFO: `/v3/users/103c2ed96ebb4953ade9c5b3f814ff71` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:40.828693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=103c2ed96ebb4953ade9c5b3f814ff71)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:40.832137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:40.862426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:40.969296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103c2ed96ebb4953ade9c5b3f814ff71'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:40.987455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103c2ed96ebb4953ade9c5b3f814ff71'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:40.988308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103c2ed96ebb4953ade9c5b3f814ff71'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:40.998364 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103c2ed96ebb4953ade9c5b3f814ff71'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:41.015374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103c2ed96ebb4953ade9c5b3f814ff71'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:41.030238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1033/2041] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:40 2022] DELETE /identity/v3/users/103c2ed96ebb4953ade9c5b3f814ff71 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:41.035117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aaccb-c3d9-46d3-9f24-45f6206b8b6a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:41.036141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aaccb-c3d9-46d3-9f24-45f6206b8b6a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:41.036649 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aaccb-c3d9-46d3-9f24-45f6206b8b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:41.062459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-476aaccb-c3d9-46d3-9f24-45f6206b8b6a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:41.063996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-476aaccb-c3d9-46d3-9f24-45f6206b8b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:41.140840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1009/2042] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:41.150852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:41.152309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:41.219864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d81dbb-982f-4af7-8641-89a6b0dc5895 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:41.224136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5e61f-3eb2-488f-bf63-60be2ad1ae45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:41.225650 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5e61f-3eb2-488f-bf63-60be2ad1ae45 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:41.226041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5e61f-3eb2-488f-bf63-60be2ad1ae45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:41.226613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5e61f-3eb2-488f-bf63-60be2ad1ae45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:41.241219 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5e61f-3eb2-488f-bf63-60be2ad1ae45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:41.242772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5e61f-3eb2-488f-bf63-60be2ad1ae45 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:41.257383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1034/2043] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:41.714251 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476aaccb-c3d9-46d3-9f24-45f6206b8b6a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:41.716415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-476aaccb-c3d9-46d3-9f24-45f6206b8b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:41.733341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476aaccb-c3d9-46d3-9f24-45f6206b8b6a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:41.739691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:41.741360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:41.742115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:41.742479 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] PATH_INFO: `/v3/users/2581141af0924dc9b2c8390dce2f8b80` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:41.744151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2581141af0924dc9b2c8390dce2f8b80)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:41.749549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:41.754159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:41.809187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2581141af0924dc9b2c8390dce2f8b80'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:41.809924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2581141af0924dc9b2c8390dce2f8b80'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:41.826005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2581141af0924dc9b2c8390dce2f8b80'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:41.836827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2581141af0924dc9b2c8390dce2f8b80'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:41.837945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2581141af0924dc9b2c8390dce2f8b80'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:41.861957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1010/2044] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:41 2022] DELETE /identity/v3/users/2581141af0924dc9b2c8390dce2f8b80 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:41.867120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e606e3d-caa8-4a1c-ae0b-73f5a7fc5c8c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:41.868129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e606e3d-caa8-4a1c-ae0b-73f5a7fc5c8c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:41.868582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e606e3d-caa8-4a1c-ae0b-73f5a7fc5c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:41.889494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:41.891215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:41.905475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0e606e3d-caa8-4a1c-ae0b-73f5a7fc5c8c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:41.906964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0e606e3d-caa8-4a1c-ae0b-73f5a7fc5c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:42.007683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1035/2045] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:42.020936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e606e3d-caa8-4a1c-ae0b-73f5a7fc5c8c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:42.023900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0e606e3d-caa8-4a1c-ae0b-73f5a7fc5c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:42.048272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28830464-72c6-4e7c-bed8-90b33b8df716 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:42.055852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:42.056781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:42.057063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:42.057382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] PATH_INFO: `/v3/projects/223614f7d9004b80afbd55b84e818421` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:42.059375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223614f7d9004b80afbd55b84e818421)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:42.062086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:42.090179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:42.147633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223614f7d9004b80afbd55b84e818421', 'request_id': 'req-0c47f2d8-6696-459e-948d-9eb98b5a2d74'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.158171 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223614f7d9004b80afbd55b84e818421', 'request_id': 'req-0c47f2d8-6696-459e-948d-9eb98b5a2d74'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.172794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e606e3d-caa8-4a1c-ae0b-73f5a7fc5c8c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:42.180171 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223614f7d9004b80afbd55b84e818421', 'request_id': 'req-0c47f2d8-6696-459e-948d-9eb98b5a2d74'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.222358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] The token cache is being invalidate because project 223614f7d9004b80afbd55b84e818421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:42.222682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.223513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.225890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1011/2046] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:41 2022] DELETE /identity/v3/projects/223614f7d9004b80afbd55b84e818421 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:42.230547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:42.232620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:42.257366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:42.279634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c776e-9afb-4209-86af-6ebee59b6f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:42.280426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c776e-9afb-4209-86af-6ebee59b6f0d service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:42.280828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c776e-9afb-4209-86af-6ebee59b6f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:42.281197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c776e-9afb-4209-86af-6ebee59b6f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:42.284354 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-217c776e-9afb-4209-86af-6ebee59b6f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:42.340524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47f2d8-6696-459e-948d-9eb98b5a2d74 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:42.348545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:42.349206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:42.350691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:42.350691 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] PATH_INFO: `/v3/users/0e03488700374e4c82d7ff1b9fb2d41c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:42.351341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e03488700374e4c82d7ff1b9fb2d41c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:42.354950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:42.414316 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c776e-9afb-4209-86af-6ebee59b6f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:42.415803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c776e-9afb-4209-86af-6ebee59b6f0d service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:42.450512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1036/2047] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:42.484650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e03488700374e4c82d7ff1b9fb2d41c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.485689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e03488700374e4c82d7ff1b9fb2d41c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.503387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e03488700374e4c82d7ff1b9fb2d41c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.523965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e03488700374e4c82d7ff1b9fb2d41c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.524880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e03488700374e4c82d7ff1b9fb2d41c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.550896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1012/2048] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:42 2022] DELETE /identity/v3/users/0e03488700374e4c82d7ff1b9fb2d41c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:42.608049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c776e-9afb-4209-86af-6ebee59b6f0d service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:42.609589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-217c776e-9afb-4209-86af-6ebee59b6f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:42.627216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c776e-9afb-4209-86af-6ebee59b6f0d service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:42.707320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:42.708340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:42.709201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:42.710396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] PATH_INFO: `/v3/users/9890876abbee40d1a4b7c486e795dcf7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:42.712784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9890876abbee40d1a4b7c486e795dcf7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:42.716869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:42.812028 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:42.821037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9890876abbee40d1a4b7c486e795dcf7'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.836438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9890876abbee40d1a4b7c486e795dcf7'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.837253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9890876abbee40d1a4b7c486e795dcf7'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.848182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9890876abbee40d1a4b7c486e795dcf7'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.882385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9890876abbee40d1a4b7c486e795dcf7'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:42.895191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1037/2049] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:42 2022] DELETE /identity/v3/users/9890876abbee40d1a4b7c486e795dcf7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:43.010318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:43.012349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:43.050070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1055e-d650-4d9e-b135-d02e2cdaf312 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:43.112806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:43.114454 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:43.114920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:43.116132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.116918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.117493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] PATH_INFO: `/v3/projects/6a5e5830b6b346b7b58e023a2264d16e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.119611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5e5830b6b346b7b58e023a2264d16e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:43.122421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:43.128135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519790c-e60d-4c77-bdad-56a74e91b67f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:43.134242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:43.134988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.135629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.135804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] PATH_INFO: `/v3/projects/4ba20cb6492549019f53af8799e47784` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.137455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba20cb6492549019f53af8799e47784)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:43.139967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:43.173318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:43.187928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5e5830b6b346b7b58e023a2264d16e', 'request_id': 'req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.196292 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5e5830b6b346b7b58e023a2264d16e', 'request_id': 'req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.204832 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5e5830b6b346b7b58e023a2264d16e', 'request_id': 'req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.221306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] The token cache is being invalidate because project 6a5e5830b6b346b7b58e023a2264d16e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:43.221492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba20cb6492549019f53af8799e47784', 'request_id': 'req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.221718 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.222456 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ea2989b9-bc69-4a70-a99d-0d2f2614c01d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.226490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1013/2050] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:43 2022] DELETE /identity/v3/projects/6a5e5830b6b346b7b58e023a2264d16e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:43.231286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6951-bf64-42d2-a329-fc2a52b37cbf None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.231788 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6951-bf64-42d2-a329-fc2a52b37cbf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.232113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6951-bf64-42d2-a329-fc2a52b37cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.235749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba20cb6492549019f53af8799e47784', 'request_id': 'req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.245118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba20cb6492549019f53af8799e47784', 'request_id': 'req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.258266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fe2e6951-bf64-42d2-a329-fc2a52b37cbf None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:43.259563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fe2e6951-bf64-42d2-a329-fc2a52b37cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:43.261286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] The token cache is being invalidate because project 4ba20cb6492549019f53af8799e47784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:43.261800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.262705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c3de9f2-9a8b-4805-9e85-8b05026a13c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.264789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1038/2051] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:43 2022] DELETE /identity/v3/projects/4ba20cb6492549019f53af8799e47784 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:43.269827 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a871d55-802e-4b45-b296-3e74cdb5684c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.270110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a871d55-802e-4b45-b296-3e74cdb5684c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.270400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a871d55-802e-4b45-b296-3e74cdb5684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.300759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1a871d55-802e-4b45-b296-3e74cdb5684c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:43.303593 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1a871d55-802e-4b45-b296-3e74cdb5684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:43.392673 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1014/2052] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:43.393903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e6951-bf64-42d2-a329-fc2a52b37cbf None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:43.396026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fe2e6951-bf64-42d2-a329-fc2a52b37cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:43.411715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e6951-bf64-42d2-a329-fc2a52b37cbf None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:43.417748 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:43.418868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.419868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.420232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] PATH_INFO: `/v3/projects/1161d2aeb2be4f5f847676616372ba0b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.421459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1161d2aeb2be4f5f847676616372ba0b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:43.424034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:43.434447 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1039/2053] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:43.435937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f923c-a35d-42fa-bdc3-77fc691e6d21 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.436231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f923c-a35d-42fa-bdc3-77fc691e6d21 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.436497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f923c-a35d-42fa-bdc3-77fc691e6d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.475856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a72f923c-a35d-42fa-bdc3-77fc691e6d21 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:43.477422 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a72f923c-a35d-42fa-bdc3-77fc691e6d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:43.488286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1040/2054] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:43.490057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682abc2-9d85-4c01-b3a7-b5779850ecd0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.492314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682abc2-9d85-4c01-b3a7-b5779850ecd0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.492638 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682abc2-9d85-4c01-b3a7-b5779850ecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.510550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1161d2aeb2be4f5f847676616372ba0b', 'request_id': 'req-c1c16b8c-1372-4b64-8fe3-7230e93b1212'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.516508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0682abc2-9d85-4c01-b3a7-b5779850ecd0 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:43.516915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1161d2aeb2be4f5f847676616372ba0b', 'request_id': 'req-c1c16b8c-1372-4b64-8fe3-7230e93b1212'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.517951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0682abc2-9d85-4c01-b3a7-b5779850ecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:43.529555 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1161d2aeb2be4f5f847676616372ba0b', 'request_id': 'req-c1c16b8c-1372-4b64-8fe3-7230e93b1212'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.548747 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] The token cache is being invalidate because project 1161d2aeb2be4f5f847676616372ba0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:43.549331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.550109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.552069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1015/2055] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:43 2022] DELETE /identity/v3/projects/1161d2aeb2be4f5f847676616372ba0b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:43.555837 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:43.557974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:43.564645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:43.613993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1041/2056] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:43.616547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682abc2-9d85-4c01-b3a7-b5779850ecd0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:43.618184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0682abc2-9d85-4c01-b3a7-b5779850ecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:43.624916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:43.632310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682abc2-9d85-4c01-b3a7-b5779850ecd0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:43.638438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:43.639262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.639599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.639965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] PATH_INFO: `/v3/users/8b1b274a848541da84e7186367e6d897` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.641277 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1b274a848541da84e7186367e6d897)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:43.643684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:43.645596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c16b8c-1372-4b64-8fe3-7230e93b1212 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:43.652053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4fd2e-a28f-4aa8-8936-4bdcdfe6bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:43.652998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4fd2e-a28f-4aa8-8936-4bdcdfe6bfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.653274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4fd2e-a28f-4aa8-8936-4bdcdfe6bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.653543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4fd2e-a28f-4aa8-8936-4bdcdfe6bfc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.654313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4fd2e-a28f-4aa8-8936-4bdcdfe6bfc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:43.654612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4fd2e-a28f-4aa8-8936-4bdcdfe6bfc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:43.656260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4fd2e-a28f-4aa8-8936-4bdcdfe6bfc3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:43.673602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1016/2057] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:43.674707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4fd2e-a28f-4aa8-8936-4bdcdfe6bfc3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:43.687490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4fd2e-a28f-4aa8-8936-4bdcdfe6bfc3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:43.692884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e02d15-edeb-4ed4-95b5-5ff3c6416dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:43.693670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e02d15-edeb-4ed4-95b5-5ff3c6416dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.694073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e02d15-edeb-4ed4-95b5-5ff3c6416dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.694464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e02d15-edeb-4ed4-95b5-5ff3c6416dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.695107 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e02d15-edeb-4ed4-95b5-5ff3c6416dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:43.695390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e02d15-edeb-4ed4-95b5-5ff3c6416dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:43.697166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e02d15-edeb-4ed4-95b5-5ff3c6416dc0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:43.718974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1017/2058] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:43.718974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e02d15-edeb-4ed4-95b5-5ff3c6416dc0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:43.727365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e02d15-edeb-4ed4-95b5-5ff3c6416dc0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:43.733045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca8d8-d5e5-4664-88d1-254cdd909888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:43.733818 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca8d8-d5e5-4664-88d1-254cdd909888 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.734180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca8d8-d5e5-4664-88d1-254cdd909888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.734457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca8d8-d5e5-4664-88d1-254cdd909888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.735210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ca8d8-d5e5-4664-88d1-254cdd909888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:43.737350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ca8d8-d5e5-4664-88d1-254cdd909888 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:43.749511 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1b274a848541da84e7186367e6d897'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.774450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1018/2059] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:43 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:43.774450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca8d8-d5e5-4664-88d1-254cdd909888 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:43.776194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1b274a848541da84e7186367e6d897'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.777585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1b274a848541da84e7186367e6d897'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.788703 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1b274a848541da84e7186367e6d897'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.808842 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1b274a848541da84e7186367e6d897'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:43.831420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1042/2060] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:43 2022] DELETE /identity/v3/users/8b1b274a848541da84e7186367e6d897 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:43.837080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:43.839487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:43.864570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca8d8-d5e5-4664-88d1-254cdd909888 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:43.962702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b5d9e-cca4-48d1-bac9-5095f8c2e6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:43.963893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b5d9e-cca4-48d1-bac9-5095f8c2e6dc admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:43.963893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b5d9e-cca4-48d1-bac9-5095f8c2e6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:43.963893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b5d9e-cca4-48d1-bac9-5095f8c2e6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:43.964896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b5d9e-cca4-48d1-bac9-5095f8c2e6dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:43.967150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b5d9e-cca4-48d1-bac9-5095f8c2e6dc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.001946 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb927c-601a-4f2e-a51f-16977c32f9ed admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.014086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800d382-ad99-45fc-aa28-e6d35d8af661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.014736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800d382-ad99-45fc-aa28-e6d35d8af661 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.015013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800d382-ad99-45fc-aa28-e6d35d8af661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.015277 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800d382-ad99-45fc-aa28-e6d35d8af661 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.015916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800d382-ad99-45fc-aa28-e6d35d8af661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.018379 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800d382-ad99-45fc-aa28-e6d35d8af661 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.023160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1019/2061] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:43 2022] POST /identity/v3/projects => generated 387 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:44.027444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b5d9e-cca4-48d1-bac9-5095f8c2e6dc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.029224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-561b5d9e-cca4-48d1-bac9-5095f8c2e6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:44.067273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1043/2062] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:43 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:44.075031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800d382-ad99-45fc-aa28-e6d35d8af661 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.090458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800d382-ad99-45fc-aa28-e6d35d8af661 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.128220 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:44.153932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:44.158420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b5d9e-cca4-48d1-bac9-5095f8c2e6dc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.164327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5175c9-7779-4889-95c4-59724863ce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.164989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5175c9-7779-4889-95c4-59724863ce47 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.165264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5175c9-7779-4889-95c4-59724863ce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.165537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5175c9-7779-4889-95c4-59724863ce47 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.166226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5175c9-7779-4889-95c4-59724863ce47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.168132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5175c9-7779-4889-95c4-59724863ce47 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.180847 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9cf93-541c-409c-b92c-b31c8afb6dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.181467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9cf93-541c-409c-b92c-b31c8afb6dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.181935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9cf93-541c-409c-b92c-b31c8afb6dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.182189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9cf93-541c-409c-b92c-b31c8afb6dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.182837 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9cf93-541c-409c-b92c-b31c8afb6dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.184533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9cf93-541c-409c-b92c-b31c8afb6dd3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.195415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1020/2063] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:44 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:11:44.196281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5175c9-7779-4889-95c4-59724863ce47 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.199562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1044/2064] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:44.199562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9cf93-541c-409c-b92c-b31c8afb6dd3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.203825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-aa5175c9-7779-4889-95c4-59724863ce47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:44.212910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9cf93-541c-409c-b92c-b31c8afb6dd3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.217608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768f676-d2cd-4fe8-99bf-dc28cca660f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.218265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768f676-d2cd-4fe8-99bf-dc28cca660f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.218537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768f676-d2cd-4fe8-99bf-dc28cca660f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.218638 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5175c9-7779-4889-95c4-59724863ce47 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.218801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768f676-d2cd-4fe8-99bf-dc28cca660f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.219448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768f676-d2cd-4fe8-99bf-dc28cca660f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.221203 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768f676-d2cd-4fe8-99bf-dc28cca660f9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.223643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.224307 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.224619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.224885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] PATH_INFO: `/v3/projects/3abbd9dd9aeb4e5ebef6e3c6d1fc8a19` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.226153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abbd9dd9aeb4e5ebef6e3c6d1fc8a19)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.228029 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.231712 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1045/2065] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:44.232423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768f676-d2cd-4fe8-99bf-dc28cca660f9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.242865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768f676-d2cd-4fe8-99bf-dc28cca660f9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.247523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc80f2a-7d83-4e44-8734-dd54ec7c2479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.248114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc80f2a-7d83-4e44-8734-dd54ec7c2479 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.248392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc80f2a-7d83-4e44-8734-dd54ec7c2479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.248661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc80f2a-7d83-4e44-8734-dd54ec7c2479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.249439 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc80f2a-7d83-4e44-8734-dd54ec7c2479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.251137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc80f2a-7d83-4e44-8734-dd54ec7c2479 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.262459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1046/2066] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:44.263283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc80f2a-7d83-4e44-8734-dd54ec7c2479 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.273388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc80f2a-7d83-4e44-8734-dd54ec7c2479 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.284340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abbd9dd9aeb4e5ebef6e3c6d1fc8a19', 'request_id': 'req-de98be97-5105-4200-8e23-e8f70b757efc'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:44.290364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abbd9dd9aeb4e5ebef6e3c6d1fc8a19', 'request_id': 'req-de98be97-5105-4200-8e23-e8f70b757efc'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:44.300538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abbd9dd9aeb4e5ebef6e3c6d1fc8a19', 'request_id': 'req-de98be97-5105-4200-8e23-e8f70b757efc'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:44.312595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] The token cache is being invalidate because project 3abbd9dd9aeb4e5ebef6e3c6d1fc8a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:44.312871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:44.313515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:44.315063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1021/2067] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:44 2022] DELETE /identity/v3/projects/3abbd9dd9aeb4e5ebef6e3c6d1fc8a19 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:44.315798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.317086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:44.333360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4e673-341e-436e-8a40-cc9de38063ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.334201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4e673-341e-436e-8a40-cc9de38063ab admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.334484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4e673-341e-436e-8a40-cc9de38063ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.334760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4e673-341e-436e-8a40-cc9de38063ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.335411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4e673-341e-436e-8a40-cc9de38063ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.337004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4e673-341e-436e-8a40-cc9de38063ab admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.346872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1047/2068] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:44.348054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5640e58-1847-4a74-acf1-d8020befefef None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.348454 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5640e58-1847-4a74-acf1-d8020befefef None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.348732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5640e58-1847-4a74-acf1-d8020befefef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.369452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e5640e58-1847-4a74-acf1-d8020befefef None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:44.370925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e5640e58-1847-4a74-acf1-d8020befefef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:44.378674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1048/2069] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:44.379400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5640e58-1847-4a74-acf1-d8020befefef None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.380647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e5640e58-1847-4a74-acf1-d8020befefef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:44.389382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98be97-5105-4200-8e23-e8f70b757efc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.392569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5640e58-1847-4a74-acf1-d8020befefef None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.394669 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6943c8-6c7c-4be3-97d7-e95e525aaedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.395340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6943c8-6c7c-4be3-97d7-e95e525aaedf admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.395592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6943c8-6c7c-4be3-97d7-e95e525aaedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.395968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6943c8-6c7c-4be3-97d7-e95e525aaedf admin admin] PATH_INFO: `/v3/projects/f81fca3fc63e49ce8df059286321c4e8/users/05f61e9232004c30835aa0f03783fcb8/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.397936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28dfc-9168-42b1-9b2f-38b078b38bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.398681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28dfc-9168-42b1-9b2f-38b078b38bea admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.398980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28dfc-9168-42b1-9b2f-38b078b38bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.399271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28dfc-9168-42b1-9b2f-38b078b38bea admin admin] PATH_INFO: `/v3/projects/5dc130bb45384bd4ac35d51f150079e4/users/5a72ce587760424f9ccce19e0841ae6a/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.410911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6943c8-6c7c-4be3-97d7-e95e525aaedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81fca3fc63e49ce8df059286321c4e8, user_id=05f61e9232004c30835aa0f03783fcb8, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.413561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6943c8-6c7c-4be3-97d7-e95e525aaedf admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.414203 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db28dfc-9168-42b1-9b2f-38b078b38bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc130bb45384bd4ac35d51f150079e4, user_id=5a72ce587760424f9ccce19e0841ae6a, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.416855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db28dfc-9168-42b1-9b2f-38b078b38bea admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.428173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1022/2070] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:44 2022] PUT /identity/v3/projects/f81fca3fc63e49ce8df059286321c4e8/users/05f61e9232004c30835aa0f03783fcb8/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:44.433848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1049/2071] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:44 2022] PUT /identity/v3/projects/5dc130bb45384bd4ac35d51f150079e4/users/5a72ce587760424f9ccce19e0841ae6a/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:44.440364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba9c16-7db5-4c6b-ba13-d6991303fc89 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.440666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba9c16-7db5-4c6b-ba13-d6991303fc89 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.440921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba9c16-7db5-4c6b-ba13-d6991303fc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.444009 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e88b-649f-435b-ad9f-ad9678379e04 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.444302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e88b-649f-435b-ad9f-ad9678379e04 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.444716 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e88b-649f-435b-ad9f-ad9678379e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.463095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b7ba9c16-7db5-4c6b-ba13-d6991303fc89 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:44.464452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b7ba9c16-7db5-4c6b-ba13-d6991303fc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:44.475640 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e4b4e88b-649f-435b-ad9f-ad9678379e04 None None] MFA Rules not processed for user `05f61e9232004c30835aa0f03783fcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:44.476920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e4b4e88b-649f-435b-ad9f-ad9678379e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:44.495654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:44.530418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1023/2072] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:44.531747 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff790-d330-47d2-ae46-a413d3c64701 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.532056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff790-d330-47d2-ae46-a413d3c64701 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.532344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff790-d330-47d2-ae46-a413d3c64701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.547085 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1050/2073] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:44.550856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e88b-649f-435b-ad9f-ad9678379e04 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.559374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e88b-649f-435b-ad9f-ad9678379e04 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.561865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4aeff790-d330-47d2-ae46-a413d3c64701 None None] MFA Rules not processed for user `5a72ce587760424f9ccce19e0841ae6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:44.563071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4aeff790-d330-47d2-ae46-a413d3c64701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:44.564285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d5f5b-36ae-4d4e-89d3-4db8e6b85733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.564880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d5f5b-36ae-4d4e-89d3-4db8e6b85733 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.565151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d5f5b-36ae-4d4e-89d3-4db8e6b85733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.565412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d5f5b-36ae-4d4e-89d3-4db8e6b85733 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.566084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d5f5b-36ae-4d4e-89d3-4db8e6b85733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:44.566382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d5f5b-36ae-4d4e-89d3-4db8e6b85733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.567959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d5f5b-36ae-4d4e-89d3-4db8e6b85733 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.569603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:44.581193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1051/2074] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:44.582849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d5f5b-36ae-4d4e-89d3-4db8e6b85733 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.593081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d5f5b-36ae-4d4e-89d3-4db8e6b85733 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.598504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4319-3944-43e6-b862-0e0eb57139d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.599094 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4319-3944-43e6-b862-0e0eb57139d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.599464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4319-3944-43e6-b862-0e0eb57139d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.599781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4319-3944-43e6-b862-0e0eb57139d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.600409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4319-3944-43e6-b862-0e0eb57139d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.602334 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4319-3944-43e6-b862-0e0eb57139d9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.634949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1052/2075] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:44 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:44.634949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4319-3944-43e6-b862-0e0eb57139d9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.635255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1024/2076] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:44.637410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeff790-d330-47d2-ae46-a413d3c64701 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.649350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeff790-d330-47d2-ae46-a413d3c64701 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.700898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4319-3944-43e6-b862-0e0eb57139d9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.705608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3453a-7170-4e27-b7d7-9aedbf01f595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.706512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3453a-7170-4e27-b7d7-9aedbf01f595 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.706801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3453a-7170-4e27-b7d7-9aedbf01f595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.707052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3453a-7170-4e27-b7d7-9aedbf01f595 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.707686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3453a-7170-4e27-b7d7-9aedbf01f595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.708087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca361c2d-8274-445a-be22-a634b87603ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.708744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca361c2d-8274-445a-be22-a634b87603ca admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.709021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca361c2d-8274-445a-be22-a634b87603ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.709400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca361c2d-8274-445a-be22-a634b87603ca admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.710098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca361c2d-8274-445a-be22-a634b87603ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.710340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3453a-7170-4e27-b7d7-9aedbf01f595 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.712026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca361c2d-8274-445a-be22-a634b87603ca admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.738609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1025/2077] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:44 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:11:44.738609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca361c2d-8274-445a-be22-a634b87603ca admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.738609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ca361c2d-8274-445a-be22-a634b87603ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:44.740807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1053/2078] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:44 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:44.741535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3453a-7170-4e27-b7d7-9aedbf01f595 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.795475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca361c2d-8274-445a-be22-a634b87603ca admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.799893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:44.804469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3453a-7170-4e27-b7d7-9aedbf01f595 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.809595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496b715-4e34-405e-84f6-b5602a2c6814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.810236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496b715-4e34-405e-84f6-b5602a2c6814 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.810512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496b715-4e34-405e-84f6-b5602a2c6814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.810780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496b715-4e34-405e-84f6-b5602a2c6814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.811413 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496b715-4e34-405e-84f6-b5602a2c6814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.813037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496b715-4e34-405e-84f6-b5602a2c6814 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.823510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1054/2079] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:44.824302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496b715-4e34-405e-84f6-b5602a2c6814 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.833522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496b715-4e34-405e-84f6-b5602a2c6814 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.838270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19806f8e-496c-4199-862c-23bcd5397bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.838851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19806f8e-496c-4199-862c-23bcd5397bac admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.839128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19806f8e-496c-4199-862c-23bcd5397bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.839397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19806f8e-496c-4199-862c-23bcd5397bac admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.840021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19806f8e-496c-4199-862c-23bcd5397bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.841935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19806f8e-496c-4199-862c-23bcd5397bac admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.848964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fb5fb-9e53-4686-8fd7-8cc2474b419b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.849632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fb5fb-9e53-4686-8fd7-8cc2474b419b service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.849959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fb5fb-9e53-4686-8fd7-8cc2474b419b service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.850199 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fb5fb-9e53-4686-8fd7-8cc2474b419b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.866134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1055/2080] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:44 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:44.867024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19806f8e-496c-4199-862c-23bcd5397bac admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.878229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19806f8e-496c-4199-862c-23bcd5397bac admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:44.885366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5202f54-38e0-4ecb-9ac1-02420aa7b4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:44.886067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5202f54-38e0-4ecb-9ac1-02420aa7b4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:44.886344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5202f54-38e0-4ecb-9ac1-02420aa7b4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:44.886612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5202f54-38e0-4ecb-9ac1-02420aa7b4a2 admin admin] PATH_INFO: `/v3/projects/18e54e71c39e4edd9bdc6671e8131280/users/b273ea45963f4babbedf8ed4071b058a/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:44.902871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5202f54-38e0-4ecb-9ac1-02420aa7b4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e54e71c39e4edd9bdc6671e8131280, user_id=b273ea45963f4babbedf8ed4071b058a, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.905581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5202f54-38e0-4ecb-9ac1-02420aa7b4a2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.911036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fb5fb-9e53-4686-8fd7-8cc2474b419b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:44.912992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fb5fb-9e53-4686-8fd7-8cc2474b419b service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:44.925323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1056/2081] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:44 2022] PUT /identity/v3/projects/18e54e71c39e4edd9bdc6671e8131280/users/b273ea45963f4babbedf8ed4071b058a/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:44.926223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5202f54-38e0-4ecb-9ac1-02420aa7b4a2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.930368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1026/2082] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:44.931195 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fb5fb-9e53-4686-8fd7-8cc2474b419b service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:44.942479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:44.944217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fb5fb-9e53-4686-8fd7-8cc2474b419b service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:45.007541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5202f54-38e0-4ecb-9ac1-02420aa7b4a2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:45.012642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb06ba-9681-4a95-a4b9-b73e783f0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:45.013460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb06ba-9681-4a95-a4b9-b73e783f0bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.013745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb06ba-9681-4a95-a4b9-b73e783f0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.014041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb06ba-9681-4a95-a4b9-b73e783f0bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.014691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb06ba-9681-4a95-a4b9-b73e783f0bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:45.016988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb06ba-9681-4a95-a4b9-b73e783f0bc8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:45.025261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c570b-af7d-405c-a10d-2d71ae06d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:45.026059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c570b-af7d-405c-a10d-2d71ae06d241 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.026344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c570b-af7d-405c-a10d-2d71ae06d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.026763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c570b-af7d-405c-a10d-2d71ae06d241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.027471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c570b-af7d-405c-a10d-2d71ae06d241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:45.029350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c570b-af7d-405c-a10d-2d71ae06d241 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:45.030077 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1057/2083] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:45.034052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb06ba-9681-4a95-a4b9-b73e783f0bc8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:45.045126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1027/2084] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:45.046366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c570b-af7d-405c-a10d-2d71ae06d241 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:45.046863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb06ba-9681-4a95-a4b9-b73e783f0bc8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:45.053225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab5a4d-98f1-44ba-a908-da2c08517d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:45.054271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab5a4d-98f1-44ba-a908-da2c08517d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.054546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab5a4d-98f1-44ba-a908-da2c08517d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.055094 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab5a4d-98f1-44ba-a908-da2c08517d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.055759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab5a4d-98f1-44ba-a908-da2c08517d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:45.057353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab5a4d-98f1-44ba-a908-da2c08517d4c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:45.059264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c570b-af7d-405c-a10d-2d71ae06d241 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:45.068924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec1bb-1d72-4ba8-aa90-1fdff63b0ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:45.069191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1058/2085] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:45.069907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec1bb-1d72-4ba8-aa90-1fdff63b0ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.070256 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec1bb-1d72-4ba8-aa90-1fdff63b0ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.070600 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec1bb-1d72-4ba8-aa90-1fdff63b0ffa admin admin] PATH_INFO: `/v3/projects/18e54e71c39e4edd9bdc6671e8131280/users/b273ea45963f4babbedf8ed4071b058a/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.073641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ec1bb-1d72-4ba8-aa90-1fdff63b0ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e54e71c39e4edd9bdc6671e8131280, user_id=b273ea45963f4babbedf8ed4071b058a, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:45.073767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab5a4d-98f1-44ba-a908-da2c08517d4c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:45.076752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ec1bb-1d72-4ba8-aa90-1fdff63b0ffa admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:45.087273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab5a4d-98f1-44ba-a908-da2c08517d4c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:45.088572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1028/2086] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:45 2022] PUT /identity/v3/projects/18e54e71c39e4edd9bdc6671e8131280/users/b273ea45963f4babbedf8ed4071b058a/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:45.098923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34add06b-edea-4e02-86dd-b81945d844f4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.099340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34add06b-edea-4e02-86dd-b81945d844f4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.099688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34add06b-edea-4e02-86dd-b81945d844f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.135745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-34add06b-edea-4e02-86dd-b81945d844f4 None None] MFA Rules not processed for user `b273ea45963f4babbedf8ed4071b058a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:45.137244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-34add06b-edea-4e02-86dd-b81945d844f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:45.158692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e18dcb-c7d0-4f9e-92ee-05e6104d7f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:45.159378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e18dcb-c7d0-4f9e-92ee-05e6104d7f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.159660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e18dcb-c7d0-4f9e-92ee-05e6104d7f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.160031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e18dcb-c7d0-4f9e-92ee-05e6104d7f45 admin admin] PATH_INFO: `/v3/projects/90b061bbd76a43bfb3bb7d75241d14fd/users/10bf92107faa41cc872b234580a68886/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.179755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:45.182939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e18dcb-c7d0-4f9e-92ee-05e6104d7f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b061bbd76a43bfb3bb7d75241d14fd, user_id=10bf92107faa41cc872b234580a68886, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:45.185881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e18dcb-c7d0-4f9e-92ee-05e6104d7f45 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:45.207079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1059/2087] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:45 2022] PUT /identity/v3/projects/90b061bbd76a43bfb3bb7d75241d14fd/users/10bf92107faa41cc872b234580a68886/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:45.223502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0749-e735-43ca-aab0-5ba6e952fe9d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.223796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0749-e735-43ca-aab0-5ba6e952fe9d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.224131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0749-e735-43ca-aab0-5ba6e952fe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.261918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1029/2088] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:45.294223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6eee0749-e735-43ca-aab0-5ba6e952fe9d None None] MFA Rules not processed for user `10bf92107faa41cc872b234580a68886`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:45.296157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6eee0749-e735-43ca-aab0-5ba6e952fe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:45.315818 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34add06b-edea-4e02-86dd-b81945d844f4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:45.423852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1060/2089] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:45.426425 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0749-e735-43ca-aab0-5ba6e952fe9d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:45.429825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34add06b-edea-4e02-86dd-b81945d844f4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:45.451199 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:45.538654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f32c1-a6ec-4536-8b05-d13a3f22b160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:45.539803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f32c1-a6ec-4536-8b05-d13a3f22b160 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.541323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f32c1-a6ec-4536-8b05-d13a3f22b160 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.541690 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f32c1-a6ec-4536-8b05-d13a3f22b160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.572987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0749-e735-43ca-aab0-5ba6e952fe9d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:45.578491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b5845-563e-44d4-8cf8-1d012ed211cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:45.579283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5845-563e-44d4-8cf8-1d012ed211cb admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.579678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5845-563e-44d4-8cf8-1d012ed211cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.580039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5845-563e-44d4-8cf8-1d012ed211cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.582558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b5845-563e-44d4-8cf8-1d012ed211cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:45.584694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b5845-563e-44d4-8cf8-1d012ed211cb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:45.629096 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1061/2090] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:45 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:45.630056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b5845-563e-44d4-8cf8-1d012ed211cb admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:45.633532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f32c1-a6ec-4536-8b05-d13a3f22b160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:45.650087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f32c1-a6ec-4536-8b05-d13a3f22b160 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:45.651137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1030/2091] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:45.733431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b5845-563e-44d4-8cf8-1d012ed211cb admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:45.738486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917dc5a-5349-4fd1-bcb0-c0476bec507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:45.739109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917dc5a-5349-4fd1-bcb0-c0476bec507b admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.739381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917dc5a-5349-4fd1-bcb0-c0476bec507b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.739645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917dc5a-5349-4fd1-bcb0-c0476bec507b admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.740584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917dc5a-5349-4fd1-bcb0-c0476bec507b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:45.742523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917dc5a-5349-4fd1-bcb0-c0476bec507b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:45.769372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1062/2092] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:45 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:45.774163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f32c1-a6ec-4536-8b05-d13a3f22b160 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:45.785142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f32c1-a6ec-4536-8b05-d13a3f22b160 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:45.790231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e378adf-741f-4a6f-b8a9-7ec6be7be2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:45.791070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e378adf-741f-4a6f-b8a9-7ec6be7be2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.791350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e378adf-741f-4a6f-b8a9-7ec6be7be2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.791741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e378adf-741f-4a6f-b8a9-7ec6be7be2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.792490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e378adf-741f-4a6f-b8a9-7ec6be7be2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:45.794342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e378adf-741f-4a6f-b8a9-7ec6be7be2c0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:45.805473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1031/2093] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:45.809960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917dc5a-5349-4fd1-bcb0-c0476bec507b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:45.820652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917dc5a-5349-4fd1-bcb0-c0476bec507b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:45.825899 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b16f73-e854-4e19-93eb-73418aac9564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:45.826653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b16f73-e854-4e19-93eb-73418aac9564 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.827025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b16f73-e854-4e19-93eb-73418aac9564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.827412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b16f73-e854-4e19-93eb-73418aac9564 admin admin] PATH_INFO: `/v3/projects/b89d28a93e8242e390ede630eb377c64/users/914f3580d1764be59da9405cc992b492/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.844165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b16f73-e854-4e19-93eb-73418aac9564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89d28a93e8242e390ede630eb377c64, user_id=914f3580d1764be59da9405cc992b492, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:45.846957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b16f73-e854-4e19-93eb-73418aac9564 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:45.863588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1063/2094] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:45 2022] PUT /identity/v3/projects/b89d28a93e8242e390ede630eb377c64/users/914f3580d1764be59da9405cc992b492/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:45.868072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e378adf-741f-4a6f-b8a9-7ec6be7be2c0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:45.878839 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e378adf-741f-4a6f-b8a9-7ec6be7be2c0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:45.917531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:45.967131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d9feb-0037-4c5e-b4cf-7b43e7fca097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:45.967753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9feb-0037-4c5e-b4cf-7b43e7fca097 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:45.968024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9feb-0037-4c5e-b4cf-7b43e7fca097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:45.968288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9feb-0037-4c5e-b4cf-7b43e7fca097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:45.968968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d9feb-0037-4c5e-b4cf-7b43e7fca097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:45.970796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d9feb-0037-4c5e-b4cf-7b43e7fca097 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:45.984140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1032/2095] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:45.988100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b16f73-e854-4e19-93eb-73418aac9564 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:46.000440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b16f73-e854-4e19-93eb-73418aac9564 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:46.015853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6350baa-a833-454b-8080-c65e367fd809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:46.016674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6350baa-a833-454b-8080-c65e367fd809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:46.016943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6350baa-a833-454b-8080-c65e367fd809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:46.017281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6350baa-a833-454b-8080-c65e367fd809 admin admin] PATH_INFO: `/v3/projects/b89d28a93e8242e390ede630eb377c64/users/914f3580d1764be59da9405cc992b492/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:46.019808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6350baa-a833-454b-8080-c65e367fd809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89d28a93e8242e390ede630eb377c64, user_id=914f3580d1764be59da9405cc992b492, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:46.023443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6350baa-a833-454b-8080-c65e367fd809 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:46.035900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1064/2096] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:45 2022] PUT /identity/v3/projects/b89d28a93e8242e390ede630eb377c64/users/914f3580d1764be59da9405cc992b492/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:46.047033 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5537349-b274-4d47-8c27-c4c97ca54e78 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:46.047345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5537349-b274-4d47-8c27-c4c97ca54e78 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:46.047618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5537349-b274-4d47-8c27-c4c97ca54e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:46.079189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b5537349-b274-4d47-8c27-c4c97ca54e78 None None] MFA Rules not processed for user `914f3580d1764be59da9405cc992b492`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:46.080836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b5537349-b274-4d47-8c27-c4c97ca54e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:46.150440 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1033/2097] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:46.161984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6350baa-a833-454b-8080-c65e367fd809 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:46.216307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:46.222345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6350baa-a833-454b-8080-c65e367fd809 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:46.226817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2407fe1-8c15-4e2e-863e-e1315299ef62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:46.227693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2407fe1-8c15-4e2e-863e-e1315299ef62 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:46.228498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2407fe1-8c15-4e2e-863e-e1315299ef62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:46.228775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2407fe1-8c15-4e2e-863e-e1315299ef62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:46.287322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2407fe1-8c15-4e2e-863e-e1315299ef62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:46.288780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2407fe1-8c15-4e2e-863e-e1315299ef62 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:46.298393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1065/2098] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:47.108675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5537349-b274-4d47-8c27-c4c97ca54e78 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:47.111206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b5537349-b274-4d47-8c27-c4c97ca54e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:47.126410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5537349-b274-4d47-8c27-c4c97ca54e78 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:47.130169 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda3737-1ad2-415e-bf7d-51635152dd30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:47.130929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda3737-1ad2-415e-bf7d-51635152dd30 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:47.131046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda3737-1ad2-415e-bf7d-51635152dd30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:47.131304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda3737-1ad2-415e-bf7d-51635152dd30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:47.223897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda3737-1ad2-415e-bf7d-51635152dd30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:47.225205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda3737-1ad2-415e-bf7d-51635152dd30 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:47.235788 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1034/2099] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:11:50.852175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2407fe1-8c15-4e2e-863e-e1315299ef62 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:50.863142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2407fe1-8c15-4e2e-863e-e1315299ef62 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:50.869310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651151-ec53-4fd8-8aba-e373c9bbc4ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:50.870725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651151-ec53-4fd8-8aba-e373c9bbc4ac service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:50.871091 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651151-ec53-4fd8-8aba-e373c9bbc4ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:50.871476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651151-ec53-4fd8-8aba-e373c9bbc4ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:50.887299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef651151-ec53-4fd8-8aba-e373c9bbc4ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:50.888932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef651151-ec53-4fd8-8aba-e373c9bbc4ac service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:50.908436 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1066/2100] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:51.346757 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda3737-1ad2-415e-bf7d-51635152dd30 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:51.418359 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:51.438276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda3737-1ad2-415e-bf7d-51635152dd30 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:51.443853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:51.444730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:51.445155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:51.445693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] PATH_INFO: `/v3/users/05f61e9232004c30835aa0f03783fcb8` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:51.447111 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f61e9232004c30835aa0f03783fcb8)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:51.451096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:51.503047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f61e9232004c30835aa0f03783fcb8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:51.503703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f61e9232004c30835aa0f03783fcb8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:51.514464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f61e9232004c30835aa0f03783fcb8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:51.522418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f61e9232004c30835aa0f03783fcb8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:51.523215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f61e9232004c30835aa0f03783fcb8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:51.540941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1035/2101] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:51 2022] DELETE /identity/v3/users/05f61e9232004c30835aa0f03783fcb8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:51.545584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767420-28a6-4704-a49e-6a592a4b5eb1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:51.545915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767420-28a6-4704-a49e-6a592a4b5eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:51.546185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767420-28a6-4704-a49e-6a592a4b5eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:51.565599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-94767420-28a6-4704-a49e-6a592a4b5eb1 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:51.566976 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-94767420-28a6-4704-a49e-6a592a4b5eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:51.627328 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1067/2102] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:51.638432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:51.639935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:51.706726 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75ded4-5200-4bdb-8201-03b46736f848 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:51.711202 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af28c0-0fe2-439a-b72a-a7261d13f855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:51.711814 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af28c0-0fe2-439a-b72a-a7261d13f855 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:51.712070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af28c0-0fe2-439a-b72a-a7261d13f855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:51.712305 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af28c0-0fe2-439a-b72a-a7261d13f855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:51.723663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af28c0-0fe2-439a-b72a-a7261d13f855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:51.725259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af28c0-0fe2-439a-b72a-a7261d13f855 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:51.737488 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1036/2103] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:52.042982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94767420-28a6-4704-a49e-6a592a4b5eb1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:52.044570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-94767420-28a6-4704-a49e-6a592a4b5eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:52.056757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94767420-28a6-4704-a49e-6a592a4b5eb1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:52.062657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:52.063192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:52.063476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:52.063713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] PATH_INFO: `/v3/projects/f81fca3fc63e49ce8df059286321c4e8` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:52.064958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81fca3fc63e49ce8df059286321c4e8)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:52.066904 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:52.128369 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81fca3fc63e49ce8df059286321c4e8', 'request_id': 'req-79bc98ba-dfb9-466e-93b1-eaa482280e6b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.143658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81fca3fc63e49ce8df059286321c4e8', 'request_id': 'req-79bc98ba-dfb9-466e-93b1-eaa482280e6b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.149901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81fca3fc63e49ce8df059286321c4e8', 'request_id': 'req-79bc98ba-dfb9-466e-93b1-eaa482280e6b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.161756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] The token cache is being invalidate because project f81fca3fc63e49ce8df059286321c4e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:52.162217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.162965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.165051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1068/2104] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:52 2022] DELETE /identity/v3/projects/f81fca3fc63e49ce8df059286321c4e8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:52.169023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af28c0-0fe2-439a-b72a-a7261d13f855 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:52.181204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af28c0-0fe2-439a-b72a-a7261d13f855 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:52.244242 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e6f34-76af-4038-b221-efd6d64b2d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:52.245173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6f34-76af-4038-b221-efd6d64b2d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:52.245605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6f34-76af-4038-b221-efd6d64b2d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:52.245898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6f34-76af-4038-b221-efd6d64b2d44 admin admin] PATH_INFO: `/v3/users/b273ea45963f4babbedf8ed4071b058a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:52.247418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e6f34-76af-4038-b221-efd6d64b2d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b273ea45963f4babbedf8ed4071b058a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:52.249026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e6f34-76af-4038-b221-efd6d64b2d44 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:52.265639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:52.318872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c35e6f34-76af-4038-b221-efd6d64b2d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b273ea45963f4babbedf8ed4071b058a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.319534 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c35e6f34-76af-4038-b221-efd6d64b2d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b273ea45963f4babbedf8ed4071b058a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.332210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c35e6f34-76af-4038-b221-efd6d64b2d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b273ea45963f4babbedf8ed4071b058a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.340419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c35e6f34-76af-4038-b221-efd6d64b2d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b273ea45963f4babbedf8ed4071b058a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.341067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c35e6f34-76af-4038-b221-efd6d64b2d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b273ea45963f4babbedf8ed4071b058a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.360738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1037/2105] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:52 2022] DELETE /identity/v3/users/b273ea45963f4babbedf8ed4071b058a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:52.673527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:52.675318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:52.706913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc98ba-dfb9-466e-93b1-eaa482280e6b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:52.716430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:52.771103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:52.771749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:52.772038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:52.772296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] PATH_INFO: `/v3/projects/18e54e71c39e4edd9bdc6671e8131280` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:52.773624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e54e71c39e4edd9bdc6671e8131280)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:52.775583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:52.827473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e54e71c39e4edd9bdc6671e8131280', 'request_id': 'req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.836183 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e54e71c39e4edd9bdc6671e8131280', 'request_id': 'req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.842523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e54e71c39e4edd9bdc6671e8131280', 'request_id': 'req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.855370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] The token cache is being invalidate because project 18e54e71c39e4edd9bdc6671e8131280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:52.855750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.856428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-fa8284f9-96e5-4dc9-be1a-55961c5c59e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:52.858320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1069/2106] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:52 2022] DELETE /identity/v3/projects/18e54e71c39e4edd9bdc6671e8131280 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:52.864086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6c0f-b590-42d8-8ce1-fec630726165 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:52.864443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6c0f-b590-42d8-8ce1-fec630726165 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:52.864826 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6c0f-b590-42d8-8ce1-fec630726165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:52.890501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8cbe6c0f-b590-42d8-8ce1-fec630726165 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:52.891979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8cbe6c0f-b590-42d8-8ce1-fec630726165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:52.958774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1038/2107] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:52.968031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b0e7c-6da2-487e-9f0f-04d592ace1d2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:52.968031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b0e7c-6da2-487e-9f0f-04d592ace1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:52.968031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b0e7c-6da2-487e-9f0f-04d592ace1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:52.989990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7f6b0e7c-6da2-487e-9f0f-04d592ace1d2 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:52.991312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7f6b0e7c-6da2-487e-9f0f-04d592ace1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:53.001908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1070/2108] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:53.006549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe6c0f-b590-42d8-8ce1-fec630726165 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.017153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe6c0f-b590-42d8-8ce1-fec630726165 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.022702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c407e0-e186-44e8-8925-2a40db88b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.023564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c407e0-e186-44e8-8925-2a40db88b90e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.023944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c407e0-e186-44e8-8925-2a40db88b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.024210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c407e0-e186-44e8-8925-2a40db88b90e admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.024937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c407e0-e186-44e8-8925-2a40db88b90e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:53.025268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c407e0-e186-44e8-8925-2a40db88b90e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.027213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c407e0-e186-44e8-8925-2a40db88b90e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:53.043905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1039/2109] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:53.048668 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b0e7c-6da2-487e-9f0f-04d592ace1d2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.058784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b0e7c-6da2-487e-9f0f-04d592ace1d2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.063666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3094e-3bd6-49c1-b71a-fb0f8ef3d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.064327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3094e-3bd6-49c1-b71a-fb0f8ef3d992 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.064606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3094e-3bd6-49c1-b71a-fb0f8ef3d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.064868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3094e-3bd6-49c1-b71a-fb0f8ef3d992 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.065506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3094e-3bd6-49c1-b71a-fb0f8ef3d992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.067562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3094e-3bd6-49c1-b71a-fb0f8ef3d992 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:53.104808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1071/2110] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:53 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:53.109111 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c407e0-e186-44e8-8925-2a40db88b90e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.122442 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c407e0-e186-44e8-8925-2a40db88b90e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.185384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dead94e-1962-4a98-a346-e015dfb10c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.185942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dead94e-1962-4a98-a346-e015dfb10c1b admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.186219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dead94e-1962-4a98-a346-e015dfb10c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.186489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dead94e-1962-4a98-a346-e015dfb10c1b admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.187120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dead94e-1962-4a98-a346-e015dfb10c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.189067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dead94e-1962-4a98-a346-e015dfb10c1b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:53.216972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1040/2111] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:53 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:53.221737 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3094e-3bd6-49c1-b71a-fb0f8ef3d992 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.237951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3094e-3bd6-49c1-b71a-fb0f8ef3d992 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.244564 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05530-ad99-4d48-b838-3f6744427858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.245176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05530-ad99-4d48-b838-3f6744427858 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.245450 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05530-ad99-4d48-b838-3f6744427858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.245717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05530-ad99-4d48-b838-3f6744427858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.246409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec05530-ad99-4d48-b838-3f6744427858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.248025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec05530-ad99-4d48-b838-3f6744427858 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:53.260368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1072/2112] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:53.264966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dead94e-1962-4a98-a346-e015dfb10c1b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.271864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:53.276471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dead94e-1962-4a98-a346-e015dfb10c1b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.283418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea449e3-5171-4528-bc31-c94d896b699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.284059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea449e3-5171-4528-bc31-c94d896b699c admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.284370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea449e3-5171-4528-bc31-c94d896b699c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.284700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea449e3-5171-4528-bc31-c94d896b699c admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.285685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea449e3-5171-4528-bc31-c94d896b699c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.287921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea449e3-5171-4528-bc31-c94d896b699c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:53.299234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1041/2113] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:53.303702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05530-ad99-4d48-b838-3f6744427858 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.314685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05530-ad99-4d48-b838-3f6744427858 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.321625 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d614f-2bac-49d8-a016-d32b295d9f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.322309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d614f-2bac-49d8-a016-d32b295d9f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.322580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d614f-2bac-49d8-a016-d32b295d9f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.322843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d614f-2bac-49d8-a016-d32b295d9f21 admin admin] PATH_INFO: `/v3/projects/c67210b0903c4c6ea8819d2e89d12f62/users/f254a2dff8bb49a39208127ad4c2b448/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.344479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d614f-2bac-49d8-a016-d32b295d9f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67210b0903c4c6ea8819d2e89d12f62, user_id=f254a2dff8bb49a39208127ad4c2b448, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.347232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d614f-2bac-49d8-a016-d32b295d9f21 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:53.374824 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1073/2114] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:53 2022] PUT /identity/v3/projects/c67210b0903c4c6ea8819d2e89d12f62/users/f254a2dff8bb49a39208127ad4c2b448/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:53.388688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9288c-b60b-40ca-89ca-bad83abd6f45 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.389250 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9288c-b60b-40ca-89ca-bad83abd6f45 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.389250 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9288c-b60b-40ca-89ca-bad83abd6f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.421217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d7a9288c-b60b-40ca-89ca-bad83abd6f45 None None] MFA Rules not processed for user `f254a2dff8bb49a39208127ad4c2b448`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:53.422473 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d7a9288c-b60b-40ca-89ca-bad83abd6f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:53.497574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1042/2115] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:53.502894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d614f-2bac-49d8-a016-d32b295d9f21 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.562956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:53.586885 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d614f-2bac-49d8-a016-d32b295d9f21 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.591752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b68b7-143f-4e5c-976c-5d3838b30be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.592362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b68b7-143f-4e5c-976c-5d3838b30be8 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.592639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b68b7-143f-4e5c-976c-5d3838b30be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.592903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b68b7-143f-4e5c-976c-5d3838b30be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.593539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b68b7-143f-4e5c-976c-5d3838b30be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.595525 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b68b7-143f-4e5c-976c-5d3838b30be8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:53.627676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1074/2116] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:53 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:11:53.628848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9288c-b60b-40ca-89ca-bad83abd6f45 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.639832 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9288c-b60b-40ca-89ca-bad83abd6f45 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.717196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35381e-eb38-40c4-a181-5ad82961ff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.718132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35381e-eb38-40c4-a181-5ad82961ff57 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.718507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35381e-eb38-40c4-a181-5ad82961ff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.718976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35381e-eb38-40c4-a181-5ad82961ff57 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.719695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35381e-eb38-40c4-a181-5ad82961ff57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.721744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35381e-eb38-40c4-a181-5ad82961ff57 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:53.749495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1043/2117] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:53 2022] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:53.753670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b68b7-143f-4e5c-976c-5d3838b30be8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.771137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b68b7-143f-4e5c-976c-5d3838b30be8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.779318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542d97-7107-4d58-a620-44bd5227d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.781617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542d97-7107-4d58-a620-44bd5227d4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.782072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542d97-7107-4d58-a620-44bd5227d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.782697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542d97-7107-4d58-a620-44bd5227d4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.783696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a542d97-7107-4d58-a620-44bd5227d4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.785548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a542d97-7107-4d58-a620-44bd5227d4d8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:53.799923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1075/2118] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:53.804829 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35381e-eb38-40c4-a181-5ad82961ff57 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.817183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35381e-eb38-40c4-a181-5ad82961ff57 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.826336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb92b1-9c2f-4049-9b52-743f0b94fe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.827267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb92b1-9c2f-4049-9b52-743f0b94fe4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.827642 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb92b1-9c2f-4049-9b52-743f0b94fe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.828032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb92b1-9c2f-4049-9b52-743f0b94fe4d admin admin] PATH_INFO: `/v3/projects/d356f398798e49b0af8e8cd7037fd117/users/d824441a66b644d3b1cba19479567653/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.845594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb92b1-9c2f-4049-9b52-743f0b94fe4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d356f398798e49b0af8e8cd7037fd117, user_id=d824441a66b644d3b1cba19479567653, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.849498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb92b1-9c2f-4049-9b52-743f0b94fe4d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:53.867743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1044/2119] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:53 2022] PUT /identity/v3/projects/d356f398798e49b0af8e8cd7037fd117/users/d824441a66b644d3b1cba19479567653/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:53.871528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542d97-7107-4d58-a620-44bd5227d4d8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.884030 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542d97-7107-4d58-a620-44bd5227d4d8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.947540 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2726c1-5086-45b1-9262-7deff3f5b708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.948528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2726c1-5086-45b1-9262-7deff3f5b708 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.948528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2726c1-5086-45b1-9262-7deff3f5b708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.948734 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2726c1-5086-45b1-9262-7deff3f5b708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.949442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2726c1-5086-45b1-9262-7deff3f5b708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.951157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2726c1-5086-45b1-9262-7deff3f5b708 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:53.961763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1076/2120] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:53.966226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb92b1-9c2f-4049-9b52-743f0b94fe4d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:53.977047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb92b1-9c2f-4049-9b52-743f0b94fe4d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:53.982481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766729a-e72b-41c6-9ed0-57c5eabfa34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:53.983149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766729a-e72b-41c6-9ed0-57c5eabfa34c admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:53.983450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766729a-e72b-41c6-9ed0-57c5eabfa34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:53.983739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766729a-e72b-41c6-9ed0-57c5eabfa34c admin admin] PATH_INFO: `/v3/projects/d356f398798e49b0af8e8cd7037fd117/users/d824441a66b644d3b1cba19479567653/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:53.985872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766729a-e72b-41c6-9ed0-57c5eabfa34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d356f398798e49b0af8e8cd7037fd117, user_id=d824441a66b644d3b1cba19479567653, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:53.988584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766729a-e72b-41c6-9ed0-57c5eabfa34c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:54.000266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1045/2121] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:53 2022] PUT /identity/v3/projects/d356f398798e49b0af8e8cd7037fd117/users/d824441a66b644d3b1cba19479567653/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:54.012246 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f666d8-a813-4cf0-af10-297cd6f8d3f2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:54.012792 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f666d8-a813-4cf0-af10-297cd6f8d3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:54.013108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f666d8-a813-4cf0-af10-297cd6f8d3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:54.052452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-72f666d8-a813-4cf0-af10-297cd6f8d3f2 None None] MFA Rules not processed for user `d824441a66b644d3b1cba19479567653`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:54.053691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-72f666d8-a813-4cf0-af10-297cd6f8d3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:54.136057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1077/2122] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:54.146260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766729a-e72b-41c6-9ed0-57c5eabfa34c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:54.149493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e766729a-e72b-41c6-9ed0-57c5eabfa34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:54.199726 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:54.216163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766729a-e72b-41c6-9ed0-57c5eabfa34c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:54.219934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356b33a-90d7-455b-8ed4-ed5075a5cc07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:54.220539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356b33a-90d7-455b-8ed4-ed5075a5cc07 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:54.220814 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356b33a-90d7-455b-8ed4-ed5075a5cc07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:54.221075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356b33a-90d7-455b-8ed4-ed5075a5cc07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:54.231549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356b33a-90d7-455b-8ed4-ed5075a5cc07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:54.232910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356b33a-90d7-455b-8ed4-ed5075a5cc07 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:54.243319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1046/2123] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:54.350991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f666d8-a813-4cf0-af10-297cd6f8d3f2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:54.362297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f666d8-a813-4cf0-af10-297cd6f8d3f2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:54.365921 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b7978-e22a-425f-b8c4-08551a63039a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:54.366613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7978-e22a-425f-b8c4-08551a63039a service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:54.366963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7978-e22a-425f-b8c4-08551a63039a service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:54.367302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7978-e22a-425f-b8c4-08551a63039a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:54.402863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:54.436169 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b7978-e22a-425f-b8c4-08551a63039a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:54.438964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b7978-e22a-425f-b8c4-08551a63039a service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:54.450503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1078/2124] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:56.033480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356b33a-90d7-455b-8ed4-ed5075a5cc07 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:56.035344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5356b33a-90d7-455b-8ed4-ed5075a5cc07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:56.117733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b7978-e22a-425f-b8c4-08551a63039a service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:56.119461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e45b7978-e22a-425f-b8c4-08551a63039a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:56.131479 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356b33a-90d7-455b-8ed4-ed5075a5cc07 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:56.135202 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b7978-e22a-425f-b8c4-08551a63039a service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:56.137555 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa36294-7b90-41ea-aced-dc5c4392345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:56.138238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa36294-7b90-41ea-aced-dc5c4392345d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:56.138515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa36294-7b90-41ea-aced-dc5c4392345d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:56.138838 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa36294-7b90-41ea-aced-dc5c4392345d admin admin] PATH_INFO: `/v3/users/5a72ce587760424f9ccce19e0841ae6a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:56.140231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa36294-7b90-41ea-aced-dc5c4392345d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a72ce587760424f9ccce19e0841ae6a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:56.141528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d6226-7320-4de7-8011-8364575aa2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:56.142472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6226-7320-4de7-8011-8364575aa2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:56.142617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6226-7320-4de7-8011-8364575aa2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:56.142890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa36294-7b90-41ea-aced-dc5c4392345d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:56.143165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6226-7320-4de7-8011-8364575aa2fa admin admin] PATH_INFO: `/v3/users/10bf92107faa41cc872b234580a68886` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:56.144315 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d6226-7320-4de7-8011-8364575aa2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=10bf92107faa41cc872b234580a68886)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:56.146743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d6226-7320-4de7-8011-8364575aa2fa admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:56.205449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9fa36294-7b90-41ea-aced-dc5c4392345d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a72ce587760424f9ccce19e0841ae6a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.206221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9fa36294-7b90-41ea-aced-dc5c4392345d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a72ce587760424f9ccce19e0841ae6a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.208546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e53d6226-7320-4de7-8011-8364575aa2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10bf92107faa41cc872b234580a68886'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.216588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9fa36294-7b90-41ea-aced-dc5c4392345d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a72ce587760424f9ccce19e0841ae6a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.219102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e53d6226-7320-4de7-8011-8364575aa2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10bf92107faa41cc872b234580a68886'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.219724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e53d6226-7320-4de7-8011-8364575aa2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10bf92107faa41cc872b234580a68886'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.224314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9fa36294-7b90-41ea-aced-dc5c4392345d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a72ce587760424f9ccce19e0841ae6a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.224970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9fa36294-7b90-41ea-aced-dc5c4392345d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a72ce587760424f9ccce19e0841ae6a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.227656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e53d6226-7320-4de7-8011-8364575aa2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10bf92107faa41cc872b234580a68886'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.240146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e53d6226-7320-4de7-8011-8364575aa2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10bf92107faa41cc872b234580a68886'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.243389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1047/2125] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:56 2022] DELETE /identity/v3/users/5a72ce587760424f9ccce19e0841ae6a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:56.249445 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1079/2126] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:56 2022] DELETE /identity/v3/users/10bf92107faa41cc872b234580a68886 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:56.249612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a35f-04e4-46d6-b1c6-732c88ccf22b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:56.249612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a35f-04e4-46d6-b1c6-732c88ccf22b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:56.249612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a35f-04e4-46d6-b1c6-732c88ccf22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:56.250854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8aaf8-8183-4c75-ad8e-a10aa5a93856 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:56.251132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8aaf8-8183-4c75-ad8e-a10aa5a93856 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:56.251402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8aaf8-8183-4c75-ad8e-a10aa5a93856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:56.268340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1245a35f-04e4-46d6-b1c6-732c88ccf22b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:56.269634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1245a35f-04e4-46d6-b1c6-732c88ccf22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:56.272213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9eb8aaf8-8183-4c75-ad8e-a10aa5a93856 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:56.273688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9eb8aaf8-8183-4c75-ad8e-a10aa5a93856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:56.329246 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:56.343538 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1080/2127] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:56.344478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1048/2128] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:56.355948 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8aaf8-8183-4c75-ad8e-a10aa5a93856 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:56.356144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245a35f-04e4-46d6-b1c6-732c88ccf22b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:56.356238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9eb8aaf8-8183-4c75-ad8e-a10aa5a93856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:56.356722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1245a35f-04e4-46d6-b1c6-732c88ccf22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:56.404879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:56.418151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8aaf8-8183-4c75-ad8e-a10aa5a93856 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:56.420110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245a35f-04e4-46d6-b1c6-732c88ccf22b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:56.423807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffc9bc-3023-40fe-9cf8-37976c3b3073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:56.423984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394a890-ed8c-4dbe-9f13-2222da48aa09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:56.424432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffc9bc-3023-40fe-9cf8-37976c3b3073 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:56.424536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394a890-ed8c-4dbe-9f13-2222da48aa09 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:56.424704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394a890-ed8c-4dbe-9f13-2222da48aa09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:56.424816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffc9bc-3023-40fe-9cf8-37976c3b3073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:56.424977 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffc9bc-3023-40fe-9cf8-37976c3b3073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:56.425069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394a890-ed8c-4dbe-9f13-2222da48aa09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:56.435052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394a890-ed8c-4dbe-9f13-2222da48aa09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:56.436498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394a890-ed8c-4dbe-9f13-2222da48aa09 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:56.436755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffc9bc-3023-40fe-9cf8-37976c3b3073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:56.438364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffc9bc-3023-40fe-9cf8-37976c3b3073 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:56.448004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1081/2129] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:11:56.448469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1049/2130] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:56.817676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394a890-ed8c-4dbe-9f13-2222da48aa09 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:56.819253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1394a890-ed8c-4dbe-9f13-2222da48aa09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:56.824931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffc9bc-3023-40fe-9cf8-37976c3b3073 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:56.828162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-08ffc9bc-3023-40fe-9cf8-37976c3b3073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:56.837412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394a890-ed8c-4dbe-9f13-2222da48aa09 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:56.845558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:56.845558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:56.845558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:56.845558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] PATH_INFO: `/v3/projects/5dc130bb45384bd4ac35d51f150079e4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:56.846875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc130bb45384bd4ac35d51f150079e4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:56.849080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:56.855572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffc9bc-3023-40fe-9cf8-37976c3b3073 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:56.868547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:56.869370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:56.869655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:56.869965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] PATH_INFO: `/v3/projects/90b061bbd76a43bfb3bb7d75241d14fd` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:56.871273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b061bbd76a43bfb3bb7d75241d14fd)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:56.873555 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:56.910253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc130bb45384bd4ac35d51f150079e4', 'request_id': 'req-612d000a-0df3-43f6-837a-781860db40b2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.919705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc130bb45384bd4ac35d51f150079e4', 'request_id': 'req-612d000a-0df3-43f6-837a-781860db40b2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.926140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc130bb45384bd4ac35d51f150079e4', 'request_id': 'req-612d000a-0df3-43f6-837a-781860db40b2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.929999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b061bbd76a43bfb3bb7d75241d14fd', 'request_id': 'req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.936899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b061bbd76a43bfb3bb7d75241d14fd', 'request_id': 'req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.943539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] The token cache is being invalidate because project 5dc130bb45384bd4ac35d51f150079e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:56.943739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.944587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.946968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1082/2131] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:56 2022] DELETE /identity/v3/projects/5dc130bb45384bd4ac35d51f150079e4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:56.950590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b061bbd76a43bfb3bb7d75241d14fd', 'request_id': 'req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.978817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] The token cache is being invalidate because project 90b061bbd76a43bfb3bb7d75241d14fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:56.979130 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.979963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:56.981810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1050/2132] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:56 2022] DELETE /identity/v3/projects/90b061bbd76a43bfb3bb7d75241d14fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:56.986449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:56.988273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:57.086124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d000a-0df3-43f6-837a-781860db40b2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:57.169660 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db4699-b30e-4d60-9a5a-0eed9decc941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:57.170411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db4699-b30e-4d60-9a5a-0eed9decc941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:57.170610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db4699-b30e-4d60-9a5a-0eed9decc941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:57.170932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db4699-b30e-4d60-9a5a-0eed9decc941 admin admin] PATH_INFO: `/v3/users/914f3580d1764be59da9405cc992b492` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:57.172066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db4699-b30e-4d60-9a5a-0eed9decc941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=914f3580d1764be59da9405cc992b492)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:57.174069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db4699-b30e-4d60-9a5a-0eed9decc941 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:57.196760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:57.215110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:57.216602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:57.224941 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a6db4699-b30e-4d60-9a5a-0eed9decc941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914f3580d1764be59da9405cc992b492'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.231646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b58f59-22e2-41fd-8090-fbbbf0caa33f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:57.233950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a6db4699-b30e-4d60-9a5a-0eed9decc941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914f3580d1764be59da9405cc992b492'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.234652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a6db4699-b30e-4d60-9a5a-0eed9decc941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914f3580d1764be59da9405cc992b492'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.236726 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:57.237365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:57.237643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:57.237945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] PATH_INFO: `/v3/users/f254a2dff8bb49a39208127ad4c2b448` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:57.239061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f254a2dff8bb49a39208127ad4c2b448)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:57.240997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:57.242032 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a6db4699-b30e-4d60-9a5a-0eed9decc941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914f3580d1764be59da9405cc992b492'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.253641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a6db4699-b30e-4d60-9a5a-0eed9decc941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914f3580d1764be59da9405cc992b492'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.261132 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1083/2133] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:56 2022] DELETE /identity/v3/users/914f3580d1764be59da9405cc992b492 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:57.299097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f254a2dff8bb49a39208127ad4c2b448'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.299896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f254a2dff8bb49a39208127ad4c2b448'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.309253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f254a2dff8bb49a39208127ad4c2b448'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.317745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f254a2dff8bb49a39208127ad4c2b448'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.318540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f254a2dff8bb49a39208127ad4c2b448'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.334047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:57.341567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1051/2134] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:57 2022] DELETE /identity/v3/users/f254a2dff8bb49a39208127ad4c2b448 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:57.346483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9072f-fca3-45d4-a686-ff4ac9e6b770 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:57.346766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9072f-fca3-45d4-a686-ff4ac9e6b770 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:57.347059 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9072f-fca3-45d4-a686-ff4ac9e6b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:57.369710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-afe9072f-fca3-45d4-a686-ff4ac9e6b770 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:57.371010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-afe9072f-fca3-45d4-a686-ff4ac9e6b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:57.442158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1084/2135] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:57.453230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:57.455513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:57.525226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a25133-2f03-420d-8c82-df7e7fdefe89 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:57.529617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93667831-9c1f-4848-9a85-30273839be02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:57.530260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93667831-9c1f-4848-9a85-30273839be02 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:57.530535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93667831-9c1f-4848-9a85-30273839be02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:57.530804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93667831-9c1f-4848-9a85-30273839be02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:57.540968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93667831-9c1f-4848-9a85-30273839be02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:57.542464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93667831-9c1f-4848-9a85-30273839be02 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:57.552395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1052/2136] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:57.580433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9072f-fca3-45d4-a686-ff4ac9e6b770 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:57.582107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-afe9072f-fca3-45d4-a686-ff4ac9e6b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:57.613764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9072f-fca3-45d4-a686-ff4ac9e6b770 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:57.620183 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:57.620915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:57.621259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:57.621582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] PATH_INFO: `/v3/projects/b89d28a93e8242e390ede630eb377c64` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:57.622771 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89d28a93e8242e390ede630eb377c64)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:57.624861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:57.681697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89d28a93e8242e390ede630eb377c64', 'request_id': 'req-179cb80f-9eea-492c-a57a-7705d4f8a456'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.694587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89d28a93e8242e390ede630eb377c64', 'request_id': 'req-179cb80f-9eea-492c-a57a-7705d4f8a456'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.710843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89d28a93e8242e390ede630eb377c64', 'request_id': 'req-179cb80f-9eea-492c-a57a-7705d4f8a456'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.725604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] The token cache is being invalidate because project b89d28a93e8242e390ede630eb377c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:57.725929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.726678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-179cb80f-9eea-492c-a57a-7705d4f8a456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.733648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1085/2137] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:57 2022] DELETE /identity/v3/projects/b89d28a93e8242e390ede630eb377c64 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:57.734945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84f8d1-3e0e-412f-954e-4989f1bba295 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:57.735230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84f8d1-3e0e-412f-954e-4989f1bba295 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:57.735547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84f8d1-3e0e-412f-954e-4989f1bba295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:57.758272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2f84f8d1-3e0e-412f-954e-4989f1bba295 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:57.759482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2f84f8d1-3e0e-412f-954e-4989f1bba295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:57.834698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1053/2138] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:57.843357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa634a-4202-4f16-a187-295b5e2b4584 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:57.843643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa634a-4202-4f16-a187-295b5e2b4584 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:57.843919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa634a-4202-4f16-a187-295b5e2b4584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:57.867443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1baa634a-4202-4f16-a187-295b5e2b4584 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:57.868688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1baa634a-4202-4f16-a187-295b5e2b4584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:57.873221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84f8d1-3e0e-412f-954e-4989f1bba295 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:57.874608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2f84f8d1-3e0e-412f-954e-4989f1bba295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:57.878154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1086/2139] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:57.881930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa634a-4202-4f16-a187-295b5e2b4584 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:57.892256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa634a-4202-4f16-a187-295b5e2b4584 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:57.897104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84f8d1-3e0e-412f-954e-4989f1bba295 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:57.897420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1115a0f-25cc-4efb-9136-14a8ebc63b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:57.898193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1115a0f-25cc-4efb-9136-14a8ebc63b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:57.898626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1115a0f-25cc-4efb-9136-14a8ebc63b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:57.898924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1115a0f-25cc-4efb-9136-14a8ebc63b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:57.899596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1115a0f-25cc-4efb-9136-14a8ebc63b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:57.899894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1115a0f-25cc-4efb-9136-14a8ebc63b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:57.901570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1115a0f-25cc-4efb-9136-14a8ebc63b0a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:57.905319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:57.906026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:57.906319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:57.906565 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] PATH_INFO: `/v3/projects/c67210b0903c4c6ea8819d2e89d12f62` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:57.907751 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67210b0903c4c6ea8819d2e89d12f62)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:57.909634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:57.913757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:57.917617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1087/2140] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:11:57.922188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1115a0f-25cc-4efb-9136-14a8ebc63b0a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:57.934375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1115a0f-25cc-4efb-9136-14a8ebc63b0a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:57.939576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a3718-7e62-4eb6-9ad5-0463239f4a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:57.940225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a3718-7e62-4eb6-9ad5-0463239f4a2c admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:57.940556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a3718-7e62-4eb6-9ad5-0463239f4a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:57.940827 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a3718-7e62-4eb6-9ad5-0463239f4a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:57.941521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a3718-7e62-4eb6-9ad5-0463239f4a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:57.943610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a3718-7e62-4eb6-9ad5-0463239f4a2c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:57.963538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67210b0903c4c6ea8819d2e89d12f62', 'request_id': 'req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.968709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67210b0903c4c6ea8819d2e89d12f62', 'request_id': 'req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.980189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1088/2141] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:57 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:11:57.980366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67210b0903c4c6ea8819d2e89d12f62', 'request_id': 'req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.981229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a3718-7e62-4eb6-9ad5-0463239f4a2c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:57.991795 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] The token cache is being invalidate because project c67210b0903c4c6ea8819d2e89d12f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:57.992722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.993572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:57.995228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1054/2142] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:57 2022] DELETE /identity/v3/projects/c67210b0903c4c6ea8819d2e89d12f62 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:57.999146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:58.000602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:58.029907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:58.046406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a3718-7e62-4eb6-9ad5-0463239f4a2c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:58.051506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffa26c-dd9e-44a5-afc5-5c9a11c1a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:58.052128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffa26c-dd9e-44a5-afc5-5c9a11c1a23e admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.052409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffa26c-dd9e-44a5-afc5-5c9a11c1a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.052748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffa26c-dd9e-44a5-afc5-5c9a11c1a23e admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.053316 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffa26c-dd9e-44a5-afc5-5c9a11c1a23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:58.055334 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffa26c-dd9e-44a5-afc5-5c9a11c1a23e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:58.073111 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d8d0-1d0b-42ad-90a0-76603eacf8d4 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:58.078120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c615a-7ec7-4a31-8cf9-5ea534dca788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:58.078759 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c615a-7ec7-4a31-8cf9-5ea534dca788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.079092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c615a-7ec7-4a31-8cf9-5ea534dca788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.079350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1089/2143] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:57 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:11:58.079461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c615a-7ec7-4a31-8cf9-5ea534dca788 admin admin] PATH_INFO: `/v3/users/d824441a66b644d3b1cba19479567653` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.080502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c615a-7ec7-4a31-8cf9-5ea534dca788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d824441a66b644d3b1cba19479567653)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:58.082747 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c615a-7ec7-4a31-8cf9-5ea534dca788 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:58.083619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffa26c-dd9e-44a5-afc5-5c9a11c1a23e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:58.085661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9dffa26c-dd9e-44a5-afc5-5c9a11c1a23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:58.097957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffa26c-dd9e-44a5-afc5-5c9a11c1a23e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:58.103086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9543865-28f2-46ae-bb93-5e7747de4fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:58.104009 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9543865-28f2-46ae-bb93-5e7747de4fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.104285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9543865-28f2-46ae-bb93-5e7747de4fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.104553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9543865-28f2-46ae-bb93-5e7747de4fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.105184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9543865-28f2-46ae-bb93-5e7747de4fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:58.106804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9543865-28f2-46ae-bb93-5e7747de4fc7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:58.133549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1090/2144] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:58.134597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9543865-28f2-46ae-bb93-5e7747de4fc7 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:58.145034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9543865-28f2-46ae-bb93-5e7747de4fc7 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:58.148640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cc7c615a-7ec7-4a31-8cf9-5ea534dca788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd824441a66b644d3b1cba19479567653'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.149361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cc7c615a-7ec7-4a31-8cf9-5ea534dca788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd824441a66b644d3b1cba19479567653'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.150714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12a715-b87a-42c1-99e1-e491bbf8096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:58.151319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12a715-b87a-42c1-99e1-e491bbf8096a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.151588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12a715-b87a-42c1-99e1-e491bbf8096a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.151857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12a715-b87a-42c1-99e1-e491bbf8096a admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.154117 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12a715-b87a-42c1-99e1-e491bbf8096a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:58.156541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12a715-b87a-42c1-99e1-e491bbf8096a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:58.158577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cc7c615a-7ec7-4a31-8cf9-5ea534dca788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd824441a66b644d3b1cba19479567653'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.169096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cc7c615a-7ec7-4a31-8cf9-5ea534dca788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd824441a66b644d3b1cba19479567653'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.169873 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cc7c615a-7ec7-4a31-8cf9-5ea534dca788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd824441a66b644d3b1cba19479567653'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.172328 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1091/2145] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:58.176618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12a715-b87a-42c1-99e1-e491bbf8096a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:58.178341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2a12a715-b87a-42c1-99e1-e491bbf8096a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:58.192706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12a715-b87a-42c1-99e1-e491bbf8096a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:58.193063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1055/2146] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:57 2022] DELETE /identity/v3/users/d824441a66b644d3b1cba19479567653 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:58.275599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe13461-c55a-4843-bc0b-d1192200f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:58.276591 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe13461-c55a-4843-bc0b-d1192200f4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.277049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe13461-c55a-4843-bc0b-d1192200f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.277550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe13461-c55a-4843-bc0b-d1192200f4b1 admin admin] PATH_INFO: `/v3/projects/48c3baa7bb6b4ef48ad33162952c0e46/users/74e635e3b11d4515afa3153f2210ea70/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.297199 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe13461-c55a-4843-bc0b-d1192200f4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c3baa7bb6b4ef48ad33162952c0e46, user_id=74e635e3b11d4515afa3153f2210ea70, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:58.300907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe13461-c55a-4843-bc0b-d1192200f4b1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:58.317431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1092/2147] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:58 2022] PUT /identity/v3/projects/48c3baa7bb6b4ef48ad33162952c0e46/users/74e635e3b11d4515afa3153f2210ea70/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:58.334433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1bbf3-f544-4b91-b9a5-b650fb16a8a8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.335309 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1bbf3-f544-4b91-b9a5-b650fb16a8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.335686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1bbf3-f544-4b91-b9a5-b650fb16a8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.375813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bbe1bbf3-f544-4b91-b9a5-b650fb16a8a8 None None] MFA Rules not processed for user `74e635e3b11d4515afa3153f2210ea70`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:58.376967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bbe1bbf3-f544-4b91-b9a5-b650fb16a8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:58.448724 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1056/2148] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:58.462765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe13461-c55a-4843-bc0b-d1192200f4b1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:58.464624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ebe13461-c55a-4843-bc0b-d1192200f4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:58.499709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1bbf3-f544-4b91-b9a5-b650fb16a8a8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:58.501155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bbe1bbf3-f544-4b91-b9a5-b650fb16a8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:58.503409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:58.538388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe13461-c55a-4843-bc0b-d1192200f4b1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:58.542311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb13b3-ea9c-485d-bb5a-07ed52ce5eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:58.542927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb13b3-ea9c-485d-bb5a-07ed52ce5eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.543199 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb13b3-ea9c-485d-bb5a-07ed52ce5eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.543465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb13b3-ea9c-485d-bb5a-07ed52ce5eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.546101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:58.555047 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb13b3-ea9c-485d-bb5a-07ed52ce5eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:58.556579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb13b3-ea9c-485d-bb5a-07ed52ce5eb9 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:58.566796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1093/2149] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:58.587405 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb13b3-ea9c-485d-bb5a-07ed52ce5eb9 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:58.596792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1bbf3-f544-4b91-b9a5-b650fb16a8a8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:58.597892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb13b3-ea9c-485d-bb5a-07ed52ce5eb9 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:58.601935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:58.602544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354a7b9-9417-44c4-b986-1895fc9ad377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:58.602668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.602834 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.603103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] PATH_INFO: `/v3/projects/d356f398798e49b0af8e8cd7037fd117` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.603201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a7b9-9417-44c4-b986-1895fc9ad377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.603748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a7b9-9417-44c4-b986-1895fc9ad377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.604014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a7b9-9417-44c4-b986-1895fc9ad377 admin admin] PATH_INFO: `/v3/users/74e635e3b11d4515afa3153f2210ea70` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.604570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d356f398798e49b0af8e8cd7037fd117)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:58.605698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354a7b9-9417-44c4-b986-1895fc9ad377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e635e3b11d4515afa3153f2210ea70)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:58.607636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354a7b9-9417-44c4-b986-1895fc9ad377 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:58.607756 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:58.663249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8354a7b9-9417-44c4-b986-1895fc9ad377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e635e3b11d4515afa3153f2210ea70'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.666998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd356f398798e49b0af8e8cd7037fd117', 'request_id': 'req-031f9992-0259-49a9-b3bf-7d6650754f4f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.672016 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8354a7b9-9417-44c4-b986-1895fc9ad377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e635e3b11d4515afa3153f2210ea70'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.672694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8354a7b9-9417-44c4-b986-1895fc9ad377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e635e3b11d4515afa3153f2210ea70'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.673031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd356f398798e49b0af8e8cd7037fd117', 'request_id': 'req-031f9992-0259-49a9-b3bf-7d6650754f4f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.680763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8354a7b9-9417-44c4-b986-1895fc9ad377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e635e3b11d4515afa3153f2210ea70'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.681283 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd356f398798e49b0af8e8cd7037fd117', 'request_id': 'req-031f9992-0259-49a9-b3bf-7d6650754f4f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.693785 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] The token cache is being invalidate because project d356f398798e49b0af8e8cd7037fd117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:58.694130 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.694841 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-031f9992-0259-49a9-b3bf-7d6650754f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.695073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8354a7b9-9417-44c4-b986-1895fc9ad377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e635e3b11d4515afa3153f2210ea70'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:58.696941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1057/2150] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:58 2022] DELETE /identity/v3/projects/d356f398798e49b0af8e8cd7037fd117 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:58.701972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edfa21-bb94-4db5-8dec-0772b0536381 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.702423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edfa21-bb94-4db5-8dec-0772b0536381 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.702697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edfa21-bb94-4db5-8dec-0772b0536381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.705121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1094/2151] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:11:58 2022] DELETE /identity/v3/users/74e635e3b11d4515afa3153f2210ea70 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:58.709156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f7a00-e768-4dcc-a6c9-ad1e293de606 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.709443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f7a00-e768-4dcc-a6c9-ad1e293de606 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.709716 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f7a00-e768-4dcc-a6c9-ad1e293de606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.724717 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-03edfa21-bb94-4db5-8dec-0772b0536381 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:58.725979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-03edfa21-bb94-4db5-8dec-0772b0536381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:58.729866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-682f7a00-e768-4dcc-a6c9-ad1e293de606 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:58.731143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-682f7a00-e768-4dcc-a6c9-ad1e293de606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:58.789899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1058/2152] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:58.793628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1095/2153] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:58.802570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8140eb-f313-4ebf-b4ae-cd177cc14fb3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.802855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8140eb-f313-4ebf-b4ae-cd177cc14fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.803122 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8140eb-f313-4ebf-b4ae-cd177cc14fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.803801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f7a00-e768-4dcc-a6c9-ad1e293de606 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:58.805356 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-682f7a00-e768-4dcc-a6c9-ad1e293de606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:58.824958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fc8140eb-f313-4ebf-b4ae-cd177cc14fb3 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:58.826194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fc8140eb-f313-4ebf-b4ae-cd177cc14fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:58.838535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1059/2154] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:58.840433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8140eb-f313-4ebf-b4ae-cd177cc14fb3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:58.849800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8140eb-f313-4ebf-b4ae-cd177cc14fb3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:58.855590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca86ca3-6f1e-4c2e-839f-fac186506b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:58.856203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca86ca3-6f1e-4c2e-839f-fac186506b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.856474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca86ca3-6f1e-4c2e-839f-fac186506b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.856739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca86ca3-6f1e-4c2e-839f-fac186506b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.857383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca86ca3-6f1e-4c2e-839f-fac186506b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:58.857683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca86ca3-6f1e-4c2e-839f-fac186506b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:58.859298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca86ca3-6f1e-4c2e-839f-fac186506b6f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:58.863589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:58.872206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1060/2155] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:58.877282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca86ca3-6f1e-4c2e-839f-fac186506b6f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:58.881041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f7a00-e768-4dcc-a6c9-ad1e293de606 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:58.886608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54ce45-92dc-4331-b515-8e3fbc083e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:58.887400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ce45-92dc-4331-b515-8e3fbc083e71 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.888064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ce45-92dc-4331-b515-8e3fbc083e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.888412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ce45-92dc-4331-b515-8e3fbc083e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.889019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca86ca3-6f1e-4c2e-839f-fac186506b6f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:58.895043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3aeae7-8c6b-4990-ad0b-66f49a9e5d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:58.895043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aeae7-8c6b-4990-ad0b-66f49a9e5d35 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:58.895043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aeae7-8c6b-4990-ad0b-66f49a9e5d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:58.895043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aeae7-8c6b-4990-ad0b-66f49a9e5d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:58.895528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3aeae7-8c6b-4990-ad0b-66f49a9e5d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:58.897414 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3aeae7-8c6b-4990-ad0b-66f49a9e5d35 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:58.898241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54ce45-92dc-4331-b515-8e3fbc083e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:58.900281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54ce45-92dc-4331-b515-8e3fbc083e71 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:58.910908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1096/2156] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:11:58.934546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1061/2157] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:58 2022] POST /identity/v3/projects => generated 409 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:58.938646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54ce45-92dc-4331-b515-8e3fbc083e71 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:58.950133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54ce45-92dc-4331-b515-8e3fbc083e71 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.017126 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fa8bd-30ee-4e65-afda-f77fe4f94112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.017752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fa8bd-30ee-4e65-afda-f77fe4f94112 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.018056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fa8bd-30ee-4e65-afda-f77fe4f94112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.018318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fa8bd-30ee-4e65-afda-f77fe4f94112 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.019020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fa8bd-30ee-4e65-afda-f77fe4f94112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.021238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fa8bd-30ee-4e65-afda-f77fe4f94112 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.045429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1097/2158] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:58 2022] POST /identity/v3/users => generated 305 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:59.050240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3aeae7-8c6b-4990-ad0b-66f49a9e5d35 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.064382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3aeae7-8c6b-4990-ad0b-66f49a9e5d35 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.071152 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8728ad-685a-4f6a-a3e3-09d126460dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.072529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8728ad-685a-4f6a-a3e3-09d126460dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.072529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8728ad-685a-4f6a-a3e3-09d126460dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.072737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8728ad-685a-4f6a-a3e3-09d126460dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.073397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8728ad-685a-4f6a-a3e3-09d126460dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.075161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8728ad-685a-4f6a-a3e3-09d126460dd2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.086332 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1062/2159] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:59.091311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fa8bd-30ee-4e65-afda-f77fe4f94112 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.104075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fa8bd-30ee-4e65-afda-f77fe4f94112 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.108956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ebab2-0646-4a8d-86d5-9bcf74cf0eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.109567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ebab2-0646-4a8d-86d5-9bcf74cf0eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.109911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ebab2-0646-4a8d-86d5-9bcf74cf0eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.110146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ebab2-0646-4a8d-86d5-9bcf74cf0eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.110829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ebab2-0646-4a8d-86d5-9bcf74cf0eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.112431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ebab2-0646-4a8d-86d5-9bcf74cf0eb3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.123044 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1098/2160] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:59.129038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8728ad-685a-4f6a-a3e3-09d126460dd2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.139198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8728ad-685a-4f6a-a3e3-09d126460dd2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.144291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc860f-add3-49e9-a898-21f399983a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.144952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc860f-add3-49e9-a898-21f399983a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.145223 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc860f-add3-49e9-a898-21f399983a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.145489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc860f-add3-49e9-a898-21f399983a58 admin admin] PATH_INFO: `/v3/projects/57e7e8caa1b847259bb89507fb37eecd/users/9368e26e93054e0fb888ba063fcbd4a0/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.148859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:59.167581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc860f-add3-49e9-a898-21f399983a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e7e8caa1b847259bb89507fb37eecd, user_id=9368e26e93054e0fb888ba063fcbd4a0, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.170363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc860f-add3-49e9-a898-21f399983a58 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.186137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1063/2161] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:59 2022] PUT /identity/v3/projects/57e7e8caa1b847259bb89507fb37eecd/users/9368e26e93054e0fb888ba063fcbd4a0/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:59.197907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76554e-e0ee-4a24-bbec-13b640e8e72e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.198592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76554e-e0ee-4a24-bbec-13b640e8e72e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.198592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76554e-e0ee-4a24-bbec-13b640e8e72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.208358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc860f-add3-49e9-a898-21f399983a58 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.210229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8ecc860f-add3-49e9-a898-21f399983a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:59.235628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2e76554e-e0ee-4a24-bbec-13b640e8e72e None None] MFA Rules not processed for user `9368e26e93054e0fb888ba063fcbd4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:59.236710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2e76554e-e0ee-4a24-bbec-13b640e8e72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:59.285008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc860f-add3-49e9-a898-21f399983a58 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.290744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.291383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.291795 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.292034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] PATH_INFO: `/v3/projects/48c3baa7bb6b4ef48ad33162952c0e46` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.293422 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c3baa7bb6b4ef48ad33162952c0e46)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.295358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.314083 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1099/2162] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:59 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:59.318920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76554e-e0ee-4a24-bbec-13b640e8e72e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.329975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76554e-e0ee-4a24-bbec-13b640e8e72e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.334981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6d87b-368d-423a-8364-4a33790b1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.335681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6d87b-368d-423a-8364-4a33790b1d01 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.335953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6d87b-368d-423a-8364-4a33790b1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.336351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6d87b-368d-423a-8364-4a33790b1d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.336984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6d87b-368d-423a-8364-4a33790b1d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.338912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6d87b-368d-423a-8364-4a33790b1d01 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.346184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c3baa7bb6b4ef48ad33162952c0e46', 'request_id': 'req-acb2f6db-491a-495c-812e-4a56f4594642'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:59.356377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c3baa7bb6b4ef48ad33162952c0e46', 'request_id': 'req-acb2f6db-491a-495c-812e-4a56f4594642'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:59.367148 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c3baa7bb6b4ef48ad33162952c0e46', 'request_id': 'req-acb2f6db-491a-495c-812e-4a56f4594642'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:59.376055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1100/2163] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:59 2022] POST /identity/v3/projects => generated 407 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:59.377154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6d87b-368d-423a-8364-4a33790b1d01 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.383758 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] The token cache is being invalidate because project 48c3baa7bb6b4ef48ad33162952c0e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:11:59.384352 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:59.385045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-acb2f6db-491a-495c-812e-4a56f4594642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:11:59.387169 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1064/2164] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:11:59 2022] DELETE /identity/v3/projects/48c3baa7bb6b4ef48ad33162952c0e46 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:59.392230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9bd35-261d-482f-bb1b-23607e859ce3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.392503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9bd35-261d-482f-bb1b-23607e859ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.392779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9bd35-261d-482f-bb1b-23607e859ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.416186 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-52f9bd35-261d-482f-bb1b-23607e859ce3 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:59.417409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:59.418273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-52f9bd35-261d-482f-bb1b-23607e859ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:59.453734 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6d87b-368d-423a-8364-4a33790b1d01 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.458998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c94f01-b9db-477d-95ea-5d69407daedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.459623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c94f01-b9db-477d-95ea-5d69407daedc admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.459903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c94f01-b9db-477d-95ea-5d69407daedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.460216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c94f01-b9db-477d-95ea-5d69407daedc admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.461157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c94f01-b9db-477d-95ea-5d69407daedc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.463284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c94f01-b9db-477d-95ea-5d69407daedc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.494971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1101/2165] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:59 2022] POST /identity/v3/users => generated 310 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:59.496038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c94f01-b9db-477d-95ea-5d69407daedc admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.497797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e3c94f01-b9db-477d-95ea-5d69407daedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:59.505434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1065/2166] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:59.507910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3e932-ea7a-4644-861b-8fc281f11950 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.508305 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3e932-ea7a-4644-861b-8fc281f11950 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.508640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3e932-ea7a-4644-861b-8fc281f11950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.511370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c94f01-b9db-477d-95ea-5d69407daedc admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.516157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413def08-0cc1-4579-811b-50fdf9a54e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.516868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413def08-0cc1-4579-811b-50fdf9a54e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.517231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413def08-0cc1-4579-811b-50fdf9a54e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.517606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413def08-0cc1-4579-811b-50fdf9a54e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.518358 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413def08-0cc1-4579-811b-50fdf9a54e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.520098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413def08-0cc1-4579-811b-50fdf9a54e01 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.533875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1102/2167] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:59.535793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413def08-0cc1-4579-811b-50fdf9a54e01 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.535927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e7e3e932-ea7a-4644-861b-8fc281f11950 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:59.537438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e7e3e932-ea7a-4644-861b-8fc281f11950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:59.546865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413def08-0cc1-4579-811b-50fdf9a54e01 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.550280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1066/2168] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:11:59.558306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ed041-5cb5-44e2-ad43-9a9f295b9cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.559044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3e932-ea7a-4644-861b-8fc281f11950 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.559432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed041-5cb5-44e2-ad43-9a9f295b9cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.559883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed041-5cb5-44e2-ad43-9a9f295b9cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.560301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed041-5cb5-44e2-ad43-9a9f295b9cbc admin admin] PATH_INFO: `/v3/projects/e2e9f5950fa642b3b4b96019326fea2b/users/85abbcf822194d9790abd2fe441f98ba/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.568902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3e932-ea7a-4644-861b-8fc281f11950 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.574084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d20ab-64aa-4f74-9a5f-7ee31f773e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.574719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d20ab-64aa-4f74-9a5f-7ee31f773e53 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.574993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d20ab-64aa-4f74-9a5f-7ee31f773e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.575263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d20ab-64aa-4f74-9a5f-7ee31f773e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.575909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d20ab-64aa-4f74-9a5f-7ee31f773e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:11:59.576191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ed041-5cb5-44e2-ad43-9a9f295b9cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e9f5950fa642b3b4b96019326fea2b, user_id=85abbcf822194d9790abd2fe441f98ba, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.576323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d20ab-64aa-4f74-9a5f-7ee31f773e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.578006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d20ab-64aa-4f74-9a5f-7ee31f773e53 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.578912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ed041-5cb5-44e2-ad43-9a9f295b9cbc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.580802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:59.597918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1103/2169] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:59 2022] PUT /identity/v3/projects/e2e9f5950fa642b3b4b96019326fea2b/users/85abbcf822194d9790abd2fe441f98ba/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:11:59.598550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1067/2170] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:11:59.599308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ed041-5cb5-44e2-ad43-9a9f295b9cbc admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.599520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d20ab-64aa-4f74-9a5f-7ee31f773e53 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.611023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d20ab-64aa-4f74-9a5f-7ee31f773e53 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.665416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ed041-5cb5-44e2-ad43-9a9f295b9cbc admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.670006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db88a32-e236-4f57-b7b1-7bf9cd4d5c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.670569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15f346-b28e-4027-b908-69c10939897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.670725 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db88a32-e236-4f57-b7b1-7bf9cd4d5c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.670888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db88a32-e236-4f57-b7b1-7bf9cd4d5c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.671160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db88a32-e236-4f57-b7b1-7bf9cd4d5c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.671259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15f346-b28e-4027-b908-69c10939897b admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.671435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15f346-b28e-4027-b908-69c10939897b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.671703 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15f346-b28e-4027-b908-69c10939897b admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.671813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db88a32-e236-4f57-b7b1-7bf9cd4d5c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.672329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15f346-b28e-4027-b908-69c10939897b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.673411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db88a32-e236-4f57-b7b1-7bf9cd4d5c15 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.674243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15f346-b28e-4027-b908-69c10939897b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.686822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1068/2171] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:11:59.688169 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db88a32-e236-4f57-b7b1-7bf9cd4d5c15 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.699358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db88a32-e236-4f57-b7b1-7bf9cd4d5c15 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.705189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b410da-e7d1-489c-8b4c-2e0d736148fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.706164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b410da-e7d1-489c-8b4c-2e0d736148fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.706441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b410da-e7d1-489c-8b4c-2e0d736148fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.706711 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b410da-e7d1-489c-8b4c-2e0d736148fc admin admin] PATH_INFO: `/v3/projects/e2e9f5950fa642b3b4b96019326fea2b/users/85abbcf822194d9790abd2fe441f98ba/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.710654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1104/2172] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:11:59 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:59.710810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b410da-e7d1-489c-8b4c-2e0d736148fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e9f5950fa642b3b4b96019326fea2b, user_id=85abbcf822194d9790abd2fe441f98ba, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.712153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b410da-e7d1-489c-8b4c-2e0d736148fc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.714999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15f346-b28e-4027-b908-69c10939897b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.728089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1069/2173] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:59 2022] PUT /identity/v3/projects/e2e9f5950fa642b3b4b96019326fea2b/users/85abbcf822194d9790abd2fe441f98ba/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:11:59.738948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d7bdc-4c10-443c-8d6f-d9d5e1924579 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.739357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d7bdc-4c10-443c-8d6f-d9d5e1924579 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.739629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d7bdc-4c10-443c-8d6f-d9d5e1924579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.768671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-980d7bdc-4c10-443c-8d6f-d9d5e1924579 None None] MFA Rules not processed for user `85abbcf822194d9790abd2fe441f98ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:11:59.769943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-980d7bdc-4c10-443c-8d6f-d9d5e1924579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:59.780563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15f346-b28e-4027-b908-69c10939897b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.797907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:59.843581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1070/2174] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:11:59 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:11:59.845288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8be313-aceb-4a41-a949-9eccbc0f8b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.845974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8be313-aceb-4a41-a949-9eccbc0f8b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.846254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8be313-aceb-4a41-a949-9eccbc0f8b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.846526 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8be313-aceb-4a41-a949-9eccbc0f8b61 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.847460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8be313-aceb-4a41-a949-9eccbc0f8b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.849231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8be313-aceb-4a41-a949-9eccbc0f8b61 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.856198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d7bdc-4c10-443c-8d6f-d9d5e1924579 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.858084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-980d7bdc-4c10-443c-8d6f-d9d5e1924579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:11:59.873349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1105/2175] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:11:59 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:11:59.877435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8be313-aceb-4a41-a949-9eccbc0f8b61 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.889170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8be313-aceb-4a41-a949-9eccbc0f8b61 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.898230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc5f7-844e-42a3-b922-0ea31414608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.899148 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc5f7-844e-42a3-b922-0ea31414608c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.899426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc5f7-844e-42a3-b922-0ea31414608c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.899987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc5f7-844e-42a3-b922-0ea31414608c admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.901460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfc5f7-844e-42a3-b922-0ea31414608c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.903172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfc5f7-844e-42a3-b922-0ea31414608c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.919640 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1106/2176] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:59.923719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc5f7-844e-42a3-b922-0ea31414608c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.928294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d7bdc-4c10-443c-8d6f-d9d5e1924579 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.934034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f324ff-ff23-4724-a622-cd10d4af458d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.934761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f324ff-ff23-4724-a622-cd10d4af458d service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.935138 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f324ff-ff23-4724-a622-cd10d4af458d service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.935519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f324ff-ff23-4724-a622-cd10d4af458d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.937598 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc5f7-844e-42a3-b922-0ea31414608c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.945733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca3e16-9f06-4050-b8d2-a8de98214162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.946437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca3e16-9f06-4050-b8d2-a8de98214162 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.946788 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca3e16-9f06-4050-b8d2-a8de98214162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.947063 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca3e16-9f06-4050-b8d2-a8de98214162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.947718 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca3e16-9f06-4050-b8d2-a8de98214162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.949320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca3e16-9f06-4050-b8d2-a8de98214162 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.949676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f324ff-ff23-4724-a622-cd10d4af458d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:11:59.951386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f324ff-ff23-4724-a622-cd10d4af458d service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:11:59.961530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1107/2177] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:11:59.961730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1071/2178] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:11:59 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:11:59.967020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca3e16-9f06-4050-b8d2-a8de98214162 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:11:59.977022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca3e16-9f06-4050-b8d2-a8de98214162 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:11:59.982197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b42b3c-0cce-47e8-812a-683cfc86cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:11:59.982824 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b42b3c-0cce-47e8-812a-683cfc86cdec admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:11:59.983099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b42b3c-0cce-47e8-812a-683cfc86cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:11:59.983361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b42b3c-0cce-47e8-812a-683cfc86cdec admin admin] PATH_INFO: `/v3/projects/0749f91416a449d99a0cb06c9df5f3d8/users/8f4892ba4b8340d2a812318395098492/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:11:59.998418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b42b3c-0cce-47e8-812a-683cfc86cdec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0749f91416a449d99a0cb06c9df5f3d8, user_id=8f4892ba4b8340d2a812318395098492, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:00.001063 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b42b3c-0cce-47e8-812a-683cfc86cdec admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:00.015080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1108/2179] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:11:59 2022] PUT /identity/v3/projects/0749f91416a449d99a0cb06c9df5f3d8/users/8f4892ba4b8340d2a812318395098492/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:12:00.026543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc451c-0b90-4efa-ab5a-10433406559a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:00.026824 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc451c-0b90-4efa-ab5a-10433406559a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:00.027093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc451c-0b90-4efa-ab5a-10433406559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:00.041047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:00.057992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f0bc451c-0b90-4efa-ab5a-10433406559a None None] MFA Rules not processed for user `8f4892ba4b8340d2a812318395098492`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:00.059229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f0bc451c-0b90-4efa-ab5a-10433406559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:00.135162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1072/2180] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:00.140930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b42b3c-0cce-47e8-812a-683cfc86cdec admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:00.146326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc451c-0b90-4efa-ab5a-10433406559a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:00.147858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f0bc451c-0b90-4efa-ab5a-10433406559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:00.200399 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b42b3c-0cce-47e8-812a-683cfc86cdec admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:00.204134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c1a55-004c-4ac4-8a4b-bba610a78b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:00.204779 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1a55-004c-4ac4-8a4b-bba610a78b07 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:00.205066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1a55-004c-4ac4-8a4b-bba610a78b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:00.205332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1a55-004c-4ac4-8a4b-bba610a78b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:00.207139 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-276c1a55-004c-4ac4-8a4b-bba610a78b07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:00.208197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc451c-0b90-4efa-ab5a-10433406559a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:00.212602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6608f1-f86d-4efe-bd64-fc1fc68e6933 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22e60fc95af4a0a94b15f9ed9e3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:00.212987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6608f1-f86d-4efe-bd64-fc1fc68e6933 service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:00.213263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6608f1-f86d-4efe-bd64-fc1fc68e6933 service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:00.214039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6608f1-f86d-4efe-bd64-fc1fc68e6933 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:00.222651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6608f1-f86d-4efe-bd64-fc1fc68e6933 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:00.224108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6608f1-f86d-4efe-bd64-fc1fc68e6933 service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:00.235087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1073/2181] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:00.271220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c1a55-004c-4ac4-8a4b-bba610a78b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:00.273004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c1a55-004c-4ac4-8a4b-bba610a78b07 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:00.283201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1109/2182] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:00 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:05.798735 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6608f1-f86d-4efe-bd64-fc1fc68e6933 service glance] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:05.865670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6608f1-f86d-4efe-bd64-fc1fc68e6933 service glance] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:05.870761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:05.871395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:05.871673 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:05.871942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] PATH_INFO: `/v3/users/9368e26e93054e0fb888ba063fcbd4a0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:05.873082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9368e26e93054e0fb888ba063fcbd4a0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:05.875058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:05.921967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:05.927910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9368e26e93054e0fb888ba063fcbd4a0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:05.928703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9368e26e93054e0fb888ba063fcbd4a0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:05.938771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9368e26e93054e0fb888ba063fcbd4a0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:05.946397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9368e26e93054e0fb888ba063fcbd4a0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:05.947103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9368e26e93054e0fb888ba063fcbd4a0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:05.965687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1074/2183] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:12:05 2022] DELETE /identity/v3/users/9368e26e93054e0fb888ba063fcbd4a0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:05.970517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b3d3f-df8d-497d-b12e-7bc7fb28a46c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:05.971011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b3d3f-df8d-497d-b12e-7bc7fb28a46c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:05.971104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b3d3f-df8d-497d-b12e-7bc7fb28a46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:05.994937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-701b3d3f-df8d-497d-b12e-7bc7fb28a46c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:05.996327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-701b3d3f-df8d-497d-b12e-7bc7fb28a46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:06.009262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:06.066784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1110/2184] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:06.077648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:06.079187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:06.137475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e93c-c55d-49f5-841b-526f91453cd0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:06.142163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677361c1-713c-4deb-994e-49dcb7ae1b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:06.142894 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677361c1-713c-4deb-994e-49dcb7ae1b65 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:06.143113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677361c1-713c-4deb-994e-49dcb7ae1b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:06.143325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677361c1-713c-4deb-994e-49dcb7ae1b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:06.153902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677361c1-713c-4deb-994e-49dcb7ae1b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:06.155402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677361c1-713c-4deb-994e-49dcb7ae1b65 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:06.165987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1075/2185] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:06.534100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b3d3f-df8d-497d-b12e-7bc7fb28a46c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:06.535576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-701b3d3f-df8d-497d-b12e-7bc7fb28a46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:06.548262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b3d3f-df8d-497d-b12e-7bc7fb28a46c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:06.559706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:06.560251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:06.560592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:06.560838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] PATH_INFO: `/v3/projects/57e7e8caa1b847259bb89507fb37eecd` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:06.562608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e7e8caa1b847259bb89507fb37eecd)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:06.578730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:06.654049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e7e8caa1b847259bb89507fb37eecd', 'request_id': 'req-2c9e877f-5a3e-424f-b954-f204f8d39e90'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:06.665421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e7e8caa1b847259bb89507fb37eecd', 'request_id': 'req-2c9e877f-5a3e-424f-b954-f204f8d39e90'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:06.676954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e7e8caa1b847259bb89507fb37eecd', 'request_id': 'req-2c9e877f-5a3e-424f-b954-f204f8d39e90'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:06.720470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] The token cache is being invalidate because project 57e7e8caa1b847259bb89507fb37eecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:12:06.720763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:06.721438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:06.723463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1111/2186] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:12:06 2022] DELETE /identity/v3/projects/57e7e8caa1b847259bb89507fb37eecd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:06.727507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677361c1-713c-4deb-994e-49dcb7ae1b65 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:06.740157 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677361c1-713c-4deb-994e-49dcb7ae1b65 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:06.825146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63511d0-c9fb-471c-801d-a5713c948acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:06.826006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63511d0-c9fb-471c-801d-a5713c948acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:06.826365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63511d0-c9fb-471c-801d-a5713c948acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:06.826728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63511d0-c9fb-471c-801d-a5713c948acd admin admin] PATH_INFO: `/v3/users/85abbcf822194d9790abd2fe441f98ba` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:06.828015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63511d0-c9fb-471c-801d-a5713c948acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=85abbcf822194d9790abd2fe441f98ba)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:06.830064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63511d0-c9fb-471c-801d-a5713c948acd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:06.895957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d63511d0-c9fb-471c-801d-a5713c948acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85abbcf822194d9790abd2fe441f98ba'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:06.896894 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d63511d0-c9fb-471c-801d-a5713c948acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85abbcf822194d9790abd2fe441f98ba'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:06.907181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d63511d0-c9fb-471c-801d-a5713c948acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85abbcf822194d9790abd2fe441f98ba'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:06.922030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d63511d0-c9fb-471c-801d-a5713c948acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85abbcf822194d9790abd2fe441f98ba'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:06.923278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d63511d0-c9fb-471c-801d-a5713c948acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85abbcf822194d9790abd2fe441f98ba'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:06.924831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:06.973880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1076/2187] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:12:06 2022] DELETE /identity/v3/users/85abbcf822194d9790abd2fe441f98ba => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:07.444686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:07.454181 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:07.472699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e877f-5a3e-424f-b954-f204f8d39e90 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:07.536541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:07.537198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:07.537512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:07.538047 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] PATH_INFO: `/v3/projects/e2e9f5950fa642b3b4b96019326fea2b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:07.539396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e9f5950fa642b3b4b96019326fea2b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:07.542573 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:07.596228 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:07.601010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e9f5950fa642b3b4b96019326fea2b', 'request_id': 'req-7226c9f3-92b0-4f84-8412-a32ee384890c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:07.613163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e9f5950fa642b3b4b96019326fea2b', 'request_id': 'req-7226c9f3-92b0-4f84-8412-a32ee384890c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:07.621493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e9f5950fa642b3b4b96019326fea2b', 'request_id': 'req-7226c9f3-92b0-4f84-8412-a32ee384890c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:07.635285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] The token cache is being invalidate because project e2e9f5950fa642b3b4b96019326fea2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:12:07.635768 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:07.636390 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7226c9f3-92b0-4f84-8412-a32ee384890c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:07.638317 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1112/2188] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:12:07 2022] DELETE /identity/v3/projects/e2e9f5950fa642b3b4b96019326fea2b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:07.643248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad35f8-d946-40f7-9a12-a6bfb769131e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:07.643634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad35f8-d946-40f7-9a12-a6bfb769131e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:07.643914 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad35f8-d946-40f7-9a12-a6bfb769131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:07.674607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a2ad35f8-d946-40f7-9a12-a6bfb769131e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:07.675931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a2ad35f8-d946-40f7-9a12-a6bfb769131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:07.745943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1077/2189] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:07.754840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4652-77bf-4f5c-a3d1-7b59eea876ad None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:07.755138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4652-77bf-4f5c-a3d1-7b59eea876ad None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:07.755404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4652-77bf-4f5c-a3d1-7b59eea876ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:07.777327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d7bf4652-77bf-4f5c-a3d1-7b59eea876ad None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:07.778456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d7bf4652-77bf-4f5c-a3d1-7b59eea876ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:07.794645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1113/2190] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:07.799008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad35f8-d946-40f7-9a12-a6bfb769131e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:07.809262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad35f8-d946-40f7-9a12-a6bfb769131e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:07.813939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13463d27-af69-45e7-9156-bbecd5b36dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:07.814478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13463d27-af69-45e7-9156-bbecd5b36dce admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:07.814756 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13463d27-af69-45e7-9156-bbecd5b36dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:07.815029 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13463d27-af69-45e7-9156-bbecd5b36dce admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:07.815695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13463d27-af69-45e7-9156-bbecd5b36dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:12:07.815997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13463d27-af69-45e7-9156-bbecd5b36dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:07.817617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13463d27-af69-45e7-9156-bbecd5b36dce admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:07.829844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1078/2191] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:12:07.834628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf4652-77bf-4f5c-a3d1-7b59eea876ad None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:07.844554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf4652-77bf-4f5c-a3d1-7b59eea876ad None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:07.850109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726132b-29f5-47bb-b23b-1adcdf493330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:07.850732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726132b-29f5-47bb-b23b-1adcdf493330 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:07.851005 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726132b-29f5-47bb-b23b-1adcdf493330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:07.851270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726132b-29f5-47bb-b23b-1adcdf493330 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:07.851907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726132b-29f5-47bb-b23b-1adcdf493330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:07.854207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726132b-29f5-47bb-b23b-1adcdf493330 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:07.888333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1114/2192] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:12:07 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:12:07.889854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13463d27-af69-45e7-9156-bbecd5b36dce admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:07.900419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13463d27-af69-45e7-9156-bbecd5b36dce admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:07.963930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c661992-5f03-42cb-b82e-d370eefa71c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:07.964773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c661992-5f03-42cb-b82e-d370eefa71c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:07.965986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c661992-5f03-42cb-b82e-d370eefa71c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:07.966264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c661992-5f03-42cb-b82e-d370eefa71c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:07.967829 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c661992-5f03-42cb-b82e-d370eefa71c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:07.978403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c661992-5f03-42cb-b82e-d370eefa71c8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:08.024712 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1079/2193] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:12:07 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:12:08.029029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726132b-29f5-47bb-b23b-1adcdf493330 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:08.040531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726132b-29f5-47bb-b23b-1adcdf493330 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:08.045885 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f043bd-b164-4489-b7b0-ece3eda044d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:08.046467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f043bd-b164-4489-b7b0-ece3eda044d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.046917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f043bd-b164-4489-b7b0-ece3eda044d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.047279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f043bd-b164-4489-b7b0-ece3eda044d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.048095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f043bd-b164-4489-b7b0-ece3eda044d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:08.049781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f043bd-b164-4489-b7b0-ece3eda044d8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:08.061506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1115/2194] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:12:08.065432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c661992-5f03-42cb-b82e-d370eefa71c8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:08.092970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c661992-5f03-42cb-b82e-d370eefa71c8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:08.106490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa649-07cd-4a78-99e5-477badcad95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:08.107278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa649-07cd-4a78-99e5-477badcad95f admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.107837 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa649-07cd-4a78-99e5-477badcad95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.108347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa649-07cd-4a78-99e5-477badcad95f admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.109217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fa649-07cd-4a78-99e5-477badcad95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:08.113581 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fa649-07cd-4a78-99e5-477badcad95f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:08.133205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1080/2195] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:12:08.137795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f043bd-b164-4489-b7b0-ece3eda044d8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:08.154210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f043bd-b164-4489-b7b0-ece3eda044d8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:08.159317 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4317267-85f2-4331-8f67-15b15479e0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:08.160753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4317267-85f2-4331-8f67-15b15479e0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.161033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4317267-85f2-4331-8f67-15b15479e0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.162033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4317267-85f2-4331-8f67-15b15479e0b8 admin admin] PATH_INFO: `/v3/projects/83880b16ad3b46a090234bea9d57d424/users/c3d5b9fc8f564ac9a11a12f63cd68bd4/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.195313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4317267-85f2-4331-8f67-15b15479e0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83880b16ad3b46a090234bea9d57d424, user_id=c3d5b9fc8f564ac9a11a12f63cd68bd4, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:08.198685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4317267-85f2-4331-8f67-15b15479e0b8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:08.220825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1116/2196] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:12:08 2022] PUT /identity/v3/projects/83880b16ad3b46a090234bea9d57d424/users/c3d5b9fc8f564ac9a11a12f63cd68bd4/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:08.233304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df4777-310f-4c0e-924d-619f3a9c2c0d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.233705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df4777-310f-4c0e-924d-619f3a9c2c0d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.233866 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df4777-310f-4c0e-924d-619f3a9c2c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.271467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-77df4777-310f-4c0e-924d-619f3a9c2c0d None None] MFA Rules not processed for user `c3d5b9fc8f564ac9a11a12f63cd68bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:08.272790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-77df4777-310f-4c0e-924d-619f3a9c2c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:08.308809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:08.357261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1081/2197] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:08.361986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4317267-85f2-4331-8f67-15b15479e0b8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:08.370866 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d316cc3-38ba-4648-92cb-f150a6035484 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.371287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d316cc3-38ba-4648-92cb-f150a6035484 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.371692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d316cc3-38ba-4648-92cb-f150a6035484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.397520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0d316cc3-38ba-4648-92cb-f150a6035484 None None] MFA Rules not processed for user `e5d4998f54924ecab01a6dbc64b6d9db`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:08.398967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0d316cc3-38ba-4648-92cb-f150a6035484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:08.442165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4317267-85f2-4331-8f67-15b15479e0b8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:08.447621 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a5500-93d0-42c5-a391-00c72bf1f70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:08.448475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a5500-93d0-42c5-a391-00c72bf1f70e admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.449265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a5500-93d0-42c5-a391-00c72bf1f70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.449571 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a5500-93d0-42c5-a391-00c72bf1f70e admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.450455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a5500-93d0-42c5-a391-00c72bf1f70e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:08.452662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a5500-93d0-42c5-a391-00c72bf1f70e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:08.457893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1082/2198] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:12:08.490219 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1117/2199] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:12:08 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:12:08.494558 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d316cc3-38ba-4648-92cb-f150a6035484 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:08.508902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d316cc3-38ba-4648-92cb-f150a6035484 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:08.579065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf21ce-3353-4d7f-ae54-8c718802096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:08.579760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf21ce-3353-4d7f-ae54-8c718802096e admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.580034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf21ce-3353-4d7f-ae54-8c718802096e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.580304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf21ce-3353-4d7f-ae54-8c718802096e admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.581068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf21ce-3353-4d7f-ae54-8c718802096e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:08.583096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf21ce-3353-4d7f-ae54-8c718802096e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:08.611481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1083/2200] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:12:08 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:12:08.612612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a5500-93d0-42c5-a391-00c72bf1f70e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:08.622991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a5500-93d0-42c5-a391-00c72bf1f70e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:08.627546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edbe85-0bb5-425b-89c9-a218de100f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:08.628149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edbe85-0bb5-425b-89c9-a218de100f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.628533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edbe85-0bb5-425b-89c9-a218de100f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.628846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edbe85-0bb5-425b-89c9-a218de100f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.629572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edbe85-0bb5-425b-89c9-a218de100f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:08.631842 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edbe85-0bb5-425b-89c9-a218de100f90 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:08.646333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1118/2201] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:12:08.648336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf21ce-3353-4d7f-ae54-8c718802096e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:08.659302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf21ce-3353-4d7f-ae54-8c718802096e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:08.665220 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef187a84-ad13-4b87-be3e-a9ee902843bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:08.665822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef187a84-ad13-4b87-be3e-a9ee902843bc admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.666131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef187a84-ad13-4b87-be3e-a9ee902843bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.666396 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef187a84-ad13-4b87-be3e-a9ee902843bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.667221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef187a84-ad13-4b87-be3e-a9ee902843bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:08.668830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef187a84-ad13-4b87-be3e-a9ee902843bc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:08.680913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1084/2202] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:12:08.685301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edbe85-0bb5-425b-89c9-a218de100f90 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:08.695529 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edbe85-0bb5-425b-89c9-a218de100f90 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:08.700511 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4552f2-ef69-4fc4-98d7-19418780c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:08.701182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4552f2-ef69-4fc4-98d7-19418780c9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.701615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4552f2-ef69-4fc4-98d7-19418780c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.701925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4552f2-ef69-4fc4-98d7-19418780c9bb admin admin] PATH_INFO: `/v3/projects/0a02b89a4a5d41cb8425c362e6043495/users/55bb27e44960405d84ea8eb4febed24d/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.724942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4552f2-ef69-4fc4-98d7-19418780c9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a02b89a4a5d41cb8425c362e6043495, user_id=55bb27e44960405d84ea8eb4febed24d, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:08.727694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4552f2-ef69-4fc4-98d7-19418780c9bb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:08.743647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1119/2203] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:12:08 2022] PUT /identity/v3/projects/0a02b89a4a5d41cb8425c362e6043495/users/55bb27e44960405d84ea8eb4febed24d/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:08.754670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1470f-fab8-4b0f-b536-dc48f4936d10 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.755078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1470f-fab8-4b0f-b536-dc48f4936d10 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.755356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1470f-fab8-4b0f-b536-dc48f4936d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.785031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-22d1470f-fab8-4b0f-b536-dc48f4936d10 None None] MFA Rules not processed for user `55bb27e44960405d84ea8eb4febed24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:08.786281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-22d1470f-fab8-4b0f-b536-dc48f4936d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:08.842472 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:08.866040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1085/2204] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:08.870872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4552f2-ef69-4fc4-98d7-19418780c9bb admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:08.891514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:08.937419 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4552f2-ef69-4fc4-98d7-19418780c9bb admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:08.942583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957fba-98f4-4764-92d8-67efa4b6edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:08.943382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957fba-98f4-4764-92d8-67efa4b6edaf admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:08.943663 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957fba-98f4-4764-92d8-67efa4b6edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:08.943935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957fba-98f4-4764-92d8-67efa4b6edaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:08.944573 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5957fba-98f4-4764-92d8-67efa4b6edaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:08.946542 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5957fba-98f4-4764-92d8-67efa4b6edaf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:08.977039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1120/2205] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:12:08 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:12:08.982018 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1470f-fab8-4b0f-b536-dc48f4936d10 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:08.993279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1470f-fab8-4b0f-b536-dc48f4936d10 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:09.065922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438d240-c8b8-48a9-85a3-b4eebc64ba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:09.066564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438d240-c8b8-48a9-85a3-b4eebc64ba00 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:09.066836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438d240-c8b8-48a9-85a3-b4eebc64ba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:09.067098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438d240-c8b8-48a9-85a3-b4eebc64ba00 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:09.067746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438d240-c8b8-48a9-85a3-b4eebc64ba00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:09.069645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438d240-c8b8-48a9-85a3-b4eebc64ba00 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:09.097288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1086/2206] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:12:08 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:12:09.098869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957fba-98f4-4764-92d8-67efa4b6edaf admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:09.109926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957fba-98f4-4764-92d8-67efa4b6edaf admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:09.114806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769f447-1fa2-421f-985d-1faf0b3ecbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:09.115489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769f447-1fa2-421f-985d-1faf0b3ecbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:09.115865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769f447-1fa2-421f-985d-1faf0b3ecbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:09.116270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769f447-1fa2-421f-985d-1faf0b3ecbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:09.117042 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769f447-1fa2-421f-985d-1faf0b3ecbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:09.118983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769f447-1fa2-421f-985d-1faf0b3ecbb1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:09.133887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1121/2207] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:12:09.136588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438d240-c8b8-48a9-85a3-b4eebc64ba00 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:09.146754 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438d240-c8b8-48a9-85a3-b4eebc64ba00 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:09.151392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec16d9-6f70-442d-80d7-70188bf0b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:09.152046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec16d9-6f70-442d-80d7-70188bf0b7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:09.152317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec16d9-6f70-442d-80d7-70188bf0b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:09.152583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec16d9-6f70-442d-80d7-70188bf0b7ba admin admin] PATH_INFO: `/v3/projects/ab36aae9a9414c46943f99e02007c605/users/abd273c34c5f4f128d657b856a70c5c9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:09.169880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec16d9-6f70-442d-80d7-70188bf0b7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab36aae9a9414c46943f99e02007c605, user_id=abd273c34c5f4f128d657b856a70c5c9, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:09.172855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec16d9-6f70-442d-80d7-70188bf0b7ba admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:09.190932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1087/2208] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:12:09 2022] PUT /identity/v3/projects/ab36aae9a9414c46943f99e02007c605/users/abd273c34c5f4f128d657b856a70c5c9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:09.194760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769f447-1fa2-421f-985d-1faf0b3ecbb1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:09.217506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769f447-1fa2-421f-985d-1faf0b3ecbb1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:09.331715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dbda2-0fae-4231-803d-811749aa2c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:09.332577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dbda2-0fae-4231-803d-811749aa2c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:09.332873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dbda2-0fae-4231-803d-811749aa2c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:09.333342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dbda2-0fae-4231-803d-811749aa2c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:09.334196 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dbda2-0fae-4231-803d-811749aa2c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:09.335896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dbda2-0fae-4231-803d-811749aa2c22 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:09.347178 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1122/2209] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:12:09.351370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec16d9-6f70-442d-80d7-70188bf0b7ba admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:09.363303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec16d9-6f70-442d-80d7-70188bf0b7ba admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:09.370569 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74570994-b997-40ee-9cbe-199ab5340ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:09.371572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74570994-b997-40ee-9cbe-199ab5340ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:09.371953 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74570994-b997-40ee-9cbe-199ab5340ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:09.372305 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74570994-b997-40ee-9cbe-199ab5340ca7 admin admin] PATH_INFO: `/v3/projects/ab36aae9a9414c46943f99e02007c605/users/abd273c34c5f4f128d657b856a70c5c9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:09.374356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74570994-b997-40ee-9cbe-199ab5340ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab36aae9a9414c46943f99e02007c605, user_id=abd273c34c5f4f128d657b856a70c5c9, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:09.377125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74570994-b997-40ee-9cbe-199ab5340ca7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:09.389063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1088/2210] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:12:09 2022] PUT /identity/v3/projects/ab36aae9a9414c46943f99e02007c605/users/abd273c34c5f4f128d657b856a70c5c9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:09.461038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50469c-91a8-42a4-a36e-139ebbcf859c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:09.461636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50469c-91a8-42a4-a36e-139ebbcf859c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:09.461636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50469c-91a8-42a4-a36e-139ebbcf859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:09.491445 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ed50469c-91a8-42a4-a36e-139ebbcf859c None None] MFA Rules not processed for user `abd273c34c5f4f128d657b856a70c5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:09.492690 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ed50469c-91a8-42a4-a36e-139ebbcf859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:09.577555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1123/2211] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:09.590961 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74570994-b997-40ee-9cbe-199ab5340ca7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:09.592753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-74570994-b997-40ee-9cbe-199ab5340ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:09.653163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74570994-b997-40ee-9cbe-199ab5340ca7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:09.657681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb927c2-7a45-4d7e-9396-c5315081b1c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:09.658333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb927c2-7a45-4d7e-9396-c5315081b1c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:09.658657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb927c2-7a45-4d7e-9396-c5315081b1c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:09.658924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb927c2-7a45-4d7e-9396-c5315081b1c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:09.726556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:09.729790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb927c2-7a45-4d7e-9396-c5315081b1c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:09.731399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb927c2-7a45-4d7e-9396-c5315081b1c6 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:09.742358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1089/2212] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:11.465806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50469c-91a8-42a4-a36e-139ebbcf859c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:11.476988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50469c-91a8-42a4-a36e-139ebbcf859c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:11.481477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a24f-c591-425c-a911-c06f32fb9ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:11.482412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a24f-c591-425c-a911-c06f32fb9ccb service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:11.482687 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a24f-c591-425c-a911-c06f32fb9ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:11.483113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a24f-c591-425c-a911-c06f32fb9ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:11.493884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:11.548784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8a24f-c591-425c-a911-c06f32fb9ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:11.550494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8a24f-c591-425c-a911-c06f32fb9ccb service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:11.567064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1124/2213] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:12.148962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb927c2-7a45-4d7e-9396-c5315081b1c6 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:12.159249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb927c2-7a45-4d7e-9396-c5315081b1c6 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:12.163390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54bf46-b79c-45f9-bb45-e7b798a0429b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:12.164157 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54bf46-b79c-45f9-bb45-e7b798a0429b service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:12.164602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54bf46-b79c-45f9-bb45-e7b798a0429b service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:12.164722 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54bf46-b79c-45f9-bb45-e7b798a0429b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:12.174628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54bf46-b79c-45f9-bb45-e7b798a0429b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:12.176040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54bf46-b79c-45f9-bb45-e7b798a0429b service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:12.185918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1090/2214] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:16.050699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a24f-c591-425c-a911-c06f32fb9ccb service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:16.050699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-05c8a24f-c591-425c-a911-c06f32fb9ccb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:16.119463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a24f-c591-425c-a911-c06f32fb9ccb service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:16.124904 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:16.125566 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:16.125856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:16.126140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] PATH_INFO: `/v3/users/01308343d2ae4469acdb056a9f186b3d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:16.127325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01308343d2ae4469acdb056a9f186b3d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:16.129300 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:16.182553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01308343d2ae4469acdb056a9f186b3d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.193034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01308343d2ae4469acdb056a9f186b3d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.193820 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01308343d2ae4469acdb056a9f186b3d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.202905 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01308343d2ae4469acdb056a9f186b3d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.217350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01308343d2ae4469acdb056a9f186b3d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.229944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1125/2215] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:12:16 2022] DELETE /identity/v3/users/01308343d2ae4469acdb056a9f186b3d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:16.236840 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e530d-053d-41fd-8573-7895ef18601f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:16.237340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e530d-053d-41fd-8573-7895ef18601f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:16.237431 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e530d-053d-41fd-8573-7895ef18601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:16.257315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0d1e530d-053d-41fd-8573-7895ef18601f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:16.258641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0d1e530d-053d-41fd-8573-7895ef18601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:16.263722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:16.265182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:16.318966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:16.339923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1091/2216] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:16.352224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e530d-053d-41fd-8573-7895ef18601f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:16.353710 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0d1e530d-053d-41fd-8573-7895ef18601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:16.361952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce42f1c-21d7-4ae2-b58f-4e1205395528 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:16.366813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:16.367455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:16.367724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:16.367991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] PATH_INFO: `/v3/users/c3d5b9fc8f564ac9a11a12f63cd68bd4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:16.369119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d5b9fc8f564ac9a11a12f63cd68bd4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:16.371116 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:16.417573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e530d-053d-41fd-8573-7895ef18601f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:16.421501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bea942-90e2-4e34-8a1b-626162a809b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:16.422173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bea942-90e2-4e34-8a1b-626162a809b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:16.422443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bea942-90e2-4e34-8a1b-626162a809b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:16.422707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bea942-90e2-4e34-8a1b-626162a809b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:16.423786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d5b9fc8f564ac9a11a12f63cd68bd4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.433168 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bea942-90e2-4e34-8a1b-626162a809b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:16.434808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bea942-90e2-4e34-8a1b-626162a809b5 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:16.435768 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d5b9fc8f564ac9a11a12f63cd68bd4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.436520 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d5b9fc8f564ac9a11a12f63cd68bd4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.443815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d5b9fc8f564ac9a11a12f63cd68bd4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.444911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1092/2217] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:16.458153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d5b9fc8f564ac9a11a12f63cd68bd4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.468807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1126/2218] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:12:16 2022] DELETE /identity/v3/users/c3d5b9fc8f564ac9a11a12f63cd68bd4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:12:16.470572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ef3a-36a6-4f47-8cb1-9b58616f13bb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:16.470941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ef3a-36a6-4f47-8cb1-9b58616f13bb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:16.471231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ef3a-36a6-4f47-8cb1-9b58616f13bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:16.491574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a975ef3a-36a6-4f47-8cb1-9b58616f13bb None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:16.492793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a975ef3a-36a6-4f47-8cb1-9b58616f13bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:16.564371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1093/2219] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:12:16.575041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:16.576945 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:16.644505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f434e8-d4a4-4654-80a8-7e085d2ed791 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:16.649162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f89d5-8425-4fdb-8833-429cc08326a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:16.649800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f89d5-8425-4fdb-8833-429cc08326a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:16.650110 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f89d5-8425-4fdb-8833-429cc08326a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:16.650379 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f89d5-8425-4fdb-8833-429cc08326a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:16.660955 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f89d5-8425-4fdb-8833-429cc08326a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:16.662543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f89d5-8425-4fdb-8833-429cc08326a6 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:16.673583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1127/2220] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:16.773014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ef3a-36a6-4f47-8cb1-9b58616f13bb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:16.774572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a975ef3a-36a6-4f47-8cb1-9b58616f13bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:16.788016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ef3a-36a6-4f47-8cb1-9b58616f13bb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:16.793929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:16.794576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:16.794880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:16.795123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] PATH_INFO: `/v3/projects/8f7ccd7f7ae046f0a9cf3d735fbc88db` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:16.796390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7ccd7f7ae046f0a9cf3d735fbc88db)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:16.798434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:16.829223 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:16.873745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7ccd7f7ae046f0a9cf3d735fbc88db', 'request_id': 'req-87b74645-344c-4fd7-a287-daa440cc9b4e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.882766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7ccd7f7ae046f0a9cf3d735fbc88db', 'request_id': 'req-87b74645-344c-4fd7-a287-daa440cc9b4e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.895461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7ccd7f7ae046f0a9cf3d735fbc88db', 'request_id': 'req-87b74645-344c-4fd7-a287-daa440cc9b4e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.915462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] The token cache is being invalidate because project 8f7ccd7f7ae046f0a9cf3d735fbc88db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:12:16.915462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.915894 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87b74645-344c-4fd7-a287-daa440cc9b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:16.921301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1094/2221] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:12:16 2022] DELETE /identity/v3/projects/8f7ccd7f7ae046f0a9cf3d735fbc88db => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:16.923806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a92296-cf55-45c8-89ed-441b64bc0715 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:16.924274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a92296-cf55-45c8-89ed-441b64bc0715 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:16.924710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a92296-cf55-45c8-89ed-441b64bc0715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:16.952161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-39a92296-cf55-45c8-89ed-441b64bc0715 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:16.952161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-39a92296-cf55-45c8-89ed-441b64bc0715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:17.005200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:17.022069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1128/2222] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:12:17.029636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b626f9-4ab8-4c8e-84e6-6384b8ad45e8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.029993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b626f9-4ab8-4c8e-84e6-6384b8ad45e8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.030297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b626f9-4ab8-4c8e-84e6-6384b8ad45e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.052742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a92296-cf55-45c8-89ed-441b64bc0715 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.054295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-39a92296-cf55-45c8-89ed-441b64bc0715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:17.075724 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-30b626f9-4ab8-4c8e-84e6-6384b8ad45e8 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:17.078990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-30b626f9-4ab8-4c8e-84e6-6384b8ad45e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:17.080080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a92296-cf55-45c8-89ed-441b64bc0715 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.098546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1095/2223] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:17.102580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b626f9-4ab8-4c8e-84e6-6384b8ad45e8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.111514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.112608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.112948 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.113283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] PATH_INFO: `/v3/projects/83880b16ad3b46a090234bea9d57d424` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.114581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=83880b16ad3b46a090234bea9d57d424)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:17.117047 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:17.126064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b626f9-4ab8-4c8e-84e6-6384b8ad45e8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.132952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377ba00-3820-4730-a1b4-a698b088d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.133565 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377ba00-3820-4730-a1b4-a698b088d3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.133936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377ba00-3820-4730-a1b4-a698b088d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.134206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377ba00-3820-4730-a1b4-a698b088d3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.134857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377ba00-3820-4730-a1b4-a698b088d3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:12:17.135157 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377ba00-3820-4730-a1b4-a698b088d3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:17.136857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377ba00-3820-4730-a1b4-a698b088d3d1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:17.149868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1096/2224] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:12:17.154506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377ba00-3820-4730-a1b4-a698b088d3d1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.164933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377ba00-3820-4730-a1b4-a698b088d3d1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.169853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfe367-f60c-4ba2-ad85-81ae6790c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.170467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe367-f60c-4ba2-ad85-81ae6790c17e admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.170745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe367-f60c-4ba2-ad85-81ae6790c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.171077 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe367-f60c-4ba2-ad85-81ae6790c17e admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.171711 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfe367-f60c-4ba2-ad85-81ae6790c17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:17.173524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfe367-f60c-4ba2-ad85-81ae6790c17e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:17.182893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83880b16ad3b46a090234bea9d57d424', 'request_id': 'req-65234150-ce34-497a-b31d-d10923ffd63e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.193076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83880b16ad3b46a090234bea9d57d424', 'request_id': 'req-65234150-ce34-497a-b31d-d10923ffd63e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.200613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83880b16ad3b46a090234bea9d57d424', 'request_id': 'req-65234150-ce34-497a-b31d-d10923ffd63e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.205898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1097/2225] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:12:17 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:12:17.209872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfe367-f60c-4ba2-ad85-81ae6790c17e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.213351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] The token cache is being invalidate because project 83880b16ad3b46a090234bea9d57d424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:12:17.213797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.214607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.216252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1129/2226] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:12:17 2022] DELETE /identity/v3/projects/83880b16ad3b46a090234bea9d57d424 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:12:17.220151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.221802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:17.286360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfe367-f60c-4ba2-ad85-81ae6790c17e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.292135 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e15abc-4440-49ed-ae06-5609500e5c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.292743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e15abc-4440-49ed-ae06-5609500e5c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.293020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e15abc-4440-49ed-ae06-5609500e5c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.293287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e15abc-4440-49ed-ae06-5609500e5c5b admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.293980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e15abc-4440-49ed-ae06-5609500e5c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:17.294550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234150-ce34-497a-b31d-d10923ffd63e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.295884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e15abc-4440-49ed-ae06-5609500e5c5b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:17.299840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c753ae4-ad62-4d55-95d1-125684469331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.300480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753ae4-ad62-4d55-95d1-125684469331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.300756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753ae4-ad62-4d55-95d1-125684469331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.301164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753ae4-ad62-4d55-95d1-125684469331 admin admin] PATH_INFO: `/v3/users/55bb27e44960405d84ea8eb4febed24d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.302342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c753ae4-ad62-4d55-95d1-125684469331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55bb27e44960405d84ea8eb4febed24d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:17.304442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c753ae4-ad62-4d55-95d1-125684469331 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:17.319835 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1098/2227] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:12:17 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:12:17.324032 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e15abc-4440-49ed-ae06-5609500e5c5b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.325709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e5e15abc-4440-49ed-ae06-5609500e5c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:17.339079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e15abc-4440-49ed-ae06-5609500e5c5b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.344234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e899e1b-7e74-4175-82bf-de42a2cd6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.344961 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e899e1b-7e74-4175-82bf-de42a2cd6292 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.345192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e899e1b-7e74-4175-82bf-de42a2cd6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.345493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e899e1b-7e74-4175-82bf-de42a2cd6292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.346175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e899e1b-7e74-4175-82bf-de42a2cd6292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:17.347768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e899e1b-7e74-4175-82bf-de42a2cd6292 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:17.361890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0c753ae4-ad62-4d55-95d1-125684469331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55bb27e44960405d84ea8eb4febed24d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.362073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1099/2228] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:12:17.363028 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e899e1b-7e74-4175-82bf-de42a2cd6292 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.368605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0c753ae4-ad62-4d55-95d1-125684469331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55bb27e44960405d84ea8eb4febed24d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.369197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0c753ae4-ad62-4d55-95d1-125684469331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55bb27e44960405d84ea8eb4febed24d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.374574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e899e1b-7e74-4175-82bf-de42a2cd6292 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.376836 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0c753ae4-ad62-4d55-95d1-125684469331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55bb27e44960405d84ea8eb4febed24d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.379255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae110d-ee16-40a4-8e87-49af39f9cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.379850 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae110d-ee16-40a4-8e87-49af39f9cf44 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.380113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae110d-ee16-40a4-8e87-49af39f9cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.380377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae110d-ee16-40a4-8e87-49af39f9cf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.381045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae110d-ee16-40a4-8e87-49af39f9cf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:17.382670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae110d-ee16-40a4-8e87-49af39f9cf44 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:17.388326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:17.389947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0c753ae4-ad62-4d55-95d1-125684469331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55bb27e44960405d84ea8eb4febed24d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.394274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1100/2229] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:12:17.398312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae110d-ee16-40a4-8e87-49af39f9cf44 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.399984 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b5ae110d-ee16-40a4-8e87-49af39f9cf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:17.400725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1130/2230] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:12:17 2022] DELETE /identity/v3/users/55bb27e44960405d84ea8eb4febed24d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:12:17.416389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae110d-ee16-40a4-8e87-49af39f9cf44 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.453177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:17.483802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d54c58-f626-4210-8535-52adfecc06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.484497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54c58-f626-4210-8535-52adfecc06f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.484786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54c58-f626-4210-8535-52adfecc06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.485069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54c58-f626-4210-8535-52adfecc06f8 admin admin] PATH_INFO: `/v3/projects/f19605ca20b64b9fad478c0cdeed311a/users/4c39d1b0651546b5b32117f9ac575ea0/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.501943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d54c58-f626-4210-8535-52adfecc06f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19605ca20b64b9fad478c0cdeed311a, user_id=4c39d1b0651546b5b32117f9ac575ea0, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:17.504909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d54c58-f626-4210-8535-52adfecc06f8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:17.519972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1101/2231] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:12:17 2022] PUT /identity/v3/projects/f19605ca20b64b9fad478c0cdeed311a/users/4c39d1b0651546b5b32117f9ac575ea0/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:12:17.531456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb845d-b871-4ad1-8059-2a1c2fdd0bef None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.531740 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb845d-b871-4ad1-8059-2a1c2fdd0bef None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.532015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb845d-b871-4ad1-8059-2a1c2fdd0bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.563861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fafb845d-b871-4ad1-8059-2a1c2fdd0bef None None] MFA Rules not processed for user `4c39d1b0651546b5b32117f9ac575ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:17.565459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fafb845d-b871-4ad1-8059-2a1c2fdd0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:17.636810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1131/2232] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:17.648420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d54c58-f626-4210-8535-52adfecc06f8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.650164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-85d54c58-f626-4210-8535-52adfecc06f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:17.694472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb845d-b871-4ad1-8059-2a1c2fdd0bef None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.696053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fafb845d-b871-4ad1-8059-2a1c2fdd0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:17.722591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d54c58-f626-4210-8535-52adfecc06f8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.734737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1c4ed-b382-467e-9f78-9ecf9761b3d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.735363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1c4ed-b382-467e-9f78-9ecf9761b3d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.735643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1c4ed-b382-467e-9f78-9ecf9761b3d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.735918 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1c4ed-b382-467e-9f78-9ecf9761b3d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.744727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1c4ed-b382-467e-9f78-9ecf9761b3d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:17.746497 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1c4ed-b382-467e-9f78-9ecf9761b3d8 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:17.756049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1102/2233] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:17.775524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb845d-b871-4ad1-8059-2a1c2fdd0bef None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.780887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.781537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.781810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.782124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] PATH_INFO: `/v3/projects/0a02b89a4a5d41cb8425c362e6043495` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.783806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a02b89a4a5d41cb8425c362e6043495)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:17.785346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1c4ed-b382-467e-9f78-9ecf9761b3d8 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.785870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:17.797414 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1c4ed-b382-467e-9f78-9ecf9761b3d8 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.803221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f28c9-e54b-40f3-9a24-af286f1cbc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.803891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f28c9-e54b-40f3-9a24-af286f1cbc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.804167 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f28c9-e54b-40f3-9a24-af286f1cbc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.804435 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f28c9-e54b-40f3-9a24-af286f1cbc23 admin admin] PATH_INFO: `/v3/users/4c39d1b0651546b5b32117f9ac575ea0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.814005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f28c9-e54b-40f3-9a24-af286f1cbc23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c39d1b0651546b5b32117f9ac575ea0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:17.815964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f28c9-e54b-40f3-9a24-af286f1cbc23 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:17.835605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a02b89a4a5d41cb8425c362e6043495', 'request_id': 'req-a0f15f37-4db6-439f-a0f4-bba162dc3d51'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.844689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a02b89a4a5d41cb8425c362e6043495', 'request_id': 'req-a0f15f37-4db6-439f-a0f4-bba162dc3d51'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.851043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a02b89a4a5d41cb8425c362e6043495', 'request_id': 'req-a0f15f37-4db6-439f-a0f4-bba162dc3d51'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.862657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] The token cache is being invalidate because project 0a02b89a4a5d41cb8425c362e6043495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:12:17.862936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.863586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.865118 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1132/2234] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:12:17 2022] DELETE /identity/v3/projects/0a02b89a4a5d41cb8425c362e6043495 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:12:17.867279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d86f28c9-e54b-40f3-9a24-af286f1cbc23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c39d1b0651546b5b32117f9ac575ea0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.868357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d86f28c9-e54b-40f3-9a24-af286f1cbc23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c39d1b0651546b5b32117f9ac575ea0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.868965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:17.870397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:17.876242 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d86f28c9-e54b-40f3-9a24-af286f1cbc23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c39d1b0651546b5b32117f9ac575ea0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.883352 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d86f28c9-e54b-40f3-9a24-af286f1cbc23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c39d1b0651546b5b32117f9ac575ea0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.884026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d86f28c9-e54b-40f3-9a24-af286f1cbc23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c39d1b0651546b5b32117f9ac575ea0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:17.889943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:17.903321 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1103/2235] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:12:17 2022] DELETE /identity/v3/users/4c39d1b0651546b5b32117f9ac575ea0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:12:17.907724 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2047fa-d54b-4f1b-9e73-61b85e3bf8e4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:17.908011 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2047fa-d54b-4f1b-9e73-61b85e3bf8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:17.908283 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2047fa-d54b-4f1b-9e73-61b85e3bf8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:17.927224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9b2047fa-d54b-4f1b-9e73-61b85e3bf8e4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:17.928431 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9b2047fa-d54b-4f1b-9e73-61b85e3bf8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:17.941588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f15f37-4db6-439f-a0f4-bba162dc3d51 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:17.958612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:17.993766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1104/2236] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:12:17.999296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:17.999948 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:18.000230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:18.000504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] PATH_INFO: `/v3/users/abd273c34c5f4f128d657b856a70c5c9` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:18.001657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd273c34c5f4f128d657b856a70c5c9)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:18.003568 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2047fa-d54b-4f1b-9e73-61b85e3bf8e4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:18.003782 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:18.004924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9b2047fa-d54b-4f1b-9e73-61b85e3bf8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:18.053960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd273c34c5f4f128d657b856a70c5c9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.063937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2047fa-d54b-4f1b-9e73-61b85e3bf8e4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:18.064264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd273c34c5f4f128d657b856a70c5c9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.064921 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd273c34c5f4f128d657b856a70c5c9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.068096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110013f4-18b0-4bbc-bf74-19c222224983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:18.068701 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110013f4-18b0-4bbc-bf74-19c222224983 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:18.068971 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110013f4-18b0-4bbc-bf74-19c222224983 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:18.069238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110013f4-18b0-4bbc-bf74-19c222224983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:18.071090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-110013f4-18b0-4bbc-bf74-19c222224983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:18.072282 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd273c34c5f4f128d657b856a70c5c9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.082885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110013f4-18b0-4bbc-bf74-19c222224983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:18.084042 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd273c34c5f4f128d657b856a70c5c9'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.084296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110013f4-18b0-4bbc-bf74-19c222224983 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:18.089933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1133/2237] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:12:17 2022] DELETE /identity/v3/users/abd273c34c5f4f128d657b856a70c5c9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:12:18.096548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1105/2238] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:12:18.746908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:18.749245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:18.763169 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110013f4-18b0-4bbc-bf74-19c222224983 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:18.765179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-110013f4-18b0-4bbc-bf74-19c222224983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:18.783606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110013f4-18b0-4bbc-bf74-19c222224983 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:18.814464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:18.844650 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68681e-6f60-475e-a3f0-0433fd9daa39 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:18.851525 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:18.852657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:18.853068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:18.853485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] PATH_INFO: `/v3/projects/ab36aae9a9414c46943f99e02007c605` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:18.855720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab36aae9a9414c46943f99e02007c605)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:18.858471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:18.904552 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:18.905205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:18.905484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:18.905784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] PATH_INFO: `/v3/projects/f19605ca20b64b9fad478c0cdeed311a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:18.911049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19605ca20b64b9fad478c0cdeed311a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:18.914784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:18.938523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab36aae9a9414c46943f99e02007c605', 'request_id': 'req-3de1d706-a50d-4e72-94e8-56854d8b10f3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.949609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab36aae9a9414c46943f99e02007c605', 'request_id': 'req-3de1d706-a50d-4e72-94e8-56854d8b10f3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.956023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab36aae9a9414c46943f99e02007c605', 'request_id': 'req-3de1d706-a50d-4e72-94e8-56854d8b10f3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.968956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] The token cache is being invalidate because project ab36aae9a9414c46943f99e02007c605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:12:18.969201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.969962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3de1d706-a50d-4e72-94e8-56854d8b10f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.971624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1134/2239] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:12:18 2022] DELETE /identity/v3/projects/ab36aae9a9414c46943f99e02007c605 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:18.976335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19605ca20b64b9fad478c0cdeed311a', 'request_id': 'req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.982835 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19605ca20b64b9fad478c0cdeed311a', 'request_id': 'req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:18.994650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19605ca20b64b9fad478c0cdeed311a', 'request_id': 'req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:19.010419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] The token cache is being invalidate because project f19605ca20b64b9fad478c0cdeed311a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:12:19.010737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:19.011503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3965f10c-80ee-4bf8-b3ea-cdec5a35b8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:19.013323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1106/2240] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:12:18 2022] DELETE /identity/v3/projects/f19605ca20b64b9fad478c0cdeed311a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:19.018501 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff8f35-4aea-4846-90c4-6b41a8f400fd None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:19.019088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff8f35-4aea-4846-90c4-6b41a8f400fd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:19.019435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff8f35-4aea-4846-90c4-6b41a8f400fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:19.044154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-85ff8f35-4aea-4846-90c4-6b41a8f400fd None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:19.045423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-85ff8f35-4aea-4846-90c4-6b41a8f400fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:19.114154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1135/2241] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:19.122962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b5d49-c241-4486-9898-c88f04ef8283 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:19.124124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b5d49-c241-4486-9898-c88f04ef8283 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:19.124827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b5d49-c241-4486-9898-c88f04ef8283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:19.142295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:19.148616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3c3b5d49-c241-4486-9898-c88f04ef8283 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:19.150716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3c3b5d49-c241-4486-9898-c88f04ef8283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:19.161475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1107/2242] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:19.166092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff8f35-4aea-4846-90c4-6b41a8f400fd None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:19.176730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff8f35-4aea-4846-90c4-6b41a8f400fd None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:19.181397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffca3f-c813-4618-8e9f-7e1858630243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:19.182078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffca3f-c813-4618-8e9f-7e1858630243 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:19.182320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffca3f-c813-4618-8e9f-7e1858630243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:19.182673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffca3f-c813-4618-8e9f-7e1858630243 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:19.183325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffca3f-c813-4618-8e9f-7e1858630243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:12:19.183806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffca3f-c813-4618-8e9f-7e1858630243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:19.185428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffca3f-c813-4618-8e9f-7e1858630243 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:19.197683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1136/2243] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:12:19.202325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b5d49-c241-4486-9898-c88f04ef8283 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:19.211469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b5d49-c241-4486-9898-c88f04ef8283 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:19.216211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41413267-6097-44c2-8cd7-4c01455ed49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:19.216802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41413267-6097-44c2-8cd7-4c01455ed49e admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:19.217072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41413267-6097-44c2-8cd7-4c01455ed49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:19.217334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41413267-6097-44c2-8cd7-4c01455ed49e admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:19.217991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41413267-6097-44c2-8cd7-4c01455ed49e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:19.219873 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41413267-6097-44c2-8cd7-4c01455ed49e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:19.254084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1108/2244] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:12:19 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:12:19.258103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffca3f-c813-4618-8e9f-7e1858630243 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:19.273073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffca3f-c813-4618-8e9f-7e1858630243 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:19.337087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def41538-b6c8-4903-a8ad-d8eb59110c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:19.337958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def41538-b6c8-4903-a8ad-d8eb59110c6e admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:19.337958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def41538-b6c8-4903-a8ad-d8eb59110c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:19.337958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def41538-b6c8-4903-a8ad-d8eb59110c6e admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:19.338617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def41538-b6c8-4903-a8ad-d8eb59110c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:19.340839 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def41538-b6c8-4903-a8ad-d8eb59110c6e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:19.349050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:19.369743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1137/2245] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:12:19 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:12:19.371062 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41413267-6097-44c2-8cd7-4c01455ed49e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:19.381809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41413267-6097-44c2-8cd7-4c01455ed49e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:19.386453 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74685803-cf23-4993-af3f-5f74280003a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:19.387055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74685803-cf23-4993-af3f-5f74280003a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:19.387321 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74685803-cf23-4993-af3f-5f74280003a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:19.387596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74685803-cf23-4993-af3f-5f74280003a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:19.388220 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74685803-cf23-4993-af3f-5f74280003a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:19.390639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74685803-cf23-4993-af3f-5f74280003a7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:19.401702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1109/2246] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:12:19.406337 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def41538-b6c8-4903-a8ad-d8eb59110c6e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:19.416612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def41538-b6c8-4903-a8ad-d8eb59110c6e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:19.421408 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4440-0dff-4181-8e59-9b1234336ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:19.422101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4440-0dff-4181-8e59-9b1234336ecf admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:19.422387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4440-0dff-4181-8e59-9b1234336ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:19.422648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4440-0dff-4181-8e59-9b1234336ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:19.423295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c4440-0dff-4181-8e59-9b1234336ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:19.424933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c4440-0dff-4181-8e59-9b1234336ecf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:19.436200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1138/2247] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:12:19.440553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74685803-cf23-4993-af3f-5f74280003a7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:19.450966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74685803-cf23-4993-af3f-5f74280003a7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:19.456324 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3e6db-26c1-4853-ba0b-a9fce5edccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:19.457100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3e6db-26c1-4853-ba0b-a9fce5edccec admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:19.457471 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3e6db-26c1-4853-ba0b-a9fce5edccec admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:19.457743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3e6db-26c1-4853-ba0b-a9fce5edccec admin admin] PATH_INFO: `/v3/projects/ac85e577cbfa4219bec065ee1ee64941/users/0a3f9fb281d64a22b827814cbd8c3a61/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:19.476099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3e6db-26c1-4853-ba0b-a9fce5edccec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac85e577cbfa4219bec065ee1ee64941, user_id=0a3f9fb281d64a22b827814cbd8c3a61, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:19.478820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3e6db-26c1-4853-ba0b-a9fce5edccec admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:19.494234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1110/2248] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:12:19 2022] PUT /identity/v3/projects/ac85e577cbfa4219bec065ee1ee64941/users/0a3f9fb281d64a22b827814cbd8c3a61/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:12:19.508360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e46d89-f0e6-4b03-8e99-84301fe82bed None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:19.508642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e46d89-f0e6-4b03-8e99-84301fe82bed None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:19.508909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e46d89-f0e6-4b03-8e99-84301fe82bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:19.541234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-65e46d89-f0e6-4b03-8e99-84301fe82bed None None] MFA Rules not processed for user `0a3f9fb281d64a22b827814cbd8c3a61`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:19.543763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-65e46d89-f0e6-4b03-8e99-84301fe82bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:19.613693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1139/2249] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:19.626210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3e6db-26c1-4853-ba0b-a9fce5edccec admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:19.627959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cde3e6db-26c1-4853-ba0b-a9fce5edccec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:19.691447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3e6db-26c1-4853-ba0b-a9fce5edccec admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:19.695458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5192d-af5e-40f4-8319-5d347b81a90a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:19.696023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5192d-af5e-40f4-8319-5d347b81a90a service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:19.696301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5192d-af5e-40f4-8319-5d347b81a90a service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:19.696570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5192d-af5e-40f4-8319-5d347b81a90a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:19.707589 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5192d-af5e-40f4-8319-5d347b81a90a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:19.709158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5192d-af5e-40f4-8319-5d347b81a90a service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:19.719904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1111/2250] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:21.398541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e46d89-f0e6-4b03-8e99-84301fe82bed None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:21.400193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-65e46d89-f0e6-4b03-8e99-84301fe82bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:21.482631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e46d89-f0e6-4b03-8e99-84301fe82bed None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:21.487592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:21.488123 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:21.488394 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:21.488661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] PATH_INFO: `/v3/users/8f4892ba4b8340d2a812318395098492` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:21.489767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4892ba4b8340d2a812318395098492)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:21.491793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:21.547967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4892ba4b8340d2a812318395098492'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:21.556443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4892ba4b8340d2a812318395098492'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:21.557064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4892ba4b8340d2a812318395098492'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:21.564194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4892ba4b8340d2a812318395098492'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:21.573330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:21.584842 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4892ba4b8340d2a812318395098492'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:21.592288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1140/2251] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:12:21 2022] DELETE /identity/v3/users/8f4892ba4b8340d2a812318395098492 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:21.597804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e5c82-f4aa-432f-a432-20a1a2aad9d4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:21.598352 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e5c82-f4aa-432f-a432-20a1a2aad9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:21.598442 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e5c82-f4aa-432f-a432-20a1a2aad9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:21.619299 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-af1e5c82-f4aa-432f-a432-20a1a2aad9d4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:21.620492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-af1e5c82-f4aa-432f-a432-20a1a2aad9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:21.680368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1112/2252] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:21.696210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:21.697881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:21.759644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5729c1-a71d-4bf3-9eb2-d38b91d1816d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:21.763807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120fd0d-ff28-4222-aeba-fabb77cc97e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:21.764455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120fd0d-ff28-4222-aeba-fabb77cc97e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:21.764730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120fd0d-ff28-4222-aeba-fabb77cc97e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:21.765013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120fd0d-ff28-4222-aeba-fabb77cc97e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:21.774611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120fd0d-ff28-4222-aeba-fabb77cc97e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:21.776088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120fd0d-ff28-4222-aeba-fabb77cc97e9 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:21.786392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1141/2253] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:22.077723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e5c82-f4aa-432f-a432-20a1a2aad9d4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:22.079341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-af1e5c82-f4aa-432f-a432-20a1a2aad9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:22.094907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e5c82-f4aa-432f-a432-20a1a2aad9d4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:22.105698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:22.106499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:22.106849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:22.107229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] PATH_INFO: `/v3/projects/0749f91416a449d99a0cb06c9df5f3d8` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:22.108504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0749f91416a449d99a0cb06c9df5f3d8)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:22.110697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:22.159806 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:22.167317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0749f91416a449d99a0cb06c9df5f3d8', 'request_id': 'req-14416906-88b9-4d07-b98c-6be2f18c7114'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:22.173989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0749f91416a449d99a0cb06c9df5f3d8', 'request_id': 'req-14416906-88b9-4d07-b98c-6be2f18c7114'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:22.182996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0749f91416a449d99a0cb06c9df5f3d8', 'request_id': 'req-14416906-88b9-4d07-b98c-6be2f18c7114'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:22.195741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] The token cache is being invalidate because project 0749f91416a449d99a0cb06c9df5f3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:12:22.196118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:22.196768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-14416906-88b9-4d07-b98c-6be2f18c7114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:22.198446 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1113/2254] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:12:22 2022] DELETE /identity/v3/projects/0749f91416a449d99a0cb06c9df5f3d8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:12:22.205654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9786d4-c5f6-4856-9f13-a78b00e916d7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:22.205984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9786d4-c5f6-4856-9f13-a78b00e916d7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:22.206261 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9786d4-c5f6-4856-9f13-a78b00e916d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:22.226562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5b9786d4-c5f6-4856-9f13-a78b00e916d7 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:22.228286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5b9786d4-c5f6-4856-9f13-a78b00e916d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:22.301548 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1142/2255] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:22.309819 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbace8-6c43-48bd-bbb4-b12199c65800 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:22.310208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbace8-6c43-48bd-bbb4-b12199c65800 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:22.310538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbace8-6c43-48bd-bbb4-b12199c65800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:22.330902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a2bbace8-6c43-48bd-bbb4-b12199c65800 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:22.332098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a2bbace8-6c43-48bd-bbb4-b12199c65800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:22.340001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1114/2256] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:22.344986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9786d4-c5f6-4856-9f13-a78b00e916d7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:22.355866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9786d4-c5f6-4856-9f13-a78b00e916d7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:22.361104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9113683-e0d0-442e-9555-702a2acfdcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:22.361710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9113683-e0d0-442e-9555-702a2acfdcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:22.362029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9113683-e0d0-442e-9555-702a2acfdcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:22.362304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9113683-e0d0-442e-9555-702a2acfdcf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:22.362998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9113683-e0d0-442e-9555-702a2acfdcf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:12:22.363572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9113683-e0d0-442e-9555-702a2acfdcf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:22.364979 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9113683-e0d0-442e-9555-702a2acfdcf4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:22.379218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1143/2257] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:12:22.383266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbace8-6c43-48bd-bbb4-b12199c65800 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:22.392777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbace8-6c43-48bd-bbb4-b12199c65800 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:22.397678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a6cf8-0eef-4ffb-9b4e-bce2e7a86df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:22.398927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a6cf8-0eef-4ffb-9b4e-bce2e7a86df4 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:22.398927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a6cf8-0eef-4ffb-9b4e-bce2e7a86df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:22.398927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a6cf8-0eef-4ffb-9b4e-bce2e7a86df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:22.399582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a6cf8-0eef-4ffb-9b4e-bce2e7a86df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:22.401988 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a6cf8-0eef-4ffb-9b4e-bce2e7a86df4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:22.435357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1115/2258] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:12:22 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:12:22.436926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9113683-e0d0-442e-9555-702a2acfdcf4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:22.447339 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9113683-e0d0-442e-9555-702a2acfdcf4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:22.526193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396bf75-b693-4723-a94e-e082fa864d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:22.526926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396bf75-b693-4723-a94e-e082fa864d3d admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:22.527266 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396bf75-b693-4723-a94e-e082fa864d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:22.528352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396bf75-b693-4723-a94e-e082fa864d3d admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:22.529075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396bf75-b693-4723-a94e-e082fa864d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:22.531195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396bf75-b693-4723-a94e-e082fa864d3d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:22.557159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1144/2259] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:12:22 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:12:22.562953 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a6cf8-0eef-4ffb-9b4e-bce2e7a86df4 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:22.578140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a6cf8-0eef-4ffb-9b4e-bce2e7a86df4 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:22.585082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b1238-27d6-42ed-ac6a-ef687d04d006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:22.585770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b1238-27d6-42ed-ac6a-ef687d04d006 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:22.586164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b1238-27d6-42ed-ac6a-ef687d04d006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:22.586504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b1238-27d6-42ed-ac6a-ef687d04d006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:22.587402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b1238-27d6-42ed-ac6a-ef687d04d006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:22.591182 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b1238-27d6-42ed-ac6a-ef687d04d006 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:22.603876 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1116/2260] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:12:22.607238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396bf75-b693-4723-a94e-e082fa864d3d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:22.621774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396bf75-b693-4723-a94e-e082fa864d3d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:22.626962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb9e39-b27a-4f4a-99ba-0c3382861b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:22.627575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb9e39-b27a-4f4a-99ba-0c3382861b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:22.627852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb9e39-b27a-4f4a-99ba-0c3382861b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:22.628121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb9e39-b27a-4f4a-99ba-0c3382861b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:22.628774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb9e39-b27a-4f4a-99ba-0c3382861b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:22.630603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb9e39-b27a-4f4a-99ba-0c3382861b07 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:22.632154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:22.646541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1145/2261] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:12:22.650227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b1238-27d6-42ed-ac6a-ef687d04d006 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:22.661358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b1238-27d6-42ed-ac6a-ef687d04d006 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:22.665863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a7da3-009a-430e-8d3d-8eff7fface51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:22.666522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a7da3-009a-430e-8d3d-8eff7fface51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:22.666820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a7da3-009a-430e-8d3d-8eff7fface51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:22.667085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a7da3-009a-430e-8d3d-8eff7fface51 admin admin] PATH_INFO: `/v3/projects/0eba4cb41313429f9308fc984a5ef3d3/users/61a6caee7fcb499b9e32490ba1d1f402/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:22.681374 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a7da3-009a-430e-8d3d-8eff7fface51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eba4cb41313429f9308fc984a5ef3d3, user_id=61a6caee7fcb499b9e32490ba1d1f402, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:22.684404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a7da3-009a-430e-8d3d-8eff7fface51 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:22.698616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1117/2262] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:12:22 2022] PUT /identity/v3/projects/0eba4cb41313429f9308fc984a5ef3d3/users/61a6caee7fcb499b9e32490ba1d1f402/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:22.710858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa785458-3cb1-409f-aae6-7d4b32351415 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:22.711144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa785458-3cb1-409f-aae6-7d4b32351415 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:22.711417 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa785458-3cb1-409f-aae6-7d4b32351415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:22.741632 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fa785458-3cb1-409f-aae6-7d4b32351415 None None] MFA Rules not processed for user `61a6caee7fcb499b9e32490ba1d1f402`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:22.742926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fa785458-3cb1-409f-aae6-7d4b32351415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:22.811092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1146/2263] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:22.822849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a7da3-009a-430e-8d3d-8eff7fface51 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:22.825376 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ed7a7da3-009a-430e-8d3d-8eff7fface51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:22.886340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a7da3-009a-430e-8d3d-8eff7fface51 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:22.890903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67baa510-34f5-4146-bcb2-3b1cccd70d01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:22.891509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67baa510-34f5-4146-bcb2-3b1cccd70d01 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:22.891780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67baa510-34f5-4146-bcb2-3b1cccd70d01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:22.892043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67baa510-34f5-4146-bcb2-3b1cccd70d01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:22.900439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67baa510-34f5-4146-bcb2-3b1cccd70d01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:22.901930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67baa510-34f5-4146-bcb2-3b1cccd70d01 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:22.911175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1118/2264] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:24.835153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa785458-3cb1-409f-aae6-7d4b32351415 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:24.836699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fa785458-3cb1-409f-aae6-7d4b32351415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:24.907507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa785458-3cb1-409f-aae6-7d4b32351415 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:24.912357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:24.913376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:24.913864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:24.914204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] PATH_INFO: `/v3/users/0a3f9fb281d64a22b827814cbd8c3a61` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:24.915585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a3f9fb281d64a22b827814cbd8c3a61)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:24.917582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:25.002844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a3f9fb281d64a22b827814cbd8c3a61'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:25.013761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a3f9fb281d64a22b827814cbd8c3a61'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:25.014485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a3f9fb281d64a22b827814cbd8c3a61'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:25.023033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a3f9fb281d64a22b827814cbd8c3a61'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:25.039078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a3f9fb281d64a22b827814cbd8c3a61'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:25.046170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1147/2265] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:12:24 2022] DELETE /identity/v3/users/0a3f9fb281d64a22b827814cbd8c3a61 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:25.050588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb066-667a-43cd-bea4-d9359a0200b0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:25.051058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb066-667a-43cd-bea4-d9359a0200b0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:25.051151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb066-667a-43cd-bea4-d9359a0200b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:25.076096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f51eb066-667a-43cd-bea4-d9359a0200b0 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:25.077319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f51eb066-667a-43cd-bea4-d9359a0200b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:25.145744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1119/2266] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:25.170294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:25.171952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:25.184002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:25.253250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1790b-d318-4943-8227-1d4bb44aa413 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:25.258259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5314c7-d9e1-4ee3-80e1-689d211f626e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:25.258669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5314c7-d9e1-4ee3-80e1-689d211f626e service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:25.259010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5314c7-d9e1-4ee3-80e1-689d211f626e service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:25.259349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5314c7-d9e1-4ee3-80e1-689d211f626e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:25.269908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5314c7-d9e1-4ee3-80e1-689d211f626e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:25.271537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5314c7-d9e1-4ee3-80e1-689d211f626e service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:25.282229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1148/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:25.539885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eb066-667a-43cd-bea4-d9359a0200b0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:25.541344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f51eb066-667a-43cd-bea4-d9359a0200b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:25.553352 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eb066-667a-43cd-bea4-d9359a0200b0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:25.558184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:25.558671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:25.559008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:25.559290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] PATH_INFO: `/v3/users/61a6caee7fcb499b9e32490ba1d1f402` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:25.560903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a6caee7fcb499b9e32490ba1d1f402)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:25.562888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:25.565530 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:25.621178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a6caee7fcb499b9e32490ba1d1f402'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:25.622072 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a6caee7fcb499b9e32490ba1d1f402'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:25.631908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a6caee7fcb499b9e32490ba1d1f402'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:25.641349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a6caee7fcb499b9e32490ba1d1f402'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:25.642931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a6caee7fcb499b9e32490ba1d1f402'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:25.664516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1120/2268] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:12:25 2022] DELETE /identity/v3/users/61a6caee7fcb499b9e32490ba1d1f402 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:25.669956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a60521-5620-4906-a1dc-b00d59ffb73b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:25.670251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a60521-5620-4906-a1dc-b00d59ffb73b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:25.670528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a60521-5620-4906-a1dc-b00d59ffb73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:25.702189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-69a60521-5620-4906-a1dc-b00d59ffb73b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:25.703829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-69a60521-5620-4906-a1dc-b00d59ffb73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:25.789821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1149/2269] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:25.802441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:25.803908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:25.900960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ae785-dea2-4a18-841c-3a683d3436f9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:25.914303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a60521-5620-4906-a1dc-b00d59ffb73b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:25.915650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c114b5-d743-475f-b1d2-40da1a22d4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:25.915882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-69a60521-5620-4906-a1dc-b00d59ffb73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:25.916301 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c114b5-d743-475f-b1d2-40da1a22d4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:25.916576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c114b5-d743-475f-b1d2-40da1a22d4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:25.916843 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c114b5-d743-475f-b1d2-40da1a22d4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:25.930194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a60521-5620-4906-a1dc-b00d59ffb73b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:25.934095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c114b5-d743-475f-b1d2-40da1a22d4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:25.935719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:25.936124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c114b5-d743-475f-b1d2-40da1a22d4f1 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:25.936749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:25.937241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:25.937542 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] PATH_INFO: `/v3/projects/ac85e577cbfa4219bec065ee1ee64941` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:25.938750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac85e577cbfa4219bec065ee1ee64941)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:25.941175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:25.960238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1121/2270] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:12:26.000076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac85e577cbfa4219bec065ee1ee64941', 'request_id': 'req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:26.008345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac85e577cbfa4219bec065ee1ee64941', 'request_id': 'req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:26.015111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac85e577cbfa4219bec065ee1ee64941', 'request_id': 'req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:26.027790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] The token cache is being invalidate because project ac85e577cbfa4219bec065ee1ee64941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:12:26.028302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:26.028967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a171edb8-d0ce-48a2-b198-dc9fcf4f7673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:26.030769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1150/2271] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:12:25 2022] DELETE /identity/v3/projects/ac85e577cbfa4219bec065ee1ee64941 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:26.267548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c114b5-d743-475f-b1d2-40da1a22d4f1 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:12:26.269012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-35c114b5-d743-475f-b1d2-40da1a22d4f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:26.285868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c114b5-d743-475f-b1d2-40da1a22d4f1 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:12:26.353430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:12:26.354609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:26.354972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:26.355337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] PATH_INFO: `/v3/projects/0eba4cb41313429f9308fc984a5ef3d3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:26.356652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eba4cb41313429f9308fc984a5ef3d3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:12:26.358775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:12:26.392853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:26.411397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eba4cb41313429f9308fc984a5ef3d3', 'request_id': 'req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:26.416769 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eba4cb41313429f9308fc984a5ef3d3', 'request_id': 'req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:26.424926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eba4cb41313429f9308fc984a5ef3d3', 'request_id': 'req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:26.436135 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] The token cache is being invalidate because project 0eba4cb41313429f9308fc984a5ef3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:12:26.436418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:26.437025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7f18c7d4-961c-4bfb-becd-9e9c70dd0979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:12:26.438543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1122/2272] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:12:26 2022] DELETE /identity/v3/projects/0eba4cb41313429f9308fc984a5ef3d3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:12:36.023924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:36.433070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:40.952594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f5612-5f84-4319-91cb-b68580f3961d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:12:40.953153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f5612-5f84-4319-91cb-b68580f3961d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:12:40.953153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f5612-5f84-4319-91cb-b68580f3961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:12:40.972848 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3b1f5612-5f84-4319-91cb-b68580f3961d None None] MFA Rules not processed for user `f1a734b8ca2d4658be2bc600d8c3f24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:12:40.974000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3b1f5612-5f84-4319-91cb-b68580f3961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:12:41.029238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1151/2273] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:12:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:12:51.022511 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=25 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:14.968351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086db6-0af7-4b2c-9194-f34b1a405851 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:14.968351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086db6-0af7-4b2c-9194-f34b1a405851 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:14.968351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086db6-0af7-4b2c-9194-f34b1a405851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:14.995116 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ae086db6-0af7-4b2c-9194-f34b1a405851 None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:13:14.996906 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ae086db6-0af7-4b2c-9194-f34b1a405851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:15.081123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1123/2274] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:13:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:13:15.148217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f5612-5f84-4319-91cb-b68580f3961d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:13:15.149899 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3b1f5612-5f84-4319-91cb-b68580f3961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:15.261101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f5612-5f84-4319-91cb-b68580f3961d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:13:15.272340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a94346-140a-4df6-8810-6e11ee67e9c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:13:15.272995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a94346-140a-4df6-8810-6e11ee67e9c5 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:15.273276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a94346-140a-4df6-8810-6e11ee67e9c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:15.273546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a94346-140a-4df6-8810-6e11ee67e9c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:15.283112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a94346-140a-4df6-8810-6e11ee67e9c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:13:15.285400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a94346-140a-4df6-8810-6e11ee67e9c5 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:13:15.298251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1152/2275] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:13:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:13:24.083982 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae086db6-0af7-4b2c-9194-f34b1a405851 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:13:24.086408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ae086db6-0af7-4b2c-9194-f34b1a405851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:24.266771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae086db6-0af7-4b2c-9194-f34b1a405851 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:13:24.273192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861c5f6-d211-4973-9a3a-8564c0247dcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:13:24.275956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861c5f6-d211-4973-9a3a-8564c0247dcc service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:24.276537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861c5f6-d211-4973-9a3a-8564c0247dcc service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:24.276813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861c5f6-d211-4973-9a3a-8564c0247dcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:24.285825 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1861c5f6-d211-4973-9a3a-8564c0247dcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:24.307292 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861c5f6-d211-4973-9a3a-8564c0247dcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:13:24.311012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861c5f6-d211-4973-9a3a-8564c0247dcc service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:13:24.333510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1124/2276] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:13:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:13:25.292070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=32 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:29.269701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53efc9-a545-42e3-a72c-9345e54fc21c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:29.270367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53efc9-a545-42e3-a72c-9345e54fc21c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:29.270367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53efc9-a545-42e3-a72c-9345e54fc21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:29.301872 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-be53efc9-a545-42e3-a72c-9345e54fc21c None None] MFA Rules not processed for user `e5d4998f54924ecab01a6dbc64b6d9db`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:13:29.303357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-be53efc9-a545-42e3-a72c-9345e54fc21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:29.373790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1153/2277] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:13:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:13:30.705163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46888f-82e5-4eb3-8f37-1967d609ac34 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:30.706354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46888f-82e5-4eb3-8f37-1967d609ac34 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:30.707008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46888f-82e5-4eb3-8f37-1967d609ac34 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:30.709081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1125/2278] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:13:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:13:30.718610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc13871-cc5b-4017-9c82-da142ec154e5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:30.719030 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc13871-cc5b-4017-9c82-da142ec154e5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:30.719131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc13871-cc5b-4017-9c82-da142ec154e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:30.740043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4dc13871-cc5b-4017-9c82-da142ec154e5 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:13:30.741260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4dc13871-cc5b-4017-9c82-da142ec154e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:30.817404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1154/2279] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:13:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:13:30.829257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46888f-82e5-4eb3-8f37-1967d609ac34 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:13:30.831010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5f46888f-82e5-4eb3-8f37-1967d609ac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:30.899101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46888f-82e5-4eb3-8f37-1967d609ac34 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:13:30.903374 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3223b-d358-4241-bceb-611a840fd000 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22e60fc95af4a0a94b15f9ed9e3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:13:30.904047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3223b-d358-4241-bceb-611a840fd000 service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:30.904322 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3223b-d358-4241-bceb-611a840fd000 service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:30.904598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3223b-d358-4241-bceb-611a840fd000 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:30.915370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3223b-d358-4241-bceb-611a840fd000 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:13:30.916817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3223b-d358-4241-bceb-611a840fd000 service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:13:30.928004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1126/2280] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:13:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:13:31.010800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5061d-3113-4ab6-a011-5145b1fcf931 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:31.011070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5061d-3113-4ab6-a011-5145b1fcf931 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:31.011383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5061d-3113-4ab6-a011-5145b1fcf931 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:31.013440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1155/2281] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:13:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:13:31.020353 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12710-c799-472d-ae50-8501d6b7aa27 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:31.020633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12710-c799-472d-ae50-8501d6b7aa27 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:31.020909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12710-c799-472d-ae50-8501d6b7aa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:31.044022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e5b12710-c799-472d-ae50-8501d6b7aa27 None None] MFA Rules not processed for user `d512b60a42ed456a82dff11d17b77c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:13:31.045492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e5b12710-c799-472d-ae50-8501d6b7aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:31.081404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:31.102287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1127/2282] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:13:31.115067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5061d-3113-4ab6-a011-5145b1fcf931 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:13:31.116864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-eda5061d-3113-4ab6-a011-5145b1fcf931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:31.142714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5061d-3113-4ab6-a011-5145b1fcf931 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:13:31.147087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc22b-601d-46b5-8d05-0954cdcbc3ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:13:31.147881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc22b-601d-46b5-8d05-0954cdcbc3ad service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:31.149166 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc22b-601d-46b5-8d05-0954cdcbc3ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:31.149604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc22b-601d-46b5-8d05-0954cdcbc3ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:31.161554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fc22b-601d-46b5-8d05-0954cdcbc3ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:13:31.163298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fc22b-601d-46b5-8d05-0954cdcbc3ad service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:13:31.180133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1156/2283] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:13:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:13:31.330493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623b5e-d46a-4dd4-b913-72763681855a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:31.330907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623b5e-d46a-4dd4-b913-72763681855a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:31.331279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623b5e-d46a-4dd4-b913-72763681855a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:31.332745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1128/2284] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:13:31.343279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde6dc7-153e-4626-8b60-a36e4c238c04 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:31.344233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde6dc7-153e-4626-8b60-a36e4c238c04 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:31.344719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde6dc7-153e-4626-8b60-a36e4c238c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:31.380883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5cde6dc7-153e-4626-8b60-a36e4c238c04 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:13:31.382507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5cde6dc7-153e-4626-8b60-a36e4c238c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:31.395586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1157/2285] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:13:31.409211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623b5e-d46a-4dd4-b913-72763681855a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:13:31.422696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623b5e-d46a-4dd4-b913-72763681855a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:13:31.426351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e7a02-d3e9-46e2-b7b9-ddb951444c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:13:31.426969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e7a02-d3e9-46e2-b7b9-ddb951444c2c service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:31.427249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e7a02-d3e9-46e2-b7b9-ddb951444c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:31.427544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e7a02-d3e9-46e2-b7b9-ddb951444c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:31.438386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e7a02-d3e9-46e2-b7b9-ddb951444c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:13:31.439817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e7a02-d3e9-46e2-b7b9-ddb951444c2c service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:13:31.452706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1129/2286] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:13:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:13:35.238357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20935ec-a68b-4d98-9de1-effbf94f7be4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:35.238844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20935ec-a68b-4d98-9de1-effbf94f7be4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:35.238952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20935ec-a68b-4d98-9de1-effbf94f7be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:35.258725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c20935ec-a68b-4d98-9de1-effbf94f7be4 None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:13:35.259957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c20935ec-a68b-4d98-9de1-effbf94f7be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:35.267574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1158/2287] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:13:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:13:35.280522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e7a02-d3e9-46e2-b7b9-ddb951444c2c service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:13:35.298665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e7a02-d3e9-46e2-b7b9-ddb951444c2c service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:13:35.304091 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfa286-1991-4823-b791-7022f7008106 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:13:35.304712 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfa286-1991-4823-b791-7022f7008106 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:35.304987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfa286-1991-4823-b791-7022f7008106 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:35.305257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfa286-1991-4823-b791-7022f7008106 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:35.314513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfa286-1991-4823-b791-7022f7008106 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:13:35.316119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfa286-1991-4823-b791-7022f7008106 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:13:35.324795 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1130/2288] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:13:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:13:45.253054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=68 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:45.321128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=18 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:51.326541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fdd2d-f116-4885-9fc1-8a3a6c7f7b2b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:51.327025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fdd2d-f116-4885-9fc1-8a3a6c7f7b2b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:51.327125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fdd2d-f116-4885-9fc1-8a3a6c7f7b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:51.347256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-856fdd2d-f116-4885-9fc1-8a3a6c7f7b2b None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:13:51.348446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-856fdd2d-f116-4885-9fc1-8a3a6c7f7b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:13:51.356287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1159/2289] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 22 22:13:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:13:51.371965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfa286-1991-4823-b791-7022f7008106 service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:13:51.384730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfa286-1991-4823-b791-7022f7008106 service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:13:51.390931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb6035-9ffa-4b59-973a-652c1f9039d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:13:51.391932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb6035-9ffa-4b59-973a-652c1f9039d7 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:13:51.392178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb6035-9ffa-4b59-973a-652c1f9039d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:13:51.392477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb6035-9ffa-4b59-973a-652c1f9039d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:13:51.401407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb6035-9ffa-4b59-973a-652c1f9039d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:13:51.403036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb6035-9ffa-4b59-973a-652c1f9039d7 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:13:51.411889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1131/2290] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:13:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:14:01.341644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:01.408728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:03.992710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ad3e8-1745-4164-9104-0b64ec8ddb92 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:14:03.993218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ad3e8-1745-4164-9104-0b64ec8ddb92 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:14:03.993328 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ad3e8-1745-4164-9104-0b64ec8ddb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:14:04.013574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2b4ad3e8-1745-4164-9104-0b64ec8ddb92 None None] MFA Rules not processed for user `f1a734b8ca2d4658be2bc600d8c3f24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:14:04.014816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2b4ad3e8-1745-4164-9104-0b64ec8ddb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:14:04.022635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1160/2291] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:14:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:14:14.007837 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:37.645280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906530-a7d0-482b-99de-129fbbc179fa None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:14:37.645872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906530-a7d0-482b-99de-129fbbc179fa None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:14:37.645872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906530-a7d0-482b-99de-129fbbc179fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:14:37.665266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9d906530-a7d0-482b-99de-129fbbc179fa None None] MFA Rules not processed for user `664ca23211794b9dade2baf58b884c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:14:37.666781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9d906530-a7d0-482b-99de-129fbbc179fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:14:37.733333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1132/2292] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:14:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:14:40.442669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2dd26-a5f0-4aec-93c5-1b7ffe22d56c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:14:40.443215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2dd26-a5f0-4aec-93c5-1b7ffe22d56c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:14:40.443215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2dd26-a5f0-4aec-93c5-1b7ffe22d56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:14:40.464851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-57e2dd26-a5f0-4aec-93c5-1b7ffe22d56c None None] MFA Rules not processed for user `fb6cbee941b24530bb6c1bfd61a64a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:14:40.464851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-57e2dd26-a5f0-4aec-93c5-1b7ffe22d56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:14:40.520993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1161/2293] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:14:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:14:47.580756 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f4a7a-1a34-4af6-9e76-780fbf97281c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:14:47.581350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f4a7a-1a34-4af6-9e76-780fbf97281c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:14:47.581350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f4a7a-1a34-4af6-9e76-780fbf97281c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:14:47.601900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-852f4a7a-1a34-4af6-9e76-780fbf97281c None None] MFA Rules not processed for user `e5d4998f54924ecab01a6dbc64b6d9db`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:14:47.603207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-852f4a7a-1a34-4af6-9e76-780fbf97281c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:14:47.610414 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1133/2294] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:14:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:14:50.513845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=25 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:57.595968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=28 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:14.215084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2dd26-a5f0-4aec-93c5-1b7ffe22d56c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:14.216639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-57e2dd26-a5f0-4aec-93c5-1b7ffe22d56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:14.289386 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2dd26-a5f0-4aec-93c5-1b7ffe22d56c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:14.294297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df21ef-1cdc-4474-ae17-d1cc55f4dbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:14.295000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df21ef-1cdc-4474-ae17-d1cc55f4dbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:14.295308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df21ef-1cdc-4474-ae17-d1cc55f4dbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:14.295623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df21ef-1cdc-4474-ae17-d1cc55f4dbc9 admin admin] PATH_INFO: `/v3/users/f1a734b8ca2d4658be2bc600d8c3f24d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:14.296820 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df21ef-1cdc-4474-ae17-d1cc55f4dbc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a734b8ca2d4658be2bc600d8c3f24d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:14.298806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df21ef-1cdc-4474-ae17-d1cc55f4dbc9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:14.346721 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-61df21ef-1cdc-4474-ae17-d1cc55f4dbc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a734b8ca2d4658be2bc600d8c3f24d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:14.356724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-61df21ef-1cdc-4474-ae17-d1cc55f4dbc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a734b8ca2d4658be2bc600d8c3f24d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:14.357322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-61df21ef-1cdc-4474-ae17-d1cc55f4dbc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a734b8ca2d4658be2bc600d8c3f24d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:14.366879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-61df21ef-1cdc-4474-ae17-d1cc55f4dbc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a734b8ca2d4658be2bc600d8c3f24d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:14.379245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-61df21ef-1cdc-4474-ae17-d1cc55f4dbc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a734b8ca2d4658be2bc600d8c3f24d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:14.385391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1162/2295] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:14 2022] DELETE /identity/v3/users/f1a734b8ca2d4658be2bc600d8c3f24d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:14.562950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f4a7a-1a34-4af6-9e76-780fbf97281c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:14.574688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f4a7a-1a34-4af6-9e76-780fbf97281c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:14.636950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:14.637583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:14.637991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:14.638296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] PATH_INFO: `/v3/projects/2e9e0bbed9004d7398f04f9338335202` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:14.639823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9e0bbed9004d7398f04f9338335202)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:14.641676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:14.689799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9e0bbed9004d7398f04f9338335202', 'request_id': 'req-53d937dd-33c0-4a55-b24d-ddf595f93aef'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:14.696192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9e0bbed9004d7398f04f9338335202', 'request_id': 'req-53d937dd-33c0-4a55-b24d-ddf595f93aef'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:14.705705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9e0bbed9004d7398f04f9338335202', 'request_id': 'req-53d937dd-33c0-4a55-b24d-ddf595f93aef'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:14.717635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] The token cache is being invalidate because project 2e9e0bbed9004d7398f04f9338335202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:14.717952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:14.718616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-53d937dd-33c0-4a55-b24d-ddf595f93aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:14.720140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1134/2296] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:14 2022] DELETE /identity/v3/projects/2e9e0bbed9004d7398f04f9338335202 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:14.725087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f9d2-f40a-4d47-b736-0d7691db2b8a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:14.725373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f9d2-f40a-4d47-b736-0d7691db2b8a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:14.725647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f9d2-f40a-4d47-b736-0d7691db2b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:14.746562 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8311f9d2-f40a-4d47-b736-0d7691db2b8a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:14.747752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8311f9d2-f40a-4d47-b736-0d7691db2b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:14.809448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1163/2297] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:14.817495 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93debe-dc11-45a7-8e7f-d4c784f2987d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:14.817742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93debe-dc11-45a7-8e7f-d4c784f2987d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:14.818053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93debe-dc11-45a7-8e7f-d4c784f2987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:14.839247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bc93debe-dc11-45a7-8e7f-d4c784f2987d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:14.840450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bc93debe-dc11-45a7-8e7f-d4c784f2987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:14.848769 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1135/2298] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:14.853041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311f9d2-f40a-4d47-b736-0d7691db2b8a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:14.863501 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311f9d2-f40a-4d47-b736-0d7691db2b8a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:14.868314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13610-0033-4ec2-ae21-d89956f3937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:14.868917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13610-0033-4ec2-ae21-d89956f3937b admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:14.869192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13610-0033-4ec2-ae21-d89956f3937b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:14.869462 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13610-0033-4ec2-ae21-d89956f3937b admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:14.870180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b13610-0033-4ec2-ae21-d89956f3937b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:15:14.870480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b13610-0033-4ec2-ae21-d89956f3937b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:14.872087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b13610-0033-4ec2-ae21-d89956f3937b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:14.883871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1164/2299] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:15:14.888349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93debe-dc11-45a7-8e7f-d4c784f2987d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:14.897627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93debe-dc11-45a7-8e7f-d4c784f2987d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:14.902898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86787f17-10bd-47d1-8e56-185e2c9a13d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:14.903682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86787f17-10bd-47d1-8e56-185e2c9a13d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:14.903964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86787f17-10bd-47d1-8e56-185e2c9a13d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:14.904386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86787f17-10bd-47d1-8e56-185e2c9a13d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:14.905024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86787f17-10bd-47d1-8e56-185e2c9a13d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:14.907039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86787f17-10bd-47d1-8e56-185e2c9a13d2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:14.937005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1136/2300] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:14 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:15:14.941584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13610-0033-4ec2-ae21-d89956f3937b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:14.952658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13610-0033-4ec2-ae21-d89956f3937b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:14.956333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:15.010429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104838b6-b03f-4840-a65c-00525ffeaeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:15.011040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104838b6-b03f-4840-a65c-00525ffeaeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.011290 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104838b6-b03f-4840-a65c-00525ffeaeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.011559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104838b6-b03f-4840-a65c-00525ffeaeb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.012199 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104838b6-b03f-4840-a65c-00525ffeaeb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:15.014205 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104838b6-b03f-4840-a65c-00525ffeaeb2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:15.038550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1165/2301] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:14 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:15.042922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86787f17-10bd-47d1-8e56-185e2c9a13d2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:15.053509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86787f17-10bd-47d1-8e56-185e2c9a13d2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:15.058641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938efd9-c184-456d-a541-83bf4166fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:15.059240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938efd9-c184-456d-a541-83bf4166fdea admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.059532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938efd9-c184-456d-a541-83bf4166fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.059794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938efd9-c184-456d-a541-83bf4166fdea admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.060438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938efd9-c184-456d-a541-83bf4166fdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:15.062161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938efd9-c184-456d-a541-83bf4166fdea admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:15.072435 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1137/2302] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:15.076734 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104838b6-b03f-4840-a65c-00525ffeaeb2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:15.086816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104838b6-b03f-4840-a65c-00525ffeaeb2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:15.091608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61310ec-c9bb-4f37-afc9-58d5a1c2306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:15.092350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61310ec-c9bb-4f37-afc9-58d5a1c2306a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.092619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61310ec-c9bb-4f37-afc9-58d5a1c2306a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.092894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61310ec-c9bb-4f37-afc9-58d5a1c2306a admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.093533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61310ec-c9bb-4f37-afc9-58d5a1c2306a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:15.095186 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61310ec-c9bb-4f37-afc9-58d5a1c2306a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:15.108702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1166/2303] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:15.114849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938efd9-c184-456d-a541-83bf4166fdea admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:15.125407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938efd9-c184-456d-a541-83bf4166fdea admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:15.131233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741aa35-41f8-49f1-9445-8ed2c85df9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:15.131884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741aa35-41f8-49f1-9445-8ed2c85df9ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.132155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741aa35-41f8-49f1-9445-8ed2c85df9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.132417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741aa35-41f8-49f1-9445-8ed2c85df9ad admin admin] PATH_INFO: `/v3/projects/6e4c2c8f3c4541d48460ca2286974b0c/users/b74f29d4482e44489a8bd0651a19d4ec/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.148796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741aa35-41f8-49f1-9445-8ed2c85df9ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4c2c8f3c4541d48460ca2286974b0c, user_id=b74f29d4482e44489a8bd0651a19d4ec, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:15.151416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741aa35-41f8-49f1-9445-8ed2c85df9ad admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:15.167554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1138/2304] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:15 2022] PUT /identity/v3/projects/6e4c2c8f3c4541d48460ca2286974b0c/users/b74f29d4482e44489a8bd0651a19d4ec/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:15.178348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2fa0c-368f-4077-9306-2f384ba970ff None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.178634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2fa0c-368f-4077-9306-2f384ba970ff None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.178909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2fa0c-368f-4077-9306-2f384ba970ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.207420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-84f2fa0c-368f-4077-9306-2f384ba970ff None None] MFA Rules not processed for user `b74f29d4482e44489a8bd0651a19d4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:15.208806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-84f2fa0c-368f-4077-9306-2f384ba970ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:15.274719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1167/2305] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:15.279517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741aa35-41f8-49f1-9445-8ed2c85df9ad admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:15.311432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:15.346187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741aa35-41f8-49f1-9445-8ed2c85df9ad admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:15.351949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0727-a02c-4c25-a7b5-32ae7b5416ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:15.352554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0727-a02c-4c25-a7b5-32ae7b5416ae admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.352831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0727-a02c-4c25-a7b5-32ae7b5416ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.353065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0727-a02c-4c25-a7b5-32ae7b5416ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.353685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b0727-a02c-4c25-a7b5-32ae7b5416ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:15.355617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b0727-a02c-4c25-a7b5-32ae7b5416ae admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:15.385657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1139/2306] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:15 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:15.390247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2fa0c-368f-4077-9306-2f384ba970ff None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:15.401570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2fa0c-368f-4077-9306-2f384ba970ff None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:15.459819 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c264a80-fd2f-4452-a5a9-1c4ae0eb0000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:15.460655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c264a80-fd2f-4452-a5a9-1c4ae0eb0000 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.460924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c264a80-fd2f-4452-a5a9-1c4ae0eb0000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.461269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c264a80-fd2f-4452-a5a9-1c4ae0eb0000 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.462340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c264a80-fd2f-4452-a5a9-1c4ae0eb0000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:15.465477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c264a80-fd2f-4452-a5a9-1c4ae0eb0000 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:15.496148 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1168/2307] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:15 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:15.500241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0727-a02c-4c25-a7b5-32ae7b5416ae admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:15.510571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0727-a02c-4c25-a7b5-32ae7b5416ae admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:15.515698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bfe55-ec4f-43d1-9005-4be4815f6a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:15.516293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bfe55-ec4f-43d1-9005-4be4815f6a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.516593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bfe55-ec4f-43d1-9005-4be4815f6a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.516860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bfe55-ec4f-43d1-9005-4be4815f6a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.517498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bfe55-ec4f-43d1-9005-4be4815f6a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:15.519107 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bfe55-ec4f-43d1-9005-4be4815f6a75 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:15.529703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1140/2308] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:15.534549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c264a80-fd2f-4452-a5a9-1c4ae0eb0000 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:15.543935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:15.548610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c264a80-fd2f-4452-a5a9-1c4ae0eb0000 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:15.555049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493de75d-c489-4f13-9644-987b2e5fd353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:15.555884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493de75d-c489-4f13-9644-987b2e5fd353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.556413 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493de75d-c489-4f13-9644-987b2e5fd353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.556689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493de75d-c489-4f13-9644-987b2e5fd353 admin admin] PATH_INFO: `/v3/projects/b9bbfaacacbe4763a6613ae9d40cec13/users/5d3a446d48cf4806a58d8bfe6bc5fb9f/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.572227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493de75d-c489-4f13-9644-987b2e5fd353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bbfaacacbe4763a6613ae9d40cec13, user_id=5d3a446d48cf4806a58d8bfe6bc5fb9f, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:15.574933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493de75d-c489-4f13-9644-987b2e5fd353 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:15.591869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1169/2309] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:15 2022] PUT /identity/v3/projects/b9bbfaacacbe4763a6613ae9d40cec13/users/5d3a446d48cf4806a58d8bfe6bc5fb9f/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:15.596386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bfe55-ec4f-43d1-9005-4be4815f6a75 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:15.611833 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bfe55-ec4f-43d1-9005-4be4815f6a75 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:15.679214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7675102-4d01-4c9e-a8c4-8786fe22ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:15.679719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675102-4d01-4c9e-a8c4-8786fe22ab18 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.679990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675102-4d01-4c9e-a8c4-8786fe22ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.680257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675102-4d01-4c9e-a8c4-8786fe22ab18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.680887 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7675102-4d01-4c9e-a8c4-8786fe22ab18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:15.682516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7675102-4d01-4c9e-a8c4-8786fe22ab18 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:15.694144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1141/2310] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:15.698574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493de75d-c489-4f13-9644-987b2e5fd353 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:15.710707 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493de75d-c489-4f13-9644-987b2e5fd353 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:15.717535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f6982-6a9f-4246-a7a1-d47385dc2d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:15.717761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6982-6a9f-4246-a7a1-d47385dc2d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.718095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6982-6a9f-4246-a7a1-d47385dc2d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.718310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6982-6a9f-4246-a7a1-d47385dc2d45 admin admin] PATH_INFO: `/v3/projects/b9bbfaacacbe4763a6613ae9d40cec13/users/5d3a446d48cf4806a58d8bfe6bc5fb9f/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.720609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f6982-6a9f-4246-a7a1-d47385dc2d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bbfaacacbe4763a6613ae9d40cec13, user_id=5d3a446d48cf4806a58d8bfe6bc5fb9f, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:15.723363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f6982-6a9f-4246-a7a1-d47385dc2d45 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:15.735252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1170/2311] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:15 2022] PUT /identity/v3/projects/b9bbfaacacbe4763a6613ae9d40cec13/users/5d3a446d48cf4806a58d8bfe6bc5fb9f/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:15:15.747090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221c6fd-c56c-43cb-8f3e-9fbe56e17627 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.747371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221c6fd-c56c-43cb-8f3e-9fbe56e17627 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.747647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221c6fd-c56c-43cb-8f3e-9fbe56e17627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.776682 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d221c6fd-c56c-43cb-8f3e-9fbe56e17627 None None] MFA Rules not processed for user `5d3a446d48cf4806a58d8bfe6bc5fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:15.777956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d221c6fd-c56c-43cb-8f3e-9fbe56e17627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:15.851026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1142/2312] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:15.863149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f6982-6a9f-4246-a7a1-d47385dc2d45 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:15.864999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-900f6982-6a9f-4246-a7a1-d47385dc2d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:15.928307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f6982-6a9f-4246-a7a1-d47385dc2d45 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:15.933522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fbb5f-4f0d-4219-956f-7531bf2df36c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:15.934350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fbb5f-4f0d-4219-956f-7531bf2df36c service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:15.934676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fbb5f-4f0d-4219-956f-7531bf2df36c service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:15.934989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fbb5f-4f0d-4219-956f-7531bf2df36c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:15.948876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fbb5f-4f0d-4219-956f-7531bf2df36c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:15.951113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fbb5f-4f0d-4219-956f-7531bf2df36c service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:15.960933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1171/2313] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:16.058954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221c6fd-c56c-43cb-8f3e-9fbe56e17627 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:16.070198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221c6fd-c56c-43cb-8f3e-9fbe56e17627 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:16.074797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4ff46-c373-4aaf-bb80-4cef3dbda1a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:16.075400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ff46-c373-4aaf-bb80-4cef3dbda1a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:16.075703 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ff46-c373-4aaf-bb80-4cef3dbda1a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:16.075974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ff46-c373-4aaf-bb80-4cef3dbda1a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:16.095879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:16.135591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4ff46-c373-4aaf-bb80-4cef3dbda1a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:16.137119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4ff46-c373-4aaf-bb80-4cef3dbda1a3 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:16.146270 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1143/2314] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:23.157854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fbb5f-4f0d-4219-956f-7531bf2df36c service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:23.238448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fbb5f-4f0d-4219-956f-7531bf2df36c service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:23.243798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:23.244435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:23.244709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:23.244978 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] PATH_INFO: `/v3/users/b74f29d4482e44489a8bd0651a19d4ec` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:23.246154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74f29d4482e44489a8bd0651a19d4ec)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:23.248067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:23.297895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74f29d4482e44489a8bd0651a19d4ec'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:23.305917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74f29d4482e44489a8bd0651a19d4ec'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:23.306524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74f29d4482e44489a8bd0651a19d4ec'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:23.313259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74f29d4482e44489a8bd0651a19d4ec'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:23.320071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:23.327682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74f29d4482e44489a8bd0651a19d4ec'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:23.335847 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1172/2315] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:23 2022] DELETE /identity/v3/users/b74f29d4482e44489a8bd0651a19d4ec => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:23.340478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3263c27-cc1b-4fc8-a466-d68bd0ff6f11 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:23.340952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3263c27-cc1b-4fc8-a466-d68bd0ff6f11 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:23.341069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3263c27-cc1b-4fc8-a466-d68bd0ff6f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:23.361317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a3263c27-cc1b-4fc8-a466-d68bd0ff6f11 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:23.362532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a3263c27-cc1b-4fc8-a466-d68bd0ff6f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:23.430614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1144/2316] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:23.440587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:23.442202 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:23.505729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71456c3-1d1b-409c-8b14-c53ee5562168 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:23.509709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8343c42-1c3a-45fa-b483-930193d0ab33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:23.510361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8343c42-1c3a-45fa-b483-930193d0ab33 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:23.510637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8343c42-1c3a-45fa-b483-930193d0ab33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:23.510913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8343c42-1c3a-45fa-b483-930193d0ab33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:23.520258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8343c42-1c3a-45fa-b483-930193d0ab33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:23.521693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8343c42-1c3a-45fa-b483-930193d0ab33 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:23.531868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1173/2317] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:23.829187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3263c27-cc1b-4fc8-a466-d68bd0ff6f11 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:23.830875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a3263c27-cc1b-4fc8-a466-d68bd0ff6f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:23.843763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3263c27-cc1b-4fc8-a466-d68bd0ff6f11 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:23.849885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:23.854644 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:23.854930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:23.855209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] PATH_INFO: `/v3/projects/6e4c2c8f3c4541d48460ca2286974b0c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:23.856511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4c2c8f3c4541d48460ca2286974b0c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:23.858954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:23.907962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4c2c8f3c4541d48460ca2286974b0c', 'request_id': 'req-bd1f7620-af48-445f-aace-d212e3b7a662'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:23.913667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4c2c8f3c4541d48460ca2286974b0c', 'request_id': 'req-bd1f7620-af48-445f-aace-d212e3b7a662'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:23.922609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4c2c8f3c4541d48460ca2286974b0c', 'request_id': 'req-bd1f7620-af48-445f-aace-d212e3b7a662'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:23.933917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] The token cache is being invalidate because project 6e4c2c8f3c4541d48460ca2286974b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:23.934228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:23.934976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:23.936561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1145/2318] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:23 2022] DELETE /identity/v3/projects/6e4c2c8f3c4541d48460ca2286974b0c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:23.940907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8343c42-1c3a-45fa-b483-930193d0ab33 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:23.951138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8343c42-1c3a-45fa-b483-930193d0ab33 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:24.018866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41123f4-dae3-4b3b-abb7-6d8bff999a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:24.019415 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41123f4-dae3-4b3b-abb7-6d8bff999a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:24.019670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41123f4-dae3-4b3b-abb7-6d8bff999a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:24.019950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41123f4-dae3-4b3b-abb7-6d8bff999a7b admin admin] PATH_INFO: `/v3/users/5d3a446d48cf4806a58d8bfe6bc5fb9f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:24.021261 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41123f4-dae3-4b3b-abb7-6d8bff999a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3a446d48cf4806a58d8bfe6bc5fb9f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:24.023237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41123f4-dae3-4b3b-abb7-6d8bff999a7b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:24.074637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f41123f4-dae3-4b3b-abb7-6d8bff999a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3a446d48cf4806a58d8bfe6bc5fb9f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:24.083823 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f41123f4-dae3-4b3b-abb7-6d8bff999a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3a446d48cf4806a58d8bfe6bc5fb9f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:24.084464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f41123f4-dae3-4b3b-abb7-6d8bff999a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3a446d48cf4806a58d8bfe6bc5fb9f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:24.092209 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f41123f4-dae3-4b3b-abb7-6d8bff999a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3a446d48cf4806a58d8bfe6bc5fb9f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:24.104626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f41123f4-dae3-4b3b-abb7-6d8bff999a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3a446d48cf4806a58d8bfe6bc5fb9f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:24.111191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1174/2319] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:23 2022] DELETE /identity/v3/users/5d3a446d48cf4806a58d8bfe6bc5fb9f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:24.416958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:24.418784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:24.434447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f7620-af48-445f-aace-d212e3b7a662 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:24.478764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:24.497533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:24.498189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:24.498463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:24.498727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] PATH_INFO: `/v3/projects/b9bbfaacacbe4763a6613ae9d40cec13` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:24.499863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9bbfaacacbe4763a6613ae9d40cec13)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:24.501772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:24.551894 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9bbfaacacbe4763a6613ae9d40cec13', 'request_id': 'req-ed8a91da-76ac-4190-af9b-42c84b51b382'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:24.557898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9bbfaacacbe4763a6613ae9d40cec13', 'request_id': 'req-ed8a91da-76ac-4190-af9b-42c84b51b382'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:24.567595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9bbfaacacbe4763a6613ae9d40cec13', 'request_id': 'req-ed8a91da-76ac-4190-af9b-42c84b51b382'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:24.579582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] The token cache is being invalidate because project b9bbfaacacbe4763a6613ae9d40cec13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:24.579866 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:24.580607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ed8a91da-76ac-4190-af9b-42c84b51b382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:24.582242 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1146/2320] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:24 2022] DELETE /identity/v3/projects/b9bbfaacacbe4763a6613ae9d40cec13 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:24.587937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47be2a7-cf81-4767-a728-62c284cb5761 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:24.588424 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47be2a7-cf81-4767-a728-62c284cb5761 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:24.588525 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47be2a7-cf81-4767-a728-62c284cb5761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:24.617161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d47be2a7-cf81-4767-a728-62c284cb5761 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:24.618448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d47be2a7-cf81-4767-a728-62c284cb5761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:24.623960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:24.687530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1175/2321] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:15:24.695807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faba32-1ffa-4a32-a027-3bb771faee3c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:24.696081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faba32-1ffa-4a32-a027-3bb771faee3c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:24.696350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faba32-1ffa-4a32-a027-3bb771faee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:24.716837 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-69faba32-1ffa-4a32-a027-3bb771faee3c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:24.718068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-69faba32-1ffa-4a32-a027-3bb771faee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:24.726591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1147/2322] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:24.731032 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47be2a7-cf81-4767-a728-62c284cb5761 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:24.742003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47be2a7-cf81-4767-a728-62c284cb5761 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:24.747805 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9191e1-0a2a-4f8b-a44d-6131fa6ac5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:24.748410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9191e1-0a2a-4f8b-a44d-6131fa6ac5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:24.748690 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9191e1-0a2a-4f8b-a44d-6131fa6ac5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:24.749188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9191e1-0a2a-4f8b-a44d-6131fa6ac5b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:24.749869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9191e1-0a2a-4f8b-a44d-6131fa6ac5b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:15:24.750207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9191e1-0a2a-4f8b-a44d-6131fa6ac5b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:24.751793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9191e1-0a2a-4f8b-a44d-6131fa6ac5b6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:24.764228 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1176/2323] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:15:24.771000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69faba32-1ffa-4a32-a027-3bb771faee3c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:24.780634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69faba32-1ffa-4a32-a027-3bb771faee3c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:24.785742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d289c-1b0d-4fd6-a782-55116a9b506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:24.786396 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d289c-1b0d-4fd6-a782-55116a9b506d admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:24.786670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d289c-1b0d-4fd6-a782-55116a9b506d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:24.786937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d289c-1b0d-4fd6-a782-55116a9b506d admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:24.787566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d289c-1b0d-4fd6-a782-55116a9b506d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:24.789457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d289c-1b0d-4fd6-a782-55116a9b506d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:24.824510 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1148/2324] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:24 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:24.829274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9191e1-0a2a-4f8b-a44d-6131fa6ac5b6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:24.841031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9191e1-0a2a-4f8b-a44d-6131fa6ac5b6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:24.898782 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98846468-fe0d-4710-bf22-6ff27f29b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:24.899391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98846468-fe0d-4710-bf22-6ff27f29b34e admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:24.899664 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98846468-fe0d-4710-bf22-6ff27f29b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:24.899938 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98846468-fe0d-4710-bf22-6ff27f29b34e admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:24.900565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98846468-fe0d-4710-bf22-6ff27f29b34e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:24.902518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98846468-fe0d-4710-bf22-6ff27f29b34e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:24.930877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1177/2325] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:24 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:24.935330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d289c-1b0d-4fd6-a782-55116a9b506d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:24.952907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d289c-1b0d-4fd6-a782-55116a9b506d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:24.959992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177a19a-8b0d-4238-a407-6d0e0daa3593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:24.960627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a19a-8b0d-4238-a407-6d0e0daa3593 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:24.960903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a19a-8b0d-4238-a407-6d0e0daa3593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:24.961198 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a19a-8b0d-4238-a407-6d0e0daa3593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:24.961904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177a19a-8b0d-4238-a407-6d0e0daa3593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:24.963549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177a19a-8b0d-4238-a407-6d0e0daa3593 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:24.974922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1149/2326] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:24.979285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98846468-fe0d-4710-bf22-6ff27f29b34e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:24.991503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98846468-fe0d-4710-bf22-6ff27f29b34e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:24.997847 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c6e30-b4e8-4874-b0fd-ec8c6c233479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:24.998457 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6e30-b4e8-4874-b0fd-ec8c6c233479 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:24.998731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6e30-b4e8-4874-b0fd-ec8c6c233479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:24.998997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6e30-b4e8-4874-b0fd-ec8c6c233479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:24.999644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c6e30-b4e8-4874-b0fd-ec8c6c233479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:25.001267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c6e30-b4e8-4874-b0fd-ec8c6c233479 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:25.013873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1178/2327] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:25.019719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177a19a-8b0d-4238-a407-6d0e0daa3593 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:25.030181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177a19a-8b0d-4238-a407-6d0e0daa3593 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:25.034898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54871b86-6c70-4659-8499-525600018bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:25.035537 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871b86-6c70-4659-8499-525600018bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:25.035810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871b86-6c70-4659-8499-525600018bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:25.036129 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871b86-6c70-4659-8499-525600018bb5 admin admin] PATH_INFO: `/v3/projects/7db383e6f95a4d8eba9d4c8a4c3da5df/users/be24d0ac142342f7a3112ee38fa12577/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:25.050449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54871b86-6c70-4659-8499-525600018bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db383e6f95a4d8eba9d4c8a4c3da5df, user_id=be24d0ac142342f7a3112ee38fa12577, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:25.053204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54871b86-6c70-4659-8499-525600018bb5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:25.067875 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1150/2328] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:25 2022] PUT /identity/v3/projects/7db383e6f95a4d8eba9d4c8a4c3da5df/users/be24d0ac142342f7a3112ee38fa12577/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:15:25.079799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd25697-85ae-47ce-8b61-0c9cbdffcd5a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:25.080019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd25697-85ae-47ce-8b61-0c9cbdffcd5a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:25.080286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd25697-85ae-47ce-8b61-0c9cbdffcd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:25.110624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-acd25697-85ae-47ce-8b61-0c9cbdffcd5a None None] MFA Rules not processed for user `be24d0ac142342f7a3112ee38fa12577`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:25.111844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-acd25697-85ae-47ce-8b61-0c9cbdffcd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:25.176658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1179/2329] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:25.182898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54871b86-6c70-4659-8499-525600018bb5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:25.258534 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54871b86-6c70-4659-8499-525600018bb5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:25.267123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33256020-633f-48ce-9ae7-a05bca19fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:25.267992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256020-633f-48ce-9ae7-a05bca19fb04 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:25.268321 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256020-633f-48ce-9ae7-a05bca19fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:25.268656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256020-633f-48ce-9ae7-a05bca19fb04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:25.269557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33256020-633f-48ce-9ae7-a05bca19fb04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:25.272621 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33256020-633f-48ce-9ae7-a05bca19fb04 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:25.292326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:25.308729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1151/2330] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:25 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:25.312980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd25697-85ae-47ce-8b61-0c9cbdffcd5a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:25.324441 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd25697-85ae-47ce-8b61-0c9cbdffcd5a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:25.328317 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:25.387797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5c478-0676-4089-bdf3-7bb3a94ade40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:25.388337 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5c478-0676-4089-bdf3-7bb3a94ade40 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:25.388616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5c478-0676-4089-bdf3-7bb3a94ade40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:25.388889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5c478-0676-4089-bdf3-7bb3a94ade40 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:25.389535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5c478-0676-4089-bdf3-7bb3a94ade40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:25.391513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5c478-0676-4089-bdf3-7bb3a94ade40 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:25.414459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1180/2331] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:25 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:25.418599 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33256020-633f-48ce-9ae7-a05bca19fb04 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:25.429394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33256020-633f-48ce-9ae7-a05bca19fb04 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:25.434281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06309946-4f8d-4261-a4a7-437a8322a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:25.434871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06309946-4f8d-4261-a4a7-437a8322a90b admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:25.435128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06309946-4f8d-4261-a4a7-437a8322a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:25.435399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06309946-4f8d-4261-a4a7-437a8322a90b admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:25.436037 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06309946-4f8d-4261-a4a7-437a8322a90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:25.437628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06309946-4f8d-4261-a4a7-437a8322a90b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:25.448281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1152/2332] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:25.452586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5c478-0676-4089-bdf3-7bb3a94ade40 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:25.462942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5c478-0676-4089-bdf3-7bb3a94ade40 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:25.467931 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768ed90-6a17-4472-b7e0-c50c418fd5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:25.468579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768ed90-6a17-4472-b7e0-c50c418fd5df admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:25.468859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768ed90-6a17-4472-b7e0-c50c418fd5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:25.469134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768ed90-6a17-4472-b7e0-c50c418fd5df admin admin] PATH_INFO: `/v3/projects/14280395626e4fdebe31cf1372a98610/users/b2be692354a74dbdad4e4a562ef036c8/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:25.485025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768ed90-6a17-4472-b7e0-c50c418fd5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=14280395626e4fdebe31cf1372a98610, user_id=b2be692354a74dbdad4e4a562ef036c8, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:25.487758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768ed90-6a17-4472-b7e0-c50c418fd5df admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:25.501958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1181/2333] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:25 2022] PUT /identity/v3/projects/14280395626e4fdebe31cf1372a98610/users/b2be692354a74dbdad4e4a562ef036c8/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:25.506092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06309946-4f8d-4261-a4a7-437a8322a90b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:25.516356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06309946-4f8d-4261-a4a7-437a8322a90b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:25.577087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85739163-9b95-4971-b64b-0eb3409ae306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:25.577694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85739163-9b95-4971-b64b-0eb3409ae306 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:25.578007 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85739163-9b95-4971-b64b-0eb3409ae306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:25.578283 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85739163-9b95-4971-b64b-0eb3409ae306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:25.578928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85739163-9b95-4971-b64b-0eb3409ae306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:25.580539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85739163-9b95-4971-b64b-0eb3409ae306 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:25.590761 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1153/2334] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:25.595283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768ed90-6a17-4472-b7e0-c50c418fd5df admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:25.606899 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768ed90-6a17-4472-b7e0-c50c418fd5df admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:25.612353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938327ae-60b9-4d13-8d24-7c5ec070c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:25.613038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938327ae-60b9-4d13-8d24-7c5ec070c866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:25.613296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938327ae-60b9-4d13-8d24-7c5ec070c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:25.613582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938327ae-60b9-4d13-8d24-7c5ec070c866 admin admin] PATH_INFO: `/v3/projects/14280395626e4fdebe31cf1372a98610/users/b2be692354a74dbdad4e4a562ef036c8/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:25.616191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938327ae-60b9-4d13-8d24-7c5ec070c866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14280395626e4fdebe31cf1372a98610, user_id=b2be692354a74dbdad4e4a562ef036c8, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:25.618883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938327ae-60b9-4d13-8d24-7c5ec070c866 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:25.629248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1182/2335] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:25 2022] PUT /identity/v3/projects/14280395626e4fdebe31cf1372a98610/users/b2be692354a74dbdad4e4a562ef036c8/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:25.640224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dfffc-7c72-445e-b6d4-8b9134a91048 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:25.640421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dfffc-7c72-445e-b6d4-8b9134a91048 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:25.640685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dfffc-7c72-445e-b6d4-8b9134a91048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:25.669543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5f1dfffc-7c72-445e-b6d4-8b9134a91048 None None] MFA Rules not processed for user `b2be692354a74dbdad4e4a562ef036c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:25.670789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5f1dfffc-7c72-445e-b6d4-8b9134a91048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:25.745858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1154/2336] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:25.757977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938327ae-60b9-4d13-8d24-7c5ec070c866 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:25.759742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-938327ae-60b9-4d13-8d24-7c5ec070c866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:25.820881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938327ae-60b9-4d13-8d24-7c5ec070c866 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:25.825042 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cde5fd-9b83-4c84-beef-06d3c869813a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:25.825649 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde5fd-9b83-4c84-beef-06d3c869813a service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:25.825960 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde5fd-9b83-4c84-beef-06d3c869813a service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:25.826232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde5fd-9b83-4c84-beef-06d3c869813a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:25.836052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cde5fd-9b83-4c84-beef-06d3c869813a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:25.837490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cde5fd-9b83-4c84-beef-06d3c869813a service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:25.847229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1183/2337] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:27.323847 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dfffc-7c72-445e-b6d4-8b9134a91048 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:27.391558 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dfffc-7c72-445e-b6d4-8b9134a91048 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:27.396365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:27.397596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:27.397854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:27.398162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] PATH_INFO: `/v3/users/be24d0ac142342f7a3112ee38fa12577` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:27.399319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be24d0ac142342f7a3112ee38fa12577)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:27.401245 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:27.409432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:27.456377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be24d0ac142342f7a3112ee38fa12577'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:27.456933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be24d0ac142342f7a3112ee38fa12577'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:27.468487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be24d0ac142342f7a3112ee38fa12577'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:27.475941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be24d0ac142342f7a3112ee38fa12577'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:27.476687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be24d0ac142342f7a3112ee38fa12577'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:27.495027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1155/2338] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:27 2022] DELETE /identity/v3/users/be24d0ac142342f7a3112ee38fa12577 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:27.499673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726afd6-8808-4949-be42-3744fbf8d3ec None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:27.500204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726afd6-8808-4949-be42-3744fbf8d3ec None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:27.500204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726afd6-8808-4949-be42-3744fbf8d3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:27.520689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5726afd6-8808-4949-be42-3744fbf8d3ec None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:27.522149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5726afd6-8808-4949-be42-3744fbf8d3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:27.581227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1184/2339] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:27.591486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:27.593073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:27.652837 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe102e1-e70f-4673-a440-042e19cd6755 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:27.657144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056cd5e-41cf-46bc-b4fb-36c86a5538d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:27.657758 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056cd5e-41cf-46bc-b4fb-36c86a5538d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:27.658069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056cd5e-41cf-46bc-b4fb-36c86a5538d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:27.658341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056cd5e-41cf-46bc-b4fb-36c86a5538d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:27.668276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056cd5e-41cf-46bc-b4fb-36c86a5538d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:27.669751 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056cd5e-41cf-46bc-b4fb-36c86a5538d7 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:27.679492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1156/2340] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:27.957143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726afd6-8808-4949-be42-3744fbf8d3ec None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:27.958701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5726afd6-8808-4949-be42-3744fbf8d3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:27.965804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:27.972613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726afd6-8808-4949-be42-3744fbf8d3ec None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:27.978753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:27.979480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:27.979669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:27.979926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] PATH_INFO: `/v3/projects/7db383e6f95a4d8eba9d4c8a4c3da5df` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:27.981332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db383e6f95a4d8eba9d4c8a4c3da5df)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:27.983368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:28.032134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db383e6f95a4d8eba9d4c8a4c3da5df', 'request_id': 'req-26df6822-c0dd-4777-abfa-c9f1e358ad02'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.040387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db383e6f95a4d8eba9d4c8a4c3da5df', 'request_id': 'req-26df6822-c0dd-4777-abfa-c9f1e358ad02'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.045966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db383e6f95a4d8eba9d4c8a4c3da5df', 'request_id': 'req-26df6822-c0dd-4777-abfa-c9f1e358ad02'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.058195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] The token cache is being invalidate because project 7db383e6f95a4d8eba9d4c8a4c3da5df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:28.058484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.059174 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.060814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1185/2341] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:27 2022] DELETE /identity/v3/projects/7db383e6f95a4d8eba9d4c8a4c3da5df => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:28.065108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056cd5e-41cf-46bc-b4fb-36c86a5538d7 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:28.079153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056cd5e-41cf-46bc-b4fb-36c86a5538d7 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:28.141878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42512fbc-40e4-4ac6-acc6-cc11c00b8b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:28.142508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512fbc-40e4-4ac6-acc6-cc11c00b8b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:28.142779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512fbc-40e4-4ac6-acc6-cc11c00b8b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:28.143040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512fbc-40e4-4ac6-acc6-cc11c00b8b02 admin admin] PATH_INFO: `/v3/users/b2be692354a74dbdad4e4a562ef036c8` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:28.144297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42512fbc-40e4-4ac6-acc6-cc11c00b8b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2be692354a74dbdad4e4a562ef036c8)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:28.146263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42512fbc-40e4-4ac6-acc6-cc11c00b8b02 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:28.188075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:28.202034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-42512fbc-40e4-4ac6-acc6-cc11c00b8b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2be692354a74dbdad4e4a562ef036c8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.202698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-42512fbc-40e4-4ac6-acc6-cc11c00b8b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2be692354a74dbdad4e4a562ef036c8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.211350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-42512fbc-40e4-4ac6-acc6-cc11c00b8b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2be692354a74dbdad4e4a562ef036c8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.218478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-42512fbc-40e4-4ac6-acc6-cc11c00b8b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2be692354a74dbdad4e4a562ef036c8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.219055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-42512fbc-40e4-4ac6-acc6-cc11c00b8b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2be692354a74dbdad4e4a562ef036c8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.237490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1157/2342] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:28 2022] DELETE /identity/v3/users/b2be692354a74dbdad4e4a562ef036c8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:28.530864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:28.532412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:28.545301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df6822-c0dd-4777-abfa-c9f1e358ad02 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:28.606694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:28.607497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:28.607776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:28.608376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] PATH_INFO: `/v3/projects/14280395626e4fdebe31cf1372a98610` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:28.609557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14280395626e4fdebe31cf1372a98610)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:28.611692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:28.660411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14280395626e4fdebe31cf1372a98610', 'request_id': 'req-63c8fdee-65d0-48c2-a370-3181e0d5d445'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.668524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14280395626e4fdebe31cf1372a98610', 'request_id': 'req-63c8fdee-65d0-48c2-a370-3181e0d5d445'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.674108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14280395626e4fdebe31cf1372a98610', 'request_id': 'req-63c8fdee-65d0-48c2-a370-3181e0d5d445'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.687465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] The token cache is being invalidate because project 14280395626e4fdebe31cf1372a98610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:28.687830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.688818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-63c8fdee-65d0-48c2-a370-3181e0d5d445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:28.691144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1186/2343] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:28 2022] DELETE /identity/v3/projects/14280395626e4fdebe31cf1372a98610 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:28.698644 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5096-e9b7-4518-8bc2-e588a31e6438 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:28.699154 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5096-e9b7-4518-8bc2-e588a31e6438 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:28.699154 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5096-e9b7-4518-8bc2-e588a31e6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:28.722312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-852a5096-e9b7-4518-8bc2-e588a31e6438 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:28.723461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-852a5096-e9b7-4518-8bc2-e588a31e6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:28.794392 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1158/2344] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:28.805083 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec658bce-ca34-4fb1-8d54-f39c4df80de6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:28.805368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec658bce-ca34-4fb1-8d54-f39c4df80de6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:28.805666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec658bce-ca34-4fb1-8d54-f39c4df80de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:28.827687 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ec658bce-ca34-4fb1-8d54-f39c4df80de6 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:28.828911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ec658bce-ca34-4fb1-8d54-f39c4df80de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:28.838129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1187/2345] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:15:28.842598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a5096-e9b7-4518-8bc2-e588a31e6438 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:28.852556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a5096-e9b7-4518-8bc2-e588a31e6438 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:28.858042 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5c9e5-5edc-47ca-9c3b-9cfa079c92d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:28.858982 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5c9e5-5edc-47ca-9c3b-9cfa079c92d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:28.859255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5c9e5-5edc-47ca-9c3b-9cfa079c92d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:28.859524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5c9e5-5edc-47ca-9c3b-9cfa079c92d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:28.860154 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5c9e5-5edc-47ca-9c3b-9cfa079c92d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:15:28.860475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5c9e5-5edc-47ca-9c3b-9cfa079c92d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:28.862098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5c9e5-5edc-47ca-9c3b-9cfa079c92d6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:28.874891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1159/2346] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:15:28.879461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec658bce-ca34-4fb1-8d54-f39c4df80de6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:28.889078 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec658bce-ca34-4fb1-8d54-f39c4df80de6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:28.895161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4a2b-c687-4bdc-84d2-579b924998aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:28.895756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4a2b-c687-4bdc-84d2-579b924998aa admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:28.896036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4a2b-c687-4bdc-84d2-579b924998aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:28.896302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4a2b-c687-4bdc-84d2-579b924998aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:28.896926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f4a2b-c687-4bdc-84d2-579b924998aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:28.898888 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f4a2b-c687-4bdc-84d2-579b924998aa admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:28.904467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:28.929977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1188/2347] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:28 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:28.936604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5c9e5-5edc-47ca-9c3b-9cfa079c92d6 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:28.947133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5c9e5-5edc-47ca-9c3b-9cfa079c92d6 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:29.008347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce6558-5092-4722-8fe9-e38f8b378dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:29.009033 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce6558-5092-4722-8fe9-e38f8b378dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.009312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce6558-5092-4722-8fe9-e38f8b378dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.009743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce6558-5092-4722-8fe9-e38f8b378dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.010415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce6558-5092-4722-8fe9-e38f8b378dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:29.012388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce6558-5092-4722-8fe9-e38f8b378dc3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:29.036190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1160/2348] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:28 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:15:29.040679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4a2b-c687-4bdc-84d2-579b924998aa admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:29.051676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4a2b-c687-4bdc-84d2-579b924998aa admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:29.057013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e6d97-0599-4bb4-a139-5dba01a26bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:29.057611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6d97-0599-4bb4-a139-5dba01a26bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.057929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6d97-0599-4bb4-a139-5dba01a26bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.058215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6d97-0599-4bb4-a139-5dba01a26bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.058866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e6d97-0599-4bb4-a139-5dba01a26bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:29.060480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e6d97-0599-4bb4-a139-5dba01a26bc4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:29.070368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1189/2349] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:15:29.074647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce6558-5092-4722-8fe9-e38f8b378dc3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:29.084709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce6558-5092-4722-8fe9-e38f8b378dc3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:29.089658 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105111e9-ef5c-4f58-9edd-46a4997b357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:29.090284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105111e9-ef5c-4f58-9edd-46a4997b357e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.090570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105111e9-ef5c-4f58-9edd-46a4997b357e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.090835 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105111e9-ef5c-4f58-9edd-46a4997b357e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.091499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105111e9-ef5c-4f58-9edd-46a4997b357e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:29.093091 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105111e9-ef5c-4f58-9edd-46a4997b357e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:29.104052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1161/2350] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:29.108647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e6d97-0599-4bb4-a139-5dba01a26bc4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:29.118977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e6d97-0599-4bb4-a139-5dba01a26bc4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:29.125228 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89031f3-9d9f-48ee-b8b8-ab0b45f3e49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:29.125916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89031f3-9d9f-48ee-b8b8-ab0b45f3e49d admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.126209 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89031f3-9d9f-48ee-b8b8-ab0b45f3e49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.126473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89031f3-9d9f-48ee-b8b8-ab0b45f3e49d admin admin] PATH_INFO: `/v3/projects/46645e68b27f4a2aa81c74ac7bbf3ffb/users/b592d3fc733f47e58763a400f171228d/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.141550 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89031f3-9d9f-48ee-b8b8-ab0b45f3e49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46645e68b27f4a2aa81c74ac7bbf3ffb, user_id=b592d3fc733f47e58763a400f171228d, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:29.144255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89031f3-9d9f-48ee-b8b8-ab0b45f3e49d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:29.163720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1190/2351] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:29 2022] PUT /identity/v3/projects/46645e68b27f4a2aa81c74ac7bbf3ffb/users/b592d3fc733f47e58763a400f171228d/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:29.181387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a268-bc7f-425c-bbfc-c1753e619fc2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.181657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a268-bc7f-425c-bbfc-c1753e619fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.182112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a268-bc7f-425c-bbfc-c1753e619fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.210202 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:29.214123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-60c3a268-bc7f-425c-bbfc-c1753e619fc2 None None] MFA Rules not processed for user `b592d3fc733f47e58763a400f171228d`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:29.216077 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-60c3a268-bc7f-425c-bbfc-c1753e619fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:29.293164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1162/2352] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:29.299867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89031f3-9d9f-48ee-b8b8-ab0b45f3e49d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:29.371449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89031f3-9d9f-48ee-b8b8-ab0b45f3e49d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:29.376347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46471f50-f571-40bb-8368-c63e9b6a2ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:29.376952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46471f50-f571-40bb-8368-c63e9b6a2ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.377229 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46471f50-f571-40bb-8368-c63e9b6a2ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.377496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46471f50-f571-40bb-8368-c63e9b6a2ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.378299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46471f50-f571-40bb-8368-c63e9b6a2ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:29.380204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46471f50-f571-40bb-8368-c63e9b6a2ae1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:29.408747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1191/2353] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:29 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:29.412966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3a268-bc7f-425c-bbfc-c1753e619fc2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:29.424637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3a268-bc7f-425c-bbfc-c1753e619fc2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:29.484326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f46b-43c6-4442-82b9-479a5725427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:29.485010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f46b-43c6-4442-82b9-479a5725427f admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.485422 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f46b-43c6-4442-82b9-479a5725427f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.485702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f46b-43c6-4442-82b9-479a5725427f admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.486522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742f46b-43c6-4442-82b9-479a5725427f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:29.489421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742f46b-43c6-4442-82b9-479a5725427f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:29.514459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1163/2354] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:29 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:29.518661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46471f50-f571-40bb-8368-c63e9b6a2ae1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:29.529390 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46471f50-f571-40bb-8368-c63e9b6a2ae1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:29.534633 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01f5b1-005b-4d9b-9f5b-eeadc9793ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:29.535295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01f5b1-005b-4d9b-9f5b-eeadc9793ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.535523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01f5b1-005b-4d9b-9f5b-eeadc9793ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.535794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01f5b1-005b-4d9b-9f5b-eeadc9793ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.536443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01f5b1-005b-4d9b-9f5b-eeadc9793ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:29.538070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01f5b1-005b-4d9b-9f5b-eeadc9793ad9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:29.549760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1192/2355] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:29.554061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f46b-43c6-4442-82b9-479a5725427f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:29.564501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f46b-43c6-4442-82b9-479a5725427f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:29.569865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aabd08-54d9-4421-bead-a9695e1ebea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:29.570644 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabd08-54d9-4421-bead-a9695e1ebea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.570949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabd08-54d9-4421-bead-a9695e1ebea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.571223 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabd08-54d9-4421-bead-a9695e1ebea1 admin admin] PATH_INFO: `/v3/projects/6c74cc4f1be647219956f0c210b7080e/users/45d0ed1aa5864b7e9b129ef3e16b6564/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.586632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aabd08-54d9-4421-bead-a9695e1ebea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c74cc4f1be647219956f0c210b7080e, user_id=45d0ed1aa5864b7e9b129ef3e16b6564, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:29.589398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aabd08-54d9-4421-bead-a9695e1ebea1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:29.611078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1164/2356] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:29 2022] PUT /identity/v3/projects/6c74cc4f1be647219956f0c210b7080e/users/45d0ed1aa5864b7e9b129ef3e16b6564/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:15:29.615472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01f5b1-005b-4d9b-9f5b-eeadc9793ad9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:29.625785 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01f5b1-005b-4d9b-9f5b-eeadc9793ad9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:29.688082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed18d1-e138-471d-8a78-30b2ff8b87e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:29.688699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed18d1-e138-471d-8a78-30b2ff8b87e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.688980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed18d1-e138-471d-8a78-30b2ff8b87e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.689253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed18d1-e138-471d-8a78-30b2ff8b87e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.689937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed18d1-e138-471d-8a78-30b2ff8b87e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:29.691588 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed18d1-e138-471d-8a78-30b2ff8b87e2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:29.702017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1193/2357] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:29.706405 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aabd08-54d9-4421-bead-a9695e1ebea1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:29.718019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aabd08-54d9-4421-bead-a9695e1ebea1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:29.723526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409d7a3-93c5-4cb5-8101-bf0b062863f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:29.724378 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409d7a3-93c5-4cb5-8101-bf0b062863f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.724651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409d7a3-93c5-4cb5-8101-bf0b062863f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.724920 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409d7a3-93c5-4cb5-8101-bf0b062863f8 admin admin] PATH_INFO: `/v3/projects/6c74cc4f1be647219956f0c210b7080e/users/45d0ed1aa5864b7e9b129ef3e16b6564/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.726974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409d7a3-93c5-4cb5-8101-bf0b062863f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c74cc4f1be647219956f0c210b7080e, user_id=45d0ed1aa5864b7e9b129ef3e16b6564, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:29.729946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409d7a3-93c5-4cb5-8101-bf0b062863f8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:29.741089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1165/2358] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:29 2022] PUT /identity/v3/projects/6c74cc4f1be647219956f0c210b7080e/users/45d0ed1aa5864b7e9b129ef3e16b6564/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:29.751733 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6a1a2-05ac-424c-853c-d7bdca0b8e54 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.751957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6a1a2-05ac-424c-853c-d7bdca0b8e54 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.752230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6a1a2-05ac-424c-853c-d7bdca0b8e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.782687 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bcb6a1a2-05ac-424c-853c-d7bdca0b8e54 None None] MFA Rules not processed for user `45d0ed1aa5864b7e9b129ef3e16b6564`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:29.783913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bcb6a1a2-05ac-424c-853c-d7bdca0b8e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:29.793594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:29.855886 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1194/2359] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:29.867770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409d7a3-93c5-4cb5-8101-bf0b062863f8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:29.869632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3409d7a3-93c5-4cb5-8101-bf0b062863f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:29.929926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409d7a3-93c5-4cb5-8101-bf0b062863f8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:29.934066 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051ee74-834f-4225-b2f1-56a278066374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:29.934668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051ee74-834f-4225-b2f1-56a278066374 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:29.934944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051ee74-834f-4225-b2f1-56a278066374 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:29.935215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051ee74-834f-4225-b2f1-56a278066374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:29.945457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051ee74-834f-4225-b2f1-56a278066374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:29.947185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051ee74-834f-4225-b2f1-56a278066374 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:29.951077 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:29.958297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1166/2360] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:30.027040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6a1a2-05ac-424c-853c-d7bdca0b8e54 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:30.090576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6a1a2-05ac-424c-853c-d7bdca0b8e54 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:30.096008 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:30.096650 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:30.096924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:30.097189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] PATH_INFO: `/v3/users/b592d3fc733f47e58763a400f171228d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:30.098404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b592d3fc733f47e58763a400f171228d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:30.100351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:30.148798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b592d3fc733f47e58763a400f171228d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.157144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b592d3fc733f47e58763a400f171228d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.157775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b592d3fc733f47e58763a400f171228d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.164471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b592d3fc733f47e58763a400f171228d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.176186 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b592d3fc733f47e58763a400f171228d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.182283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1195/2361] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:30 2022] DELETE /identity/v3/users/b592d3fc733f47e58763a400f171228d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:30.186861 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec8f1-565d-40d5-9c64-c859a5516d32 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:30.187137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec8f1-565d-40d5-9c64-c859a5516d32 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:30.187404 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec8f1-565d-40d5-9c64-c859a5516d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:30.206159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d74ec8f1-565d-40d5-9c64-c859a5516d32 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:30.207345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d74ec8f1-565d-40d5-9c64-c859a5516d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:30.267274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1167/2362] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:30.277437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:30.278926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:30.310119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:30.339468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6865b-c31b-498d-a617-9795284330c8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:30.343467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8a4c5-a244-4755-a13d-6d1d6f733502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:30.344081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a4c5-a244-4755-a13d-6d1d6f733502 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:30.344358 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a4c5-a244-4755-a13d-6d1d6f733502 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:30.344632 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a4c5-a244-4755-a13d-6d1d6f733502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:30.354046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8a4c5-a244-4755-a13d-6d1d6f733502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:30.355478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8a4c5-a244-4755-a13d-6d1d6f733502 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:30.365100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1196/2363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:30.644450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ec8f1-565d-40d5-9c64-c859a5516d32 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:30.646085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d74ec8f1-565d-40d5-9c64-c859a5516d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:30.669859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ec8f1-565d-40d5-9c64-c859a5516d32 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:30.676661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:30.677384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:30.677692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:30.678045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] PATH_INFO: `/v3/projects/46645e68b27f4a2aa81c74ac7bbf3ffb` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:30.679619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=46645e68b27f4a2aa81c74ac7bbf3ffb)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:30.681803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:30.733940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46645e68b27f4a2aa81c74ac7bbf3ffb', 'request_id': 'req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.739373 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46645e68b27f4a2aa81c74ac7bbf3ffb', 'request_id': 'req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.748550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46645e68b27f4a2aa81c74ac7bbf3ffb', 'request_id': 'req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.761562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] The token cache is being invalidate because project 46645e68b27f4a2aa81c74ac7bbf3ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:30.761863 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.762561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.764124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1168/2364] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:30 2022] DELETE /identity/v3/projects/46645e68b27f4a2aa81c74ac7bbf3ffb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:30.770051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8a4c5-a244-4755-a13d-6d1d6f733502 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:30.782759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8a4c5-a244-4755-a13d-6d1d6f733502 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:30.842286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72560038-9d41-4cec-9bbd-94df91abd77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:30.842915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560038-9d41-4cec-9bbd-94df91abd77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:30.843186 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560038-9d41-4cec-9bbd-94df91abd77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:30.843452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560038-9d41-4cec-9bbd-94df91abd77f admin admin] PATH_INFO: `/v3/users/45d0ed1aa5864b7e9b129ef3e16b6564` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:30.844639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560038-9d41-4cec-9bbd-94df91abd77f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d0ed1aa5864b7e9b129ef3e16b6564)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:30.846596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560038-9d41-4cec-9bbd-94df91abd77f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:30.896153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72560038-9d41-4cec-9bbd-94df91abd77f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d0ed1aa5864b7e9b129ef3e16b6564'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.905479 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72560038-9d41-4cec-9bbd-94df91abd77f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d0ed1aa5864b7e9b129ef3e16b6564'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.906128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72560038-9d41-4cec-9bbd-94df91abd77f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d0ed1aa5864b7e9b129ef3e16b6564'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.912904 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72560038-9d41-4cec-9bbd-94df91abd77f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d0ed1aa5864b7e9b129ef3e16b6564'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.925552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72560038-9d41-4cec-9bbd-94df91abd77f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d0ed1aa5864b7e9b129ef3e16b6564'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:30.931567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1197/2365] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:30 2022] DELETE /identity/v3/users/45d0ed1aa5864b7e9b129ef3e16b6564 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:31.201734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:31.203273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:31.217781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98f201-1ab7-4fc4-8a0f-1632fe2f7cbe admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:31.281134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:31.281672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:31.281984 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:31.282259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] PATH_INFO: `/v3/projects/6c74cc4f1be647219956f0c210b7080e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:31.283395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c74cc4f1be647219956f0c210b7080e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:31.285304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:31.309415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:31.336415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c74cc4f1be647219956f0c210b7080e', 'request_id': 'req-67556ba0-b431-4e84-b195-ed626d545480'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:31.342288 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c74cc4f1be647219956f0c210b7080e', 'request_id': 'req-67556ba0-b431-4e84-b195-ed626d545480'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:31.351343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c74cc4f1be647219956f0c210b7080e', 'request_id': 'req-67556ba0-b431-4e84-b195-ed626d545480'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:31.363817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] The token cache is being invalidate because project 6c74cc4f1be647219956f0c210b7080e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:31.364099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:31.364705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-67556ba0-b431-4e84-b195-ed626d545480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:31.366240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1169/2366] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:31 2022] DELETE /identity/v3/projects/6c74cc4f1be647219956f0c210b7080e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:31.371260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3316ae-f1b8-4767-906b-60c6ced576b1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:31.371547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3316ae-f1b8-4767-906b-60c6ced576b1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:31.371814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3316ae-f1b8-4767-906b-60c6ced576b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:31.392254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-de3316ae-f1b8-4767-906b-60c6ced576b1 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:31.393617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-de3316ae-f1b8-4767-906b-60c6ced576b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:31.439421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:31.456894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1198/2367] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:31.465164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b72ff-e290-4656-9eab-4a2cc83f3fbf None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:31.465446 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b72ff-e290-4656-9eab-4a2cc83f3fbf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:31.465713 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b72ff-e290-4656-9eab-4a2cc83f3fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:31.487048 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-791b72ff-e290-4656-9eab-4a2cc83f3fbf None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:31.488262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-791b72ff-e290-4656-9eab-4a2cc83f3fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:31.497045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1170/2368] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:31.501459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3316ae-f1b8-4767-906b-60c6ced576b1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:31.511493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3316ae-f1b8-4767-906b-60c6ced576b1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:31.516478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432ff2d-e320-43ec-9bb6-1e7360530b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:31.517071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ff2d-e320-43ec-9bb6-1e7360530b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:31.517359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ff2d-e320-43ec-9bb6-1e7360530b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:31.517616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ff2d-e320-43ec-9bb6-1e7360530b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:31.518301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432ff2d-e320-43ec-9bb6-1e7360530b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:15:31.518607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432ff2d-e320-43ec-9bb6-1e7360530b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:31.520209 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432ff2d-e320-43ec-9bb6-1e7360530b60 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:31.532223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1199/2369] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:15:31.536830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b72ff-e290-4656-9eab-4a2cc83f3fbf None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:31.549327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b72ff-e290-4656-9eab-4a2cc83f3fbf None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:31.558391 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8522da-05f4-4f55-b97a-cddd45d1e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:31.559006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8522da-05f4-4f55-b97a-cddd45d1e074 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:31.559264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8522da-05f4-4f55-b97a-cddd45d1e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:31.559534 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8522da-05f4-4f55-b97a-cddd45d1e074 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:31.560149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8522da-05f4-4f55-b97a-cddd45d1e074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:31.562078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8522da-05f4-4f55-b97a-cddd45d1e074 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:31.595668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1171/2370] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:31 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:31.602165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432ff2d-e320-43ec-9bb6-1e7360530b60 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:31.613202 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432ff2d-e320-43ec-9bb6-1e7360530b60 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:31.675612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bef1c-85f7-40c1-9573-a7d2108460c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:31.676449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bef1c-85f7-40c1-9573-a7d2108460c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:31.676982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bef1c-85f7-40c1-9573-a7d2108460c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:31.677300 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bef1c-85f7-40c1-9573-a7d2108460c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:31.678289 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bef1c-85f7-40c1-9573-a7d2108460c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:31.681382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bef1c-85f7-40c1-9573-a7d2108460c4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:31.705942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1200/2371] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:31 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:31.710247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8522da-05f4-4f55-b97a-cddd45d1e074 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:31.721058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8522da-05f4-4f55-b97a-cddd45d1e074 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:31.727807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1eff3-2092-4a9e-9f12-33a8aec02899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:31.728687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1eff3-2092-4a9e-9f12-33a8aec02899 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:31.729096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1eff3-2092-4a9e-9f12-33a8aec02899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:31.729498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1eff3-2092-4a9e-9f12-33a8aec02899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:31.730526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1eff3-2092-4a9e-9f12-33a8aec02899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:31.733057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1eff3-2092-4a9e-9f12-33a8aec02899 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:31.749357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1172/2372] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:31.753754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bef1c-85f7-40c1-9573-a7d2108460c4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:31.765150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bef1c-85f7-40c1-9573-a7d2108460c4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:31.771800 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3f0e7-c9a7-4c11-a3ed-d1a723b65117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:31.772401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3f0e7-c9a7-4c11-a3ed-d1a723b65117 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:31.772661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3f0e7-c9a7-4c11-a3ed-d1a723b65117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:31.772911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3f0e7-c9a7-4c11-a3ed-d1a723b65117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:31.773565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3f0e7-c9a7-4c11-a3ed-d1a723b65117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:31.775426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3f0e7-c9a7-4c11-a3ed-d1a723b65117 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:31.790047 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1201/2373] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:31.794563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1eff3-2092-4a9e-9f12-33a8aec02899 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:31.805162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1eff3-2092-4a9e-9f12-33a8aec02899 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:31.811166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f348a9d-4c40-41d0-aa7c-9bb603ed6cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:31.811818 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f348a9d-4c40-41d0-aa7c-9bb603ed6cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:31.812086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f348a9d-4c40-41d0-aa7c-9bb603ed6cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:31.812349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f348a9d-4c40-41d0-aa7c-9bb603ed6cbe admin admin] PATH_INFO: `/v3/projects/75b728a73bc44eed947ec2e4ae7e17e1/users/1ec528bb757243ba94473efc1fe4be2a/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:31.828061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f348a9d-4c40-41d0-aa7c-9bb603ed6cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b728a73bc44eed947ec2e4ae7e17e1, user_id=1ec528bb757243ba94473efc1fe4be2a, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:31.830744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f348a9d-4c40-41d0-aa7c-9bb603ed6cbe admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:31.846363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1173/2374] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:31 2022] PUT /identity/v3/projects/75b728a73bc44eed947ec2e4ae7e17e1/users/1ec528bb757243ba94473efc1fe4be2a/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:31.857806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440173-7c41-43f8-966a-2919df58825f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:31.858459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440173-7c41-43f8-966a-2919df58825f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:31.858764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440173-7c41-43f8-966a-2919df58825f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:31.886943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-38440173-7c41-43f8-966a-2919df58825f None None] MFA Rules not processed for user `1ec528bb757243ba94473efc1fe4be2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:31.888162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-38440173-7c41-43f8-966a-2919df58825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:31.965418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1202/2375] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:31.970200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f348a9d-4c40-41d0-aa7c-9bb603ed6cbe admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:32.039887 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f348a9d-4c40-41d0-aa7c-9bb603ed6cbe admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:32.045323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83132d22-c0e5-4759-860d-07ba062d81aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:32.045885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83132d22-c0e5-4759-860d-07ba062d81aa admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.046162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83132d22-c0e5-4759-860d-07ba062d81aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.046430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83132d22-c0e5-4759-860d-07ba062d81aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.047062 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83132d22-c0e5-4759-860d-07ba062d81aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:32.048965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83132d22-c0e5-4759-860d-07ba062d81aa admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:32.079087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1174/2376] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:31 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:32.083341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38440173-7c41-43f8-966a-2919df58825f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:32.094653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38440173-7c41-43f8-966a-2919df58825f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:32.142909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:32.161361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedb523-f666-42ca-921e-6d07b07e0611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:32.161999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedb523-f666-42ca-921e-6d07b07e0611 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.162278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedb523-f666-42ca-921e-6d07b07e0611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.162545 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedb523-f666-42ca-921e-6d07b07e0611 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.163148 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedb523-f666-42ca-921e-6d07b07e0611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:32.165254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedb523-f666-42ca-921e-6d07b07e0611 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:32.190534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1203/2377] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:32 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:32.195402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83132d22-c0e5-4759-860d-07ba062d81aa admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:32.212059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83132d22-c0e5-4759-860d-07ba062d81aa admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:32.217935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402e065-f53b-4177-9924-6f24d77f4500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:32.218540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402e065-f53b-4177-9924-6f24d77f4500 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.218813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402e065-f53b-4177-9924-6f24d77f4500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.219083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402e065-f53b-4177-9924-6f24d77f4500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.219715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402e065-f53b-4177-9924-6f24d77f4500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:32.221310 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402e065-f53b-4177-9924-6f24d77f4500 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:32.232452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1175/2378] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:32.242301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedb523-f666-42ca-921e-6d07b07e0611 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:32.253075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedb523-f666-42ca-921e-6d07b07e0611 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:32.258321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be988f-e3fc-4642-8bae-488026c732d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:32.258973 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be988f-e3fc-4642-8bae-488026c732d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.259440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be988f-e3fc-4642-8bae-488026c732d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.259982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be988f-e3fc-4642-8bae-488026c732d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.260738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be988f-e3fc-4642-8bae-488026c732d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:32.262361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be988f-e3fc-4642-8bae-488026c732d2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:32.272483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1204/2379] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:32.277030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402e065-f53b-4177-9924-6f24d77f4500 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:32.287400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402e065-f53b-4177-9924-6f24d77f4500 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:32.292601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d105367-b001-4032-b1ae-661d45cea72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:32.293247 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d105367-b001-4032-b1ae-661d45cea72e admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.293519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d105367-b001-4032-b1ae-661d45cea72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.293772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d105367-b001-4032-b1ae-661d45cea72e admin admin] PATH_INFO: `/v3/projects/1bb5ea5a86634cddacb20dcd0125cfeb/users/f24077a0e65540fdb397c99315f903e4/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.308852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d105367-b001-4032-b1ae-661d45cea72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb5ea5a86634cddacb20dcd0125cfeb, user_id=f24077a0e65540fdb397c99315f903e4, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:32.311419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d105367-b001-4032-b1ae-661d45cea72e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:32.323216 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:32.330075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1176/2380] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:32 2022] PUT /identity/v3/projects/1bb5ea5a86634cddacb20dcd0125cfeb/users/f24077a0e65540fdb397c99315f903e4/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:32.342974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2928b1-59e9-4f10-a7cf-cff35d1bce69 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.343259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2928b1-59e9-4f10-a7cf-cff35d1bce69 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.343528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2928b1-59e9-4f10-a7cf-cff35d1bce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.373360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6d2928b1-59e9-4f10-a7cf-cff35d1bce69 None None] MFA Rules not processed for user `f24077a0e65540fdb397c99315f903e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:32.374623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6d2928b1-59e9-4f10-a7cf-cff35d1bce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:32.442543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1205/2381] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:32.448164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d105367-b001-4032-b1ae-661d45cea72e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:32.518003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d105367-b001-4032-b1ae-661d45cea72e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:32.522792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d337b3d-e22a-4f94-b60b-7030d3c0a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:32.523394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d337b3d-e22a-4f94-b60b-7030d3c0a8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.523664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d337b3d-e22a-4f94-b60b-7030d3c0a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.523926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d337b3d-e22a-4f94-b60b-7030d3c0a8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.524580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d337b3d-e22a-4f94-b60b-7030d3c0a8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:32.526625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d337b3d-e22a-4f94-b60b-7030d3c0a8bf admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:32.556055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1177/2382] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:32 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:32.563475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2928b1-59e9-4f10-a7cf-cff35d1bce69 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:32.578298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2928b1-59e9-4f10-a7cf-cff35d1bce69 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:32.639884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f84c8-ff8f-4cbf-a967-72a14e1b01ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:32.640492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f84c8-ff8f-4cbf-a967-72a14e1b01ef admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.640767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f84c8-ff8f-4cbf-a967-72a14e1b01ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.641034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f84c8-ff8f-4cbf-a967-72a14e1b01ef admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.641659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f84c8-ff8f-4cbf-a967-72a14e1b01ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:32.643607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f84c8-ff8f-4cbf-a967-72a14e1b01ef admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:32.666325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1206/2383] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:32 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:32.670459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d337b3d-e22a-4f94-b60b-7030d3c0a8bf admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:32.681859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d337b3d-e22a-4f94-b60b-7030d3c0a8bf admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:32.687629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf972e-9196-4448-b3a0-fd080a24cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:32.688228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf972e-9196-4448-b3a0-fd080a24cfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.688505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf972e-9196-4448-b3a0-fd080a24cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.688773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf972e-9196-4448-b3a0-fd080a24cfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.689415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf972e-9196-4448-b3a0-fd080a24cfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:32.691061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf972e-9196-4448-b3a0-fd080a24cfd2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:32.703076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1178/2384] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:32.707974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f84c8-ff8f-4cbf-a967-72a14e1b01ef admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:32.719310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f84c8-ff8f-4cbf-a967-72a14e1b01ef admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:32.725531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec6919-118f-4427-b307-844619a8a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:32.726482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec6919-118f-4427-b307-844619a8a1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.726816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec6919-118f-4427-b307-844619a8a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.727226 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec6919-118f-4427-b307-844619a8a1e3 admin admin] PATH_INFO: `/v3/projects/a03bddaada2244b685c78b71156711f1/users/794766102353403a9ef240d7e94c3f49/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.743102 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec6919-118f-4427-b307-844619a8a1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03bddaada2244b685c78b71156711f1, user_id=794766102353403a9ef240d7e94c3f49, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:32.746154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec6919-118f-4427-b307-844619a8a1e3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:32.762406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1207/2385] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:32 2022] PUT /identity/v3/projects/a03bddaada2244b685c78b71156711f1/users/794766102353403a9ef240d7e94c3f49/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:32.766618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf972e-9196-4448-b3a0-fd080a24cfd2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:32.777740 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf972e-9196-4448-b3a0-fd080a24cfd2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:32.842114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf45d5c-8b4b-4aa4-b85d-f9e622fab99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:32.842626 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf45d5c-8b4b-4aa4-b85d-f9e622fab99d admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.842901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf45d5c-8b4b-4aa4-b85d-f9e622fab99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.843163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf45d5c-8b4b-4aa4-b85d-f9e622fab99d admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.843833 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf45d5c-8b4b-4aa4-b85d-f9e622fab99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:32.845466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf45d5c-8b4b-4aa4-b85d-f9e622fab99d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:32.855677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1179/2386] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:32.860267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec6919-118f-4427-b307-844619a8a1e3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:32.871693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec6919-118f-4427-b307-844619a8a1e3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:32.877302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bec6d-8265-4d68-8890-2e20db214b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:32.877984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bec6d-8265-4d68-8890-2e20db214b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.878260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bec6d-8265-4d68-8890-2e20db214b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.878534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bec6d-8265-4d68-8890-2e20db214b44 admin admin] PATH_INFO: `/v3/projects/a03bddaada2244b685c78b71156711f1/users/794766102353403a9ef240d7e94c3f49/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.880657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bec6d-8265-4d68-8890-2e20db214b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03bddaada2244b685c78b71156711f1, user_id=794766102353403a9ef240d7e94c3f49, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:32.883578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bec6d-8265-4d68-8890-2e20db214b44 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:32.895251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1208/2387] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:32 2022] PUT /identity/v3/projects/a03bddaada2244b685c78b71156711f1/users/794766102353403a9ef240d7e94c3f49/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:32.906839 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8428-6a43-495e-ac91-34bb0bc908b6 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:32.907123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8428-6a43-495e-ac91-34bb0bc908b6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:32.907383 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8428-6a43-495e-ac91-34bb0bc908b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:32.937948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-553c8428-6a43-495e-ac91-34bb0bc908b6 None None] MFA Rules not processed for user `794766102353403a9ef240d7e94c3f49`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:32.939163 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-553c8428-6a43-495e-ac91-34bb0bc908b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:32.999774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:33.010584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1180/2388] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:33.023530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bec6d-8265-4d68-8890-2e20db214b44 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:33.025885 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c69bec6d-8265-4d68-8890-2e20db214b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:33.032833 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:33.087673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bec6d-8265-4d68-8890-2e20db214b44 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:33.092281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a89bb-11c9-4542-a7ab-fa6288b556ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:33.092815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a89bb-11c9-4542-a7ab-fa6288b556ed service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:33.093087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a89bb-11c9-4542-a7ab-fa6288b556ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:33.093356 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a89bb-11c9-4542-a7ab-fa6288b556ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:33.103121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a89bb-11c9-4542-a7ab-fa6288b556ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:33.104523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a89bb-11c9-4542-a7ab-fa6288b556ed service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:33.116874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1209/2389] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:33.661594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c8428-6a43-495e-ac91-34bb0bc908b6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:33.663792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-553c8428-6a43-495e-ac91-34bb0bc908b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:33.677964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c8428-6a43-495e-ac91-34bb0bc908b6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:33.682323 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fa789-86a3-4048-8bfe-3fdfdf7f5c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:33.682933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa789-86a3-4048-8bfe-3fdfdf7f5c1b service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:33.683212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa789-86a3-4048-8bfe-3fdfdf7f5c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:33.683478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa789-86a3-4048-8bfe-3fdfdf7f5c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:33.759035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fa789-86a3-4048-8bfe-3fdfdf7f5c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:33.760492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fa789-86a3-4048-8bfe-3fdfdf7f5c1b service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:33.775501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1181/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:34.788818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a89bb-11c9-4542-a7ab-fa6288b556ed service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:34.797732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a89bb-11c9-4542-a7ab-fa6288b556ed service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:34.802994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be4648-f7b7-4c4e-8915-94477880f3b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:34.803508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be4648-f7b7-4c4e-8915-94477880f3b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:34.803815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be4648-f7b7-4c4e-8915-94477880f3b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:34.804080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be4648-f7b7-4c4e-8915-94477880f3b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:34.806499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c7be4648-f7b7-4c4e-8915-94477880f3b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:34.869101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be4648-f7b7-4c4e-8915-94477880f3b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:34.870683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be4648-f7b7-4c4e-8915-94477880f3b4 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:34.880923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1210/2391] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:35.009303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fa789-86a3-4048-8bfe-3fdfdf7f5c1b service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:35.018590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fa789-86a3-4048-8bfe-3fdfdf7f5c1b service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:35.023039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243a336-49d2-45a6-ac37-1377560b2f0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:35.023650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243a336-49d2-45a6-ac37-1377560b2f0e service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:35.024014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243a336-49d2-45a6-ac37-1377560b2f0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:35.024336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243a336-49d2-45a6-ac37-1377560b2f0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:35.026945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0243a336-49d2-45a6-ac37-1377560b2f0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:35.100833 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243a336-49d2-45a6-ac37-1377560b2f0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:35.102275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243a336-49d2-45a6-ac37-1377560b2f0e service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:35.114365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1182/2392] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:37.037492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be4648-f7b7-4c4e-8915-94477880f3b4 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:37.039027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c7be4648-f7b7-4c4e-8915-94477880f3b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:37.096629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be4648-f7b7-4c4e-8915-94477880f3b4 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:37.100527 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2b9b5-d438-4fba-bfa9-19b08c9ad942 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22e60fc95af4a0a94b15f9ed9e3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:37.101157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2b9b5-d438-4fba-bfa9-19b08c9ad942 service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:37.101428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2b9b5-d438-4fba-bfa9-19b08c9ad942 service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:37.101690 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2b9b5-d438-4fba-bfa9-19b08c9ad942 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:37.103738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8ec2b9b5-d438-4fba-bfa9-19b08c9ad942 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:37.117402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2b9b5-d438-4fba-bfa9-19b08c9ad942 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:37.118871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2b9b5-d438-4fba-bfa9-19b08c9ad942 service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:37.129581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1211/2393] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:37.901043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243a336-49d2-45a6-ac37-1377560b2f0e service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:37.909765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243a336-49d2-45a6-ac37-1377560b2f0e service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:37.913810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273113c-a315-4fc2-bfc0-36f1976c2f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:37.914549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273113c-a315-4fc2-bfc0-36f1976c2f1d service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:37.914856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273113c-a315-4fc2-bfc0-36f1976c2f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:37.915240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273113c-a315-4fc2-bfc0-36f1976c2f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:37.978717 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273113c-a315-4fc2-bfc0-36f1976c2f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:37.980276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273113c-a315-4fc2-bfc0-36f1976c2f1d service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:37.993409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1183/2394] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:40.200510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2b9b5-d438-4fba-bfa9-19b08c9ad942 service glance] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:40.252871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:40.269572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2b9b5-d438-4fba-bfa9-19b08c9ad942 service glance] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:40.275363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:40.276025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:40.276302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:40.276570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] PATH_INFO: `/v3/users/1ec528bb757243ba94473efc1fe4be2a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:40.277903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec528bb757243ba94473efc1fe4be2a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:40.279856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:40.334769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec528bb757243ba94473efc1fe4be2a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:40.343513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec528bb757243ba94473efc1fe4be2a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:40.344146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec528bb757243ba94473efc1fe4be2a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:40.351007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec528bb757243ba94473efc1fe4be2a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:40.363195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec528bb757243ba94473efc1fe4be2a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:40.368996 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1212/2395] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:40 2022] DELETE /identity/v3/users/1ec528bb757243ba94473efc1fe4be2a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:40.373912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d546-fd8d-49e5-bb58-9104d54043ec None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:40.374418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d546-fd8d-49e5-bb58-9104d54043ec None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:40.374418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d546-fd8d-49e5-bb58-9104d54043ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:40.394692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3a97d546-fd8d-49e5-bb58-9104d54043ec None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:40.395885 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3a97d546-fd8d-49e5-bb58-9104d54043ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:40.407407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:40.461431 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1184/2396] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:40.471443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:40.473108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:40.539859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c6780-4442-4a77-96c4-3d0d1f224c85 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:40.544337 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935e028-7ca8-4a6d-9c80-600bd1bf3773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:40.544973 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935e028-7ca8-4a6d-9c80-600bd1bf3773 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:40.545247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935e028-7ca8-4a6d-9c80-600bd1bf3773 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:40.546464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935e028-7ca8-4a6d-9c80-600bd1bf3773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:40.556389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935e028-7ca8-4a6d-9c80-600bd1bf3773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:40.558098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935e028-7ca8-4a6d-9c80-600bd1bf3773 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:40.568363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1213/2397] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:40.862807 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97d546-fd8d-49e5-bb58-9104d54043ec None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:40.865462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3a97d546-fd8d-49e5-bb58-9104d54043ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:40.881199 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97d546-fd8d-49e5-bb58-9104d54043ec None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:40.891273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:40.891930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:40.892206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:40.892476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] PATH_INFO: `/v3/projects/75b728a73bc44eed947ec2e4ae7e17e1` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:40.893632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b728a73bc44eed947ec2e4ae7e17e1)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:40.895614 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:40.948575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b728a73bc44eed947ec2e4ae7e17e1', 'request_id': 'req-0a96680a-d5c0-4328-a2c6-626efee2042c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:40.954090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b728a73bc44eed947ec2e4ae7e17e1', 'request_id': 'req-0a96680a-d5c0-4328-a2c6-626efee2042c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:40.963001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b728a73bc44eed947ec2e4ae7e17e1', 'request_id': 'req-0a96680a-d5c0-4328-a2c6-626efee2042c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:40.975108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] The token cache is being invalidate because project 75b728a73bc44eed947ec2e4ae7e17e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:40.975519 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:40.976165 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:40.977675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1185/2398] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:40 2022] DELETE /identity/v3/projects/75b728a73bc44eed947ec2e4ae7e17e1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:40.982261 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935e028-7ca8-4a6d-9c80-600bd1bf3773 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:40.992492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935e028-7ca8-4a6d-9c80-600bd1bf3773 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:41.053985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:41.054624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:41.054952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:41.055158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] PATH_INFO: `/v3/users/f24077a0e65540fdb397c99315f903e4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:41.056266 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24077a0e65540fdb397c99315f903e4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:41.058531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:41.070429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:41.106812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24077a0e65540fdb397c99315f903e4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.115990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24077a0e65540fdb397c99315f903e4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.116658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24077a0e65540fdb397c99315f903e4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.124121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24077a0e65540fdb397c99315f903e4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.135762 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24077a0e65540fdb397c99315f903e4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.141638 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1214/2399] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:40 2022] DELETE /identity/v3/users/f24077a0e65540fdb397c99315f903e4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:41.422014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:41.423484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:41.437503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96680a-d5c0-4328-a2c6-626efee2042c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:41.494694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:41.495347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:41.495713 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:41.495983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] PATH_INFO: `/v3/projects/1bb5ea5a86634cddacb20dcd0125cfeb` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:41.497113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb5ea5a86634cddacb20dcd0125cfeb)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:41.499081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:41.547491 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:41.555290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb5ea5a86634cddacb20dcd0125cfeb', 'request_id': 'req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.562252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb5ea5a86634cddacb20dcd0125cfeb', 'request_id': 'req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.570681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb5ea5a86634cddacb20dcd0125cfeb', 'request_id': 'req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.582588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] The token cache is being invalidate because project 1bb5ea5a86634cddacb20dcd0125cfeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:41.582869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.583500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.585117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1186/2400] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:41 2022] DELETE /identity/v3/projects/1bb5ea5a86634cddacb20dcd0125cfeb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:41.589389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:41.591022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:41.604402 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f846608-5034-4998-a358-db0b764241a2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:41.665744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5ade9-2d41-4605-9b6c-05e1f72d5e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:41.666507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5ade9-2d41-4605-9b6c-05e1f72d5e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:41.667392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5ade9-2d41-4605-9b6c-05e1f72d5e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:41.667672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5ade9-2d41-4605-9b6c-05e1f72d5e4f admin admin] PATH_INFO: `/v3/users/794766102353403a9ef240d7e94c3f49` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:41.668818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5ade9-2d41-4605-9b6c-05e1f72d5e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=794766102353403a9ef240d7e94c3f49)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:41.670792 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5ade9-2d41-4605-9b6c-05e1f72d5e4f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:41.721242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56f5ade9-2d41-4605-9b6c-05e1f72d5e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794766102353403a9ef240d7e94c3f49'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.728603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56f5ade9-2d41-4605-9b6c-05e1f72d5e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794766102353403a9ef240d7e94c3f49'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.729687 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56f5ade9-2d41-4605-9b6c-05e1f72d5e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794766102353403a9ef240d7e94c3f49'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.736825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56f5ade9-2d41-4605-9b6c-05e1f72d5e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794766102353403a9ef240d7e94c3f49'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.749672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56f5ade9-2d41-4605-9b6c-05e1f72d5e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794766102353403a9ef240d7e94c3f49'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:41.755980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1215/2401] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:41 2022] DELETE /identity/v3/users/794766102353403a9ef240d7e94c3f49 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:42.052083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:42.053712 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:42.068015 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0e1b8-e6df-4940-8e6e-1b266f0823d9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:42.154168 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:42.154823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:42.155096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:42.155366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] PATH_INFO: `/v3/projects/a03bddaada2244b685c78b71156711f1` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:42.156513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03bddaada2244b685c78b71156711f1)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:42.158465 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:42.213447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03bddaada2244b685c78b71156711f1', 'request_id': 'req-0acaee9e-969d-4991-848f-19000af8895e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:42.219237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03bddaada2244b685c78b71156711f1', 'request_id': 'req-0acaee9e-969d-4991-848f-19000af8895e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:42.231622 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03bddaada2244b685c78b71156711f1', 'request_id': 'req-0acaee9e-969d-4991-848f-19000af8895e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:42.245071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] The token cache is being invalidate because project a03bddaada2244b685c78b71156711f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:42.245340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:42.246195 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0acaee9e-969d-4991-848f-19000af8895e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:42.248049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1187/2402] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:42 2022] DELETE /identity/v3/projects/a03bddaada2244b685c78b71156711f1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:15:42.254881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a094399-2d64-4e7f-985f-6d1d2fcaf3be None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:42.255236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a094399-2d64-4e7f-985f-6d1d2fcaf3be None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:42.255644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a094399-2d64-4e7f-985f-6d1d2fcaf3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:42.289884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4a094399-2d64-4e7f-985f-6d1d2fcaf3be None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:42.291793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4a094399-2d64-4e7f-985f-6d1d2fcaf3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:42.296662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:42.359564 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1216/2403] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:42.368079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb44e-888e-4196-9410-acac6f161ed0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:42.368361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb44e-888e-4196-9410-acac6f161ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:42.368632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb44e-888e-4196-9410-acac6f161ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:42.394043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f72cb44e-888e-4196-9410-acac6f161ed0 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:42.395243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f72cb44e-888e-4196-9410-acac6f161ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:42.404742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1188/2404] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:42.409210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a094399-2d64-4e7f-985f-6d1d2fcaf3be None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:42.419944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a094399-2d64-4e7f-985f-6d1d2fcaf3be None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:42.426325 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a8781-b0fd-4a89-9209-2118c9f9bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:42.426950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8781-b0fd-4a89-9209-2118c9f9bf80 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:42.427225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8781-b0fd-4a89-9209-2118c9f9bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:42.427478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8781-b0fd-4a89-9209-2118c9f9bf80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:42.428297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a8781-b0fd-4a89-9209-2118c9f9bf80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:15:42.428603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a8781-b0fd-4a89-9209-2118c9f9bf80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:42.430251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a8781-b0fd-4a89-9209-2118c9f9bf80 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:42.443722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1217/2405] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:15:42.448409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cb44e-888e-4196-9410-acac6f161ed0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:42.458638 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cb44e-888e-4196-9410-acac6f161ed0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:42.464646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5a408-a71b-452c-a71d-45c668fe23c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:42.465251 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5a408-a71b-452c-a71d-45c668fe23c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:42.465525 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5a408-a71b-452c-a71d-45c668fe23c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:42.465781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5a408-a71b-452c-a71d-45c668fe23c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:42.466489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5a408-a71b-452c-a71d-45c668fe23c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:42.468385 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5a408-a71b-452c-a71d-45c668fe23c5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:42.499006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1189/2406] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:42 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:42.504918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a8781-b0fd-4a89-9209-2118c9f9bf80 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:42.515815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a8781-b0fd-4a89-9209-2118c9f9bf80 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:42.582862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b5cc3-b527-4cfb-bb9e-dcfc2f85a028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:42.583485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b5cc3-b527-4cfb-bb9e-dcfc2f85a028 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:42.583760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b5cc3-b527-4cfb-bb9e-dcfc2f85a028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:42.584029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b5cc3-b527-4cfb-bb9e-dcfc2f85a028 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:42.584672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b5cc3-b527-4cfb-bb9e-dcfc2f85a028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:42.586644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b5cc3-b527-4cfb-bb9e-dcfc2f85a028 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:42.612023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1218/2407] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:42 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:42.616173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5a408-a71b-452c-a71d-45c668fe23c5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:42.627403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5a408-a71b-452c-a71d-45c668fe23c5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:42.632517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cc4af-3a14-479a-95b3-fdc3a7d3419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:42.633141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cc4af-3a14-479a-95b3-fdc3a7d3419b admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:42.633418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cc4af-3a14-479a-95b3-fdc3a7d3419b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:42.633684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cc4af-3a14-479a-95b3-fdc3a7d3419b admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:42.634609 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cc4af-3a14-479a-95b3-fdc3a7d3419b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:42.636727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cc4af-3a14-479a-95b3-fdc3a7d3419b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:42.647222 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1190/2408] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:42.651481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b5cc3-b527-4cfb-bb9e-dcfc2f85a028 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:42.661655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b5cc3-b527-4cfb-bb9e-dcfc2f85a028 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:42.667305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4734a7-6a21-4a8b-8300-bc4adec1eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:42.668187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4734a7-6a21-4a8b-8300-bc4adec1eb80 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:42.668473 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4734a7-6a21-4a8b-8300-bc4adec1eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:42.668745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4734a7-6a21-4a8b-8300-bc4adec1eb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:42.669383 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4734a7-6a21-4a8b-8300-bc4adec1eb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:42.671023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4734a7-6a21-4a8b-8300-bc4adec1eb80 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:42.681589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1219/2409] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:42.686053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cc4af-3a14-479a-95b3-fdc3a7d3419b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:42.696771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cc4af-3a14-479a-95b3-fdc3a7d3419b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:42.702603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a336e3-ddca-4202-918f-8d5338aa4d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:42.703273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a336e3-ddca-4202-918f-8d5338aa4d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:42.703544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a336e3-ddca-4202-918f-8d5338aa4d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:42.703813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a336e3-ddca-4202-918f-8d5338aa4d9e admin admin] PATH_INFO: `/v3/projects/32c9e5b278d045f881e55237bb01da86/users/3bf50b4532d547dea77fd9538f4db885/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:42.719387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a336e3-ddca-4202-918f-8d5338aa4d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c9e5b278d045f881e55237bb01da86, user_id=3bf50b4532d547dea77fd9538f4db885, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:42.722058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a336e3-ddca-4202-918f-8d5338aa4d9e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:42.725069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:42.740410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1191/2410] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:42 2022] PUT /identity/v3/projects/32c9e5b278d045f881e55237bb01da86/users/3bf50b4532d547dea77fd9538f4db885/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:42.752609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e59dd-77c2-47d2-8dde-8532c3bd1e44 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:42.752894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e59dd-77c2-47d2-8dde-8532c3bd1e44 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:42.753168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e59dd-77c2-47d2-8dde-8532c3bd1e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:42.783988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-566e59dd-77c2-47d2-8dde-8532c3bd1e44 None None] MFA Rules not processed for user `3bf50b4532d547dea77fd9538f4db885`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:42.784763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-566e59dd-77c2-47d2-8dde-8532c3bd1e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:42.851999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1220/2411] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:42.856752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a336e3-ddca-4202-918f-8d5338aa4d9e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:42.923750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a336e3-ddca-4202-918f-8d5338aa4d9e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:42.928419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2d02d-d5b0-4c43-909a-32c5d575c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:42.929086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2d02d-d5b0-4c43-909a-32c5d575c341 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:42.929363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2d02d-d5b0-4c43-909a-32c5d575c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:42.929628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2d02d-d5b0-4c43-909a-32c5d575c341 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:42.930284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2d02d-d5b0-4c43-909a-32c5d575c341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:42.932304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2d02d-d5b0-4c43-909a-32c5d575c341 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:42.962568 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1192/2412] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:42 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:42.966880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e59dd-77c2-47d2-8dde-8532c3bd1e44 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:42.973775 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:42.978610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e59dd-77c2-47d2-8dde-8532c3bd1e44 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:43.036681 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677ed6-753c-4080-89aa-87f729ccd0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:43.037334 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677ed6-753c-4080-89aa-87f729ccd0bf admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:43.037606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677ed6-753c-4080-89aa-87f729ccd0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:43.037894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677ed6-753c-4080-89aa-87f729ccd0bf admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:43.038519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69677ed6-753c-4080-89aa-87f729ccd0bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:43.040451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69677ed6-753c-4080-89aa-87f729ccd0bf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:43.063992 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1221/2413] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:42 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:43.068114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2d02d-d5b0-4c43-909a-32c5d575c341 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:43.078930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2d02d-d5b0-4c43-909a-32c5d575c341 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:43.084909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de73b9-76de-4328-85c4-30f06a2849b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:43.085504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de73b9-76de-4328-85c4-30f06a2849b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:43.085776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de73b9-76de-4328-85c4-30f06a2849b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:43.086109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de73b9-76de-4328-85c4-30f06a2849b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:43.086744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de73b9-76de-4328-85c4-30f06a2849b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:43.088339 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de73b9-76de-4328-85c4-30f06a2849b0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:43.099512 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1193/2414] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:43.104322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677ed6-753c-4080-89aa-87f729ccd0bf admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:43.116305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677ed6-753c-4080-89aa-87f729ccd0bf admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:43.122514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4b821-6298-4dc1-a81f-9b1ca67f91e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:43.123163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b821-6298-4dc1-a81f-9b1ca67f91e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:43.123438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b821-6298-4dc1-a81f-9b1ca67f91e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:43.123704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b821-6298-4dc1-a81f-9b1ca67f91e0 admin admin] PATH_INFO: `/v3/projects/48b97c7d1dc14b37a4682017e7126ac2/users/bfb97687537b43a8aaca1b92aa2b17e2/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:43.140870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4b821-6298-4dc1-a81f-9b1ca67f91e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b97c7d1dc14b37a4682017e7126ac2, user_id=bfb97687537b43a8aaca1b92aa2b17e2, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:43.143481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4b821-6298-4dc1-a81f-9b1ca67f91e0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:43.158898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1222/2415] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:43 2022] PUT /identity/v3/projects/48b97c7d1dc14b37a4682017e7126ac2/users/bfb97687537b43a8aaca1b92aa2b17e2/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:43.162801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de73b9-76de-4328-85c4-30f06a2849b0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:43.172933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de73b9-76de-4328-85c4-30f06a2849b0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:43.233044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10fc61-e721-4d99-a62d-92a2c94b53a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:43.234049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10fc61-e721-4d99-a62d-92a2c94b53a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:43.234322 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10fc61-e721-4d99-a62d-92a2c94b53a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:43.234592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10fc61-e721-4d99-a62d-92a2c94b53a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:43.235236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10fc61-e721-4d99-a62d-92a2c94b53a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:43.236827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10fc61-e721-4d99-a62d-92a2c94b53a6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:43.247464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1194/2416] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:43.251581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4b821-6298-4dc1-a81f-9b1ca67f91e0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:43.262493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4b821-6298-4dc1-a81f-9b1ca67f91e0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:43.267459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aaf88b-e965-47fb-a07c-47ae26c47d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:43.268128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaf88b-e965-47fb-a07c-47ae26c47d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:43.268406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaf88b-e965-47fb-a07c-47ae26c47d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:43.268678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaf88b-e965-47fb-a07c-47ae26c47d08 admin admin] PATH_INFO: `/v3/projects/48b97c7d1dc14b37a4682017e7126ac2/users/bfb97687537b43a8aaca1b92aa2b17e2/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:43.270657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aaf88b-e965-47fb-a07c-47ae26c47d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b97c7d1dc14b37a4682017e7126ac2, user_id=bfb97687537b43a8aaca1b92aa2b17e2, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:43.273276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aaf88b-e965-47fb-a07c-47ae26c47d08 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:43.284866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1223/2417] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:43 2022] PUT /identity/v3/projects/48b97c7d1dc14b37a4682017e7126ac2/users/bfb97687537b43a8aaca1b92aa2b17e2/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:43.355881 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8646e1-4ae6-4022-98db-5efb0296ff51 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:43.356171 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8646e1-4ae6-4022-98db-5efb0296ff51 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:43.356456 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8646e1-4ae6-4022-98db-5efb0296ff51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:43.390809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fe8646e1-4ae6-4022-98db-5efb0296ff51 None None] MFA Rules not processed for user `bfb97687537b43a8aaca1b92aa2b17e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:43.392099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fe8646e1-4ae6-4022-98db-5efb0296ff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:43.455061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:43.476273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1195/2418] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:43.492541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aaf88b-e965-47fb-a07c-47ae26c47d08 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:43.494547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c8aaf88b-e965-47fb-a07c-47ae26c47d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:43.553477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aaf88b-e965-47fb-a07c-47ae26c47d08 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:43.557597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a444f8-6438-4b9a-ab9d-bb5bc81591fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:43.558605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a444f8-6438-4b9a-ab9d-bb5bc81591fb service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:43.558780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a444f8-6438-4b9a-ab9d-bb5bc81591fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:43.559021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a444f8-6438-4b9a-ab9d-bb5bc81591fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:43.568513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a444f8-6438-4b9a-ab9d-bb5bc81591fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:43.570068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a444f8-6438-4b9a-ab9d-bb5bc81591fb service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:43.580250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1224/2419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:43.680489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8646e1-4ae6-4022-98db-5efb0296ff51 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:43.692057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8646e1-4ae6-4022-98db-5efb0296ff51 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:43.696574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373f0b1-319f-4a74-9661-7ce89b20d5b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:43.697170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f0b1-319f-4a74-9661-7ce89b20d5b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:43.697476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f0b1-319f-4a74-9661-7ce89b20d5b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:43.697741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f0b1-319f-4a74-9661-7ce89b20d5b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:43.761823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373f0b1-319f-4a74-9661-7ce89b20d5b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:43.763296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373f0b1-319f-4a74-9661-7ce89b20d5b6 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:43.772978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1196/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:47.670411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a444f8-6438-4b9a-ab9d-bb5bc81591fb service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:47.671898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d8a444f8-6438-4b9a-ab9d-bb5bc81591fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:47.738372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:47.756592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a444f8-6438-4b9a-ab9d-bb5bc81591fb service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:47.762723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f81a14-ee4b-4e2c-92ab-205d57687dc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:47.763385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f81a14-ee4b-4e2c-92ab-205d57687dc9 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:47.763677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f81a14-ee4b-4e2c-92ab-205d57687dc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:47.763923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f81a14-ee4b-4e2c-92ab-205d57687dc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:47.765767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c6f81a14-ee4b-4e2c-92ab-205d57687dc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:47.829523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f81a14-ee4b-4e2c-92ab-205d57687dc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:47.831192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f81a14-ee4b-4e2c-92ab-205d57687dc9 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:47.842184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1225/2421] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:48.634112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373f0b1-319f-4a74-9661-7ce89b20d5b6 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:48.712896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373f0b1-319f-4a74-9661-7ce89b20d5b6 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:48.720006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:48.721136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:48.721257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:48.721592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] PATH_INFO: `/v3/users/3bf50b4532d547dea77fd9538f4db885` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:48.722893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf50b4532d547dea77fd9538f4db885)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:48.725057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:48.782074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf50b4532d547dea77fd9538f4db885'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:48.782617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf50b4532d547dea77fd9538f4db885'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:48.792842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf50b4532d547dea77fd9538f4db885'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:48.801092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf50b4532d547dea77fd9538f4db885'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:48.802054 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf50b4532d547dea77fd9538f4db885'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:48.823468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1197/2422] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:48 2022] DELETE /identity/v3/users/3bf50b4532d547dea77fd9538f4db885 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:48.828663 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd204a-834f-4cb0-963a-199209e7f1c6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:48.829211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd204a-834f-4cb0-963a-199209e7f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:48.829211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd204a-834f-4cb0-963a-199209e7f1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:48.849046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c7dd204a-834f-4cb0-963a-199209e7f1c6 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:48.850311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c7dd204a-834f-4cb0-963a-199209e7f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:48.911398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1226/2423] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:48.921879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:48.923430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:48.935440 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:48.988215 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6de26b-9dfe-4a25-99cc-d9f4c361b929 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:48.991890 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c1252-b8f0-4290-99f0-de8aae75da11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:48.992509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c1252-b8f0-4290-99f0-de8aae75da11 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:48.992805 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c1252-b8f0-4290-99f0-de8aae75da11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:48.993095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c1252-b8f0-4290-99f0-de8aae75da11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:49.002657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c1252-b8f0-4290-99f0-de8aae75da11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:49.004097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c1252-b8f0-4290-99f0-de8aae75da11 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:49.014522 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1198/2424] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:49.298935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd204a-834f-4cb0-963a-199209e7f1c6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:49.300591 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c7dd204a-834f-4cb0-963a-199209e7f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:49.314602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd204a-834f-4cb0-963a-199209e7f1c6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:49.320156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:49.320939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:49.321306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:49.321666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] PATH_INFO: `/v3/projects/32c9e5b278d045f881e55237bb01da86` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:49.323244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c9e5b278d045f881e55237bb01da86)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:49.325632 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:49.386942 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c9e5b278d045f881e55237bb01da86', 'request_id': 'req-e8bf150f-d12f-4787-a56a-e70cb067beae'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:49.398377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c9e5b278d045f881e55237bb01da86', 'request_id': 'req-e8bf150f-d12f-4787-a56a-e70cb067beae'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:49.405772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c9e5b278d045f881e55237bb01da86', 'request_id': 'req-e8bf150f-d12f-4787-a56a-e70cb067beae'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:49.418850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] The token cache is being invalidate because project 32c9e5b278d045f881e55237bb01da86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:49.419130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:49.419854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:49.424564 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1227/2425] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:49 2022] DELETE /identity/v3/projects/32c9e5b278d045f881e55237bb01da86 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:49.426051 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c1252-b8f0-4290-99f0-de8aae75da11 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:49.441192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c1252-b8f0-4290-99f0-de8aae75da11 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:49.512151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1aa80-2a2a-4293-a65e-0ec4efc6bb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:49.512973 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1aa80-2a2a-4293-a65e-0ec4efc6bb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:49.513257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1aa80-2a2a-4293-a65e-0ec4efc6bb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:49.513517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1aa80-2a2a-4293-a65e-0ec4efc6bb16 admin admin] PATH_INFO: `/v3/users/bfb97687537b43a8aaca1b92aa2b17e2` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:49.514763 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1aa80-2a2a-4293-a65e-0ec4efc6bb16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfb97687537b43a8aaca1b92aa2b17e2)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:49.517461 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1aa80-2a2a-4293-a65e-0ec4efc6bb16 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:49.576074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9ee1aa80-2a2a-4293-a65e-0ec4efc6bb16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfb97687537b43a8aaca1b92aa2b17e2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:49.576933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9ee1aa80-2a2a-4293-a65e-0ec4efc6bb16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfb97687537b43a8aaca1b92aa2b17e2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:49.585399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9ee1aa80-2a2a-4293-a65e-0ec4efc6bb16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfb97687537b43a8aaca1b92aa2b17e2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:49.592867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9ee1aa80-2a2a-4293-a65e-0ec4efc6bb16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfb97687537b43a8aaca1b92aa2b17e2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:49.598019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9ee1aa80-2a2a-4293-a65e-0ec4efc6bb16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfb97687537b43a8aaca1b92aa2b17e2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:49.616897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1199/2426] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:49 2022] DELETE /identity/v3/users/bfb97687537b43a8aaca1b92aa2b17e2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:49.932795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:49.934881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:49.948361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf150f-d12f-4787-a56a-e70cb067beae admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:49.971753 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:50.015626 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:50.016340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:50.016677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:50.017042 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] PATH_INFO: `/v3/projects/48b97c7d1dc14b37a4682017e7126ac2` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:50.018370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b97c7d1dc14b37a4682017e7126ac2)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:50.020363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:50.070295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b97c7d1dc14b37a4682017e7126ac2', 'request_id': 'req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:50.079915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b97c7d1dc14b37a4682017e7126ac2', 'request_id': 'req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:50.086249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b97c7d1dc14b37a4682017e7126ac2', 'request_id': 'req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:50.099039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] The token cache is being invalidate because project 48b97c7d1dc14b37a4682017e7126ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:50.099316 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:50.099994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2ce1eee1-dccc-4581-a2ef-d832bde6dff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:50.101486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1228/2427] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:49 2022] DELETE /identity/v3/projects/48b97c7d1dc14b37a4682017e7126ac2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:50.107571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3aab4-3523-432c-b198-648cc9667432 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:50.108057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3aab4-3523-432c-b198-648cc9667432 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:50.108292 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3aab4-3523-432c-b198-648cc9667432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:50.129362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f7b3aab4-3523-432c-b198-648cc9667432 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:50.130808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f7b3aab4-3523-432c-b198-648cc9667432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:50.158903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:50.195092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1200/2428] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:50.203472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab609a5-5816-4ab1-a36f-0c1fdf5b25f3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:50.203769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab609a5-5816-4ab1-a36f-0c1fdf5b25f3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:50.204040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab609a5-5816-4ab1-a36f-0c1fdf5b25f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:50.225417 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6ab609a5-5816-4ab1-a36f-0c1fdf5b25f3 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:50.226697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6ab609a5-5816-4ab1-a36f-0c1fdf5b25f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:50.237034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1229/2429] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:15:50.241630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3aab4-3523-432c-b198-648cc9667432 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:50.253957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3aab4-3523-432c-b198-648cc9667432 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:50.259241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5683e92-d06b-4e57-a394-8411ece2836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:50.259962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5683e92-d06b-4e57-a394-8411ece2836d admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:50.260238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5683e92-d06b-4e57-a394-8411ece2836d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:50.260534 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5683e92-d06b-4e57-a394-8411ece2836d admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:50.261361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5683e92-d06b-4e57-a394-8411ece2836d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:15:50.261662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5683e92-d06b-4e57-a394-8411ece2836d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:50.263640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5683e92-d06b-4e57-a394-8411ece2836d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:50.277375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1201/2430] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:15:50.281926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab609a5-5816-4ab1-a36f-0c1fdf5b25f3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:50.291206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab609a5-5816-4ab1-a36f-0c1fdf5b25f3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:50.296034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1b15f-f753-402b-875d-7b33372354da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:50.296597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1b15f-f753-402b-875d-7b33372354da admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:50.296870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1b15f-f753-402b-875d-7b33372354da admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:50.297139 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1b15f-f753-402b-875d-7b33372354da admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:50.297923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1b15f-f753-402b-875d-7b33372354da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:50.299840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1b15f-f753-402b-875d-7b33372354da admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:50.334702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1230/2431] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:50 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:50.335854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5683e92-d06b-4e57-a394-8411ece2836d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:50.347408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5683e92-d06b-4e57-a394-8411ece2836d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:50.406106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ac0f2-1660-4980-83d3-bdc1a6293733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:50.406726 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac0f2-1660-4980-83d3-bdc1a6293733 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:50.406998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac0f2-1660-4980-83d3-bdc1a6293733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:50.407264 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac0f2-1660-4980-83d3-bdc1a6293733 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:50.408039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ac0f2-1660-4980-83d3-bdc1a6293733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:50.409968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ac0f2-1660-4980-83d3-bdc1a6293733 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:50.434489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1202/2432] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:50 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:15:50.439049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1b15f-f753-402b-875d-7b33372354da admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:50.451106 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1b15f-f753-402b-875d-7b33372354da admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:50.456260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e62efb-cb53-46aa-a5e0-95d5f40ed152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:50.456871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62efb-cb53-46aa-a5e0-95d5f40ed152 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:50.457166 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62efb-cb53-46aa-a5e0-95d5f40ed152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:50.457434 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62efb-cb53-46aa-a5e0-95d5f40ed152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:50.458108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e62efb-cb53-46aa-a5e0-95d5f40ed152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:50.459841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e62efb-cb53-46aa-a5e0-95d5f40ed152 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:50.481121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1231/2433] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:50.485477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ac0f2-1660-4980-83d3-bdc1a6293733 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:50.495751 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ac0f2-1660-4980-83d3-bdc1a6293733 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:50.501166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578f083-9d5c-4587-85a2-454c010d2b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:50.501855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578f083-9d5c-4587-85a2-454c010d2b5a admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:50.502200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578f083-9d5c-4587-85a2-454c010d2b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:50.502531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578f083-9d5c-4587-85a2-454c010d2b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:50.503241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578f083-9d5c-4587-85a2-454c010d2b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:50.504914 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578f083-9d5c-4587-85a2-454c010d2b5a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:50.516803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1203/2434] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:50.521263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e62efb-cb53-46aa-a5e0-95d5f40ed152 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:50.537927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e62efb-cb53-46aa-a5e0-95d5f40ed152 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:50.543796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffae2d-9e2a-4674-82ce-6a2e208720ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:50.544536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffae2d-9e2a-4674-82ce-6a2e208720ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:50.544815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffae2d-9e2a-4674-82ce-6a2e208720ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:50.545086 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffae2d-9e2a-4674-82ce-6a2e208720ed admin admin] PATH_INFO: `/v3/projects/eb91d5f1e3644a9daba470f9a6c71d02/users/f5613c1733dd49d09aaad5f3338d4857/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:50.568140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffae2d-9e2a-4674-82ce-6a2e208720ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb91d5f1e3644a9daba470f9a6c71d02, user_id=f5613c1733dd49d09aaad5f3338d4857, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:50.572041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffae2d-9e2a-4674-82ce-6a2e208720ed admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:50.588084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1232/2435] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:50 2022] PUT /identity/v3/projects/eb91d5f1e3644a9daba470f9a6c71d02/users/f5613c1733dd49d09aaad5f3338d4857/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:50.602443 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c28a0-4b1a-423a-862a-8ea784ffd4e2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:50.602832 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c28a0-4b1a-423a-862a-8ea784ffd4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:50.603306 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c28a0-4b1a-423a-862a-8ea784ffd4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:50.643300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-633c28a0-4b1a-423a-862a-8ea784ffd4e2 None None] MFA Rules not processed for user `f5613c1733dd49d09aaad5f3338d4857`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:50.644567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-633c28a0-4b1a-423a-862a-8ea784ffd4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:50.721552 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1204/2436] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:15:50.738276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffae2d-9e2a-4674-82ce-6a2e208720ed admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:50.740985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d8ffae2d-9e2a-4674-82ce-6a2e208720ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:50.803456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:50.810371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffae2d-9e2a-4674-82ce-6a2e208720ed admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:50.817316 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea67f17-9c25-4068-aef3-b939f1134ae9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:50.818045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea67f17-9c25-4068-aef3-b939f1134ae9 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:50.818389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea67f17-9c25-4068-aef3-b939f1134ae9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:50.818760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea67f17-9c25-4068-aef3-b939f1134ae9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:50.830120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea67f17-9c25-4068-aef3-b939f1134ae9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:50.831565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea67f17-9c25-4068-aef3-b939f1134ae9 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:50.841262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1233/2437] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:53.950826 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c28a0-4b1a-423a-862a-8ea784ffd4e2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:53.984197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:54.020179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c28a0-4b1a-423a-862a-8ea784ffd4e2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:54.025107 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03688f24-c747-4d93-9176-4dd89a4dc71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:54.025675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688f24-c747-4d93-9176-4dd89a4dc71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:54.026005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688f24-c747-4d93-9176-4dd89a4dc71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:54.026274 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688f24-c747-4d93-9176-4dd89a4dc71f admin admin] PATH_INFO: `/v3/users/f5613c1733dd49d09aaad5f3338d4857` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:54.027417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03688f24-c747-4d93-9176-4dd89a4dc71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5613c1733dd49d09aaad5f3338d4857)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:54.029417 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03688f24-c747-4d93-9176-4dd89a4dc71f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:54.112577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-03688f24-c747-4d93-9176-4dd89a4dc71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5613c1733dd49d09aaad5f3338d4857'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:54.113194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-03688f24-c747-4d93-9176-4dd89a4dc71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5613c1733dd49d09aaad5f3338d4857'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:54.123115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-03688f24-c747-4d93-9176-4dd89a4dc71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5613c1733dd49d09aaad5f3338d4857'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:54.133746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-03688f24-c747-4d93-9176-4dd89a4dc71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5613c1733dd49d09aaad5f3338d4857'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:54.133746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-03688f24-c747-4d93-9176-4dd89a4dc71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5613c1733dd49d09aaad5f3338d4857'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:54.142513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea67f17-9c25-4068-aef3-b939f1134ae9 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:54.143755 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8ea67f17-9c25-4068-aef3-b939f1134ae9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:54.159913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1205/2438] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:15:53 2022] DELETE /identity/v3/users/f5613c1733dd49d09aaad5f3338d4857 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:54.166112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60df5f-e19e-4693-9651-2899d1e9f1af None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:54.166399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60df5f-e19e-4693-9651-2899d1e9f1af None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:54.166668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60df5f-e19e-4693-9651-2899d1e9f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:54.188135 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9a60df5f-e19e-4693-9651-2899d1e9f1af None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:54.189486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9a60df5f-e19e-4693-9651-2899d1e9f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:54.207400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea67f17-9c25-4068-aef3-b939f1134ae9 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:54.260467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1206/2439] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:54.267471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d482ec-8456-4382-a1c5-1939d4d20cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:54.268185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d482ec-8456-4382-a1c5-1939d4d20cbf service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:54.268464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d482ec-8456-4382-a1c5-1939d4d20cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:54.268729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d482ec-8456-4382-a1c5-1939d4d20cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:54.270574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-44d482ec-8456-4382-a1c5-1939d4d20cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:54.271066 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60df5f-e19e-4693-9651-2899d1e9f1af None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:54.272587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9a60df5f-e19e-4693-9651-2899d1e9f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:54.284563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d482ec-8456-4382-a1c5-1939d4d20cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:54.286100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d482ec-8456-4382-a1c5-1939d4d20cbf service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:54.286932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60df5f-e19e-4693-9651-2899d1e9f1af None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:54.291855 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fcccc-0f1a-4843-98f1-1e18ebd13372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:54.292704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fcccc-0f1a-4843-98f1-1e18ebd13372 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:54.293427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fcccc-0f1a-4843-98f1-1e18ebd13372 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:54.293866 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fcccc-0f1a-4843-98f1-1e18ebd13372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:54.296498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1234/2440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:15:54.305508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fcccc-0f1a-4843-98f1-1e18ebd13372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:54.307060 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fcccc-0f1a-4843-98f1-1e18ebd13372 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:54.317725 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1207/2441] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:15:55.100511 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d482ec-8456-4382-a1c5-1939d4d20cbf service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:55.104279 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-44d482ec-8456-4382-a1c5-1939d4d20cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:55.127504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d482ec-8456-4382-a1c5-1939d4d20cbf service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:55.141464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:55.142467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:55.142813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:55.143360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] PATH_INFO: `/v3/projects/eb91d5f1e3644a9daba470f9a6c71d02` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:55.144333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb91d5f1e3644a9daba470f9a6c71d02)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:55.146365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:55.195662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb91d5f1e3644a9daba470f9a6c71d02', 'request_id': 'req-085bdf1e-ffd1-473c-beff-b540b76bf519'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:55.207146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb91d5f1e3644a9daba470f9a6c71d02', 'request_id': 'req-085bdf1e-ffd1-473c-beff-b540b76bf519'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:55.212979 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb91d5f1e3644a9daba470f9a6c71d02', 'request_id': 'req-085bdf1e-ffd1-473c-beff-b540b76bf519'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:55.225036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] The token cache is being invalidate because project eb91d5f1e3644a9daba470f9a6c71d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:15:55.225322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:55.225955 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-085bdf1e-ffd1-473c-beff-b540b76bf519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:15:55.227446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1235/2442] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:15:55 2022] DELETE /identity/v3/projects/eb91d5f1e3644a9daba470f9a6c71d02 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:55.232792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b550ee-dd82-4901-a38c-5f6af52c89bb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:55.233304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b550ee-dd82-4901-a38c-5f6af52c89bb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:55.233403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b550ee-dd82-4901-a38c-5f6af52c89bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:55.255541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-50b550ee-dd82-4901-a38c-5f6af52c89bb None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:55.256931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-50b550ee-dd82-4901-a38c-5f6af52c89bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:55.287553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:55.320346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1208/2443] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:15:55.328632 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887836c3-095f-4c80-b6db-83fdfdd31271 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:55.328914 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887836c3-095f-4c80-b6db-83fdfdd31271 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:55.329184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887836c3-095f-4c80-b6db-83fdfdd31271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:55.351054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-887836c3-095f-4c80-b6db-83fdfdd31271 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:55.352581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-887836c3-095f-4c80-b6db-83fdfdd31271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:55.364593 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1236/2444] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:55.367106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b550ee-dd82-4901-a38c-5f6af52c89bb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:55.377707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b550ee-dd82-4901-a38c-5f6af52c89bb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:55.384019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29ee06-21d2-4ef8-8d27-18b1db4248cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:55.384675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29ee06-21d2-4ef8-8d27-18b1db4248cf admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:55.384949 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29ee06-21d2-4ef8-8d27-18b1db4248cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:55.385201 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29ee06-21d2-4ef8-8d27-18b1db4248cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:55.385865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29ee06-21d2-4ef8-8d27-18b1db4248cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:15:55.386197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29ee06-21d2-4ef8-8d27-18b1db4248cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:55.387810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29ee06-21d2-4ef8-8d27-18b1db4248cf admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:55.400653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1209/2445] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:15:55.405820 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887836c3-095f-4c80-b6db-83fdfdd31271 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:55.420582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887836c3-095f-4c80-b6db-83fdfdd31271 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:55.427174 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500dbd4-b41d-4b15-ac15-f8aafd0569ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:55.427741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500dbd4-b41d-4b15-ac15-f8aafd0569ba admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:55.428017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500dbd4-b41d-4b15-ac15-f8aafd0569ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:55.428286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500dbd4-b41d-4b15-ac15-f8aafd0569ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:55.429420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500dbd4-b41d-4b15-ac15-f8aafd0569ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:55.430929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500dbd4-b41d-4b15-ac15-f8aafd0569ba admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:55.467966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1237/2446] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:15:55 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:55.472216 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29ee06-21d2-4ef8-8d27-18b1db4248cf admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:55.482447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29ee06-21d2-4ef8-8d27-18b1db4248cf admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:55.553437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77492d-2bf1-4a7a-8bd8-3fcad61ac7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:55.554708 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77492d-2bf1-4a7a-8bd8-3fcad61ac7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:55.555076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77492d-2bf1-4a7a-8bd8-3fcad61ac7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:55.555449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77492d-2bf1-4a7a-8bd8-3fcad61ac7d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:55.556258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77492d-2bf1-4a7a-8bd8-3fcad61ac7d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:55.558413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77492d-2bf1-4a7a-8bd8-3fcad61ac7d8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:55.585071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1210/2447] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:15:55 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:15:55.586499 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500dbd4-b41d-4b15-ac15-f8aafd0569ba admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:55.592818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:55.604829 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500dbd4-b41d-4b15-ac15-f8aafd0569ba admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:55.617889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5433dc-056c-488a-87d6-4cef6d5f7ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:55.618513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5433dc-056c-488a-87d6-4cef6d5f7ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:55.618789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5433dc-056c-488a-87d6-4cef6d5f7ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:55.619061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5433dc-056c-488a-87d6-4cef6d5f7ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:55.619722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5433dc-056c-488a-87d6-4cef6d5f7ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:55.622232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5433dc-056c-488a-87d6-4cef6d5f7ac7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:55.634107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1238/2448] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:15:55.638098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77492d-2bf1-4a7a-8bd8-3fcad61ac7d8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:55.649574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77492d-2bf1-4a7a-8bd8-3fcad61ac7d8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:55.661411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30353f0-1934-4b83-b545-af5cb92570a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:55.662253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30353f0-1934-4b83-b545-af5cb92570a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:55.662627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30353f0-1934-4b83-b545-af5cb92570a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:55.663024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30353f0-1934-4b83-b545-af5cb92570a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:55.663836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30353f0-1934-4b83-b545-af5cb92570a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:55.665746 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30353f0-1934-4b83-b545-af5cb92570a2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:55.679355 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1211/2449] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:15:55.683442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5433dc-056c-488a-87d6-4cef6d5f7ac7 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:55.696481 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5433dc-056c-488a-87d6-4cef6d5f7ac7 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:55.703950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294f921-02cd-413f-9c09-9287cd135107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:55.704940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294f921-02cd-413f-9c09-9287cd135107 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:55.705346 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294f921-02cd-413f-9c09-9287cd135107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:55.705747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294f921-02cd-413f-9c09-9287cd135107 admin admin] PATH_INFO: `/v3/projects/4df97c5319df42d7a6534b5ca3b5c873/users/ecb55920b3334d0db3bb8934094ba28c/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:55.741723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294f921-02cd-413f-9c09-9287cd135107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df97c5319df42d7a6534b5ca3b5c873, user_id=ecb55920b3334d0db3bb8934094ba28c, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:55.746689 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294f921-02cd-413f-9c09-9287cd135107 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:55.793886 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1239/2450] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:15:55 2022] PUT /identity/v3/projects/4df97c5319df42d7a6534b5ca3b5c873/users/ecb55920b3334d0db3bb8934094ba28c/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:15:55.796606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf795f6-2981-493a-a648-03bed17d664e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:55.796955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf795f6-2981-493a-a648-03bed17d664e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:55.797284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf795f6-2981-493a-a648-03bed17d664e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:55.825240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-acf795f6-2981-493a-a648-03bed17d664e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:55.826700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-acf795f6-2981-493a-a648-03bed17d664e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:55.910780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1212/2451] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:15:55.931812 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294f921-02cd-413f-9c09-9287cd135107 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:55.933696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e294f921-02cd-413f-9c09-9287cd135107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:56.048023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294f921-02cd-413f-9c09-9287cd135107 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:56.060935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea0f4b-cba6-4c43-aa7c-847e08d6a943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:56.062744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea0f4b-cba6-4c43-aa7c-847e08d6a943 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:56.063028 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea0f4b-cba6-4c43-aa7c-847e08d6a943 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:56.063912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea0f4b-cba6-4c43-aa7c-847e08d6a943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:56.094510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea0f4b-cba6-4c43-aa7c-847e08d6a943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:56.096082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea0f4b-cba6-4c43-aa7c-847e08d6a943 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:56.127613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1240/2452] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:15:56.253269 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703e2d-c60f-44ef-b795-f15f4c1cd64c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:56.253756 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703e2d-c60f-44ef-b795-f15f4c1cd64c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:56.253906 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703e2d-c60f-44ef-b795-f15f4c1cd64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:56.274240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3c703e2d-c60f-44ef-b795-f15f4c1cd64c None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:56.275943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3c703e2d-c60f-44ef-b795-f15f4c1cd64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:56.312832 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:56.338915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1213/2453] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:15:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:56.397033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea0f4b-cba6-4c43-aa7c-847e08d6a943 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:56.400584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0fea0f4b-cba6-4c43-aa7c-847e08d6a943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:56.480574 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea0f4b-cba6-4c43-aa7c-847e08d6a943 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:56.489459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8bb7e-8c3e-485c-a783-74cf354f9611 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:56.490702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8bb7e-8c3e-485c-a783-74cf354f9611 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:56.491284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8bb7e-8c3e-485c-a783-74cf354f9611 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:56.491639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8bb7e-8c3e-485c-a783-74cf354f9611 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:56.506062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8bb7e-8c3e-485c-a783-74cf354f9611 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:56.508644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8bb7e-8c3e-485c-a783-74cf354f9611 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:56.529793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1241/2454] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:15:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:15:58.267844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fdc9e-87aa-4981-8882-5193ef31266c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:58.268422 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fdc9e-87aa-4981-8882-5193ef31266c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:58.268422 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fdc9e-87aa-4981-8882-5193ef31266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:58.328524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-dd5fdc9e-87aa-4981-8882-5193ef31266c None None] MFA Rules not processed for user `ecb55920b3334d0db3bb8934094ba28c`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:15:58.330388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-dd5fdc9e-87aa-4981-8882-5193ef31266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:58.518124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1214/2455] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:15:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:15:58.532014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8bb7e-8c3e-485c-a783-74cf354f9611 service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:15:58.535554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3cb8bb7e-8c3e-485c-a783-74cf354f9611 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:15:58.768046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8bb7e-8c3e-485c-a783-74cf354f9611 service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:15:58.793916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ff0bf-96ee-4a80-92dd-5262090397ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:15:58.795508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ff0bf-96ee-4a80-92dd-5262090397ae service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:15:58.795783 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ff0bf-96ee-4a80-92dd-5262090397ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:15:58.796064 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ff0bf-96ee-4a80-92dd-5262090397ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:15:58.826635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ff0bf-96ee-4a80-92dd-5262090397ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:15:58.828382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ff0bf-96ee-4a80-92dd-5262090397ae service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:15:58.844269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1242/2456] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:15:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:00.514745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83723cb7-754f-44c1-a2e8-cf6f14d6fcbb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:00.515811 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83723cb7-754f-44c1-a2e8-cf6f14d6fcbb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:00.516263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83723cb7-754f-44c1-a2e8-cf6f14d6fcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:00.543460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-83723cb7-754f-44c1-a2e8-cf6f14d6fcbb None None] MFA Rules not processed for user `ecb55920b3334d0db3bb8934094ba28c`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:00.545723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-83723cb7-754f-44c1-a2e8-cf6f14d6fcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:00.558076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1215/2457] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:00.870722 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ff0bf-96ee-4a80-92dd-5262090397ae service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:00.872688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e45ff0bf-96ee-4a80-92dd-5262090397ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:00.885417 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:00.911884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ff0bf-96ee-4a80-92dd-5262090397ae service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:00.921557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:00.924739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:00.927353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:00.927353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] PATH_INFO: `/v3/users/664ca23211794b9dade2baf58b884c42` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:00.927687 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=664ca23211794b9dade2baf58b884c42)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:00.932471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:00.968563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83723cb7-754f-44c1-a2e8-cf6f14d6fcbb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:00.979671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83723cb7-754f-44c1-a2e8-cf6f14d6fcbb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:00.986718 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652faa0-37bc-4d0e-b052-d385090d470a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:00.987859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652faa0-37bc-4d0e-b052-d385090d470a service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:00.988394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652faa0-37bc-4d0e-b052-d385090d470a service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:00.988743 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652faa0-37bc-4d0e-b052-d385090d470a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:00.992467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e652faa0-37bc-4d0e-b052-d385090d470a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:01.005489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652faa0-37bc-4d0e-b052-d385090d470a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:01.012290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652faa0-37bc-4d0e-b052-d385090d470a service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:01.015194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '664ca23211794b9dade2baf58b884c42'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:01.022413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1216/2458] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:01.032751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '664ca23211794b9dade2baf58b884c42'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:01.033428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '664ca23211794b9dade2baf58b884c42'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:01.043079 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '664ca23211794b9dade2baf58b884c42'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:01.062182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '664ca23211794b9dade2baf58b884c42'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:01.070173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1243/2459] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:00 2022] DELETE /identity/v3/users/664ca23211794b9dade2baf58b884c42 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:01.351025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652faa0-37bc-4d0e-b052-d385090d470a service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:01.376070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652faa0-37bc-4d0e-b052-d385090d470a service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:01.411804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:01.414301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:01.498532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:01.499333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:01.499333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:01.499650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] PATH_INFO: `/v3/projects/f4f6c57bec6d4567bd1d8066e20e1945` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:01.501432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f6c57bec6d4567bd1d8066e20e1945)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:01.504023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:01.567878 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bc510-3bcb-4643-ae19-855d9a65fbf2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:01.573611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a282d94-40cd-4320-a297-6b6abdc54466 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:01.574273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282d94-40cd-4320-a297-6b6abdc54466 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:01.574590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282d94-40cd-4320-a297-6b6abdc54466 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:01.575016 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282d94-40cd-4320-a297-6b6abdc54466 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:01.576970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8a282d94-40cd-4320-a297-6b6abdc54466 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:01.593916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a282d94-40cd-4320-a297-6b6abdc54466 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:01.595097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f6c57bec6d4567bd1d8066e20e1945', 'request_id': 'req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:01.595617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a282d94-40cd-4320-a297-6b6abdc54466 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:01.602486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:01.610657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f6c57bec6d4567bd1d8066e20e1945', 'request_id': 'req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:01.623101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1244/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:01.631617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f6c57bec6d4567bd1d8066e20e1945', 'request_id': 'req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:01.648491 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] The token cache is being invalidate because project f4f6c57bec6d4567bd1d8066e20e1945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:01.649511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:01.650359 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3f244ab4-b9bc-4ba9-b9d3-a6847a096656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:01.655658 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1217/2461] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:01 2022] DELETE /identity/v3/projects/f4f6c57bec6d4567bd1d8066e20e1945 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:01.657433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2b67-38a1-47c9-b823-c691f947017b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:01.657910 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2b67-38a1-47c9-b823-c691f947017b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:01.658330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2b67-38a1-47c9-b823-c691f947017b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:01.693359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-aeea2b67-38a1-47c9-b823-c691f947017b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:01.695828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aeea2b67-38a1-47c9-b823-c691f947017b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:01.790498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1245/2462] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:01.799675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f896-2b8d-4d9a-a819-e9cf17bf171b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:01.800516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f896-2b8d-4d9a-a819-e9cf17bf171b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:01.800793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f896-2b8d-4d9a-a819-e9cf17bf171b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:01.828313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4cf9f896-2b8d-4d9a-a819-e9cf17bf171b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:01.832517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4cf9f896-2b8d-4d9a-a819-e9cf17bf171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:01.842647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1218/2463] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:01.846925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea2b67-38a1-47c9-b823-c691f947017b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:01.854704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:01.863212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea2b67-38a1-47c9-b823-c691f947017b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:01.876611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f1060-abba-441a-a4fa-71810c5abd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:01.877255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1060-abba-441a-a4fa-71810c5abd0a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:01.877534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1060-abba-441a-a4fa-71810c5abd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:01.880048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1060-abba-441a-a4fa-71810c5abd0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:01.880048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f1060-abba-441a-a4fa-71810c5abd0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:16:01.883472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f1060-abba-441a-a4fa-71810c5abd0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:01.883472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f1060-abba-441a-a4fa-71810c5abd0a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:01.917038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1246/2464] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:16:01.927318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9f896-2b8d-4d9a-a819-e9cf17bf171b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:01.949070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9f896-2b8d-4d9a-a819-e9cf17bf171b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:01.962093 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad666161-e17e-4e3e-8be0-91e95fb993c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:01.963867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad666161-e17e-4e3e-8be0-91e95fb993c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:01.964150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad666161-e17e-4e3e-8be0-91e95fb993c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:01.964419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad666161-e17e-4e3e-8be0-91e95fb993c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:01.977869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad666161-e17e-4e3e-8be0-91e95fb993c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:01.984200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad666161-e17e-4e3e-8be0-91e95fb993c7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:02.054513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1219/2465] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:01 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:02.056487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f1060-abba-441a-a4fa-71810c5abd0a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:02.071121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f1060-abba-441a-a4fa-71810c5abd0a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:02.168464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9953-e8d7-48ae-ad69-3a4649292e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:02.169398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9953-e8d7-48ae-ad69-3a4649292e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:02.169729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9953-e8d7-48ae-ad69-3a4649292e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:02.170122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9953-e8d7-48ae-ad69-3a4649292e37 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:02.170900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f9953-e8d7-48ae-ad69-3a4649292e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:02.172998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f9953-e8d7-48ae-ad69-3a4649292e37 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:02.207378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1247/2466] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:02 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:02.211494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad666161-e17e-4e3e-8be0-91e95fb993c7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:02.225193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad666161-e17e-4e3e-8be0-91e95fb993c7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:02.238236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af02a02-79f1-4179-a846-8ff4f6662a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:02.238902 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af02a02-79f1-4179-a846-8ff4f6662a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:02.239173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af02a02-79f1-4179-a846-8ff4f6662a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:02.239437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af02a02-79f1-4179-a846-8ff4f6662a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:02.240096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af02a02-79f1-4179-a846-8ff4f6662a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:02.241729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af02a02-79f1-4179-a846-8ff4f6662a60 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:02.257125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1220/2467] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:02.261586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9953-e8d7-48ae-ad69-3a4649292e37 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:02.273685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9953-e8d7-48ae-ad69-3a4649292e37 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:02.287821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6b36f-e093-4cb0-8099-103e5145ad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:02.288585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6b36f-e093-4cb0-8099-103e5145ad73 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:02.288868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6b36f-e093-4cb0-8099-103e5145ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:02.289140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6b36f-e093-4cb0-8099-103e5145ad73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:02.289801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6b36f-e093-4cb0-8099-103e5145ad73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:02.291506 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6b36f-e093-4cb0-8099-103e5145ad73 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:02.305887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1248/2468] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:02.310591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af02a02-79f1-4179-a846-8ff4f6662a60 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:02.321792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af02a02-79f1-4179-a846-8ff4f6662a60 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:02.327421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac1047-9f22-443a-89d9-d340cd749a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:02.328199 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac1047-9f22-443a-89d9-d340cd749a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:02.328594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac1047-9f22-443a-89d9-d340cd749a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:02.328980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac1047-9f22-443a-89d9-d340cd749a31 admin admin] PATH_INFO: `/v3/projects/6449ae3887c64de6889b21729b3d0667/users/d0e0e14b9db5436c9f526aea36834f51/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:02.350639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac1047-9f22-443a-89d9-d340cd749a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6449ae3887c64de6889b21729b3d0667, user_id=d0e0e14b9db5436c9f526aea36834f51, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:02.354089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac1047-9f22-443a-89d9-d340cd749a31 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:02.377644 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1221/2469] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:02 2022] PUT /identity/v3/projects/6449ae3887c64de6889b21729b3d0667/users/d0e0e14b9db5436c9f526aea36834f51/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:02.389537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592df55-8409-43d1-bb0c-93b3ac9d6bcb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:02.389900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592df55-8409-43d1-bb0c-93b3ac9d6bcb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:02.390134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592df55-8409-43d1-bb0c-93b3ac9d6bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:02.422455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4592df55-8409-43d1-bb0c-93b3ac9d6bcb None None] MFA Rules not processed for user `d0e0e14b9db5436c9f526aea36834f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:02.423628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4592df55-8409-43d1-bb0c-93b3ac9d6bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:02.525821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1249/2470] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:02.536600 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac1047-9f22-443a-89d9-d340cd749a31 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:02.539574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2bac1047-9f22-443a-89d9-d340cd749a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:02.678373 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac1047-9f22-443a-89d9-d340cd749a31 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:02.686115 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad9c57-738f-42c1-9913-cd33d320cd6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:02.689671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad9c57-738f-42c1-9913-cd33d320cd6a service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:02.690075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad9c57-738f-42c1-9913-cd33d320cd6a service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:02.690457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad9c57-738f-42c1-9913-cd33d320cd6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:02.700600 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad9c57-738f-42c1-9913-cd33d320cd6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:02.702265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad9c57-738f-42c1-9913-cd33d320cd6a service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:02.713475 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1222/2471] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:04.107968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592df55-8409-43d1-bb0c-93b3ac9d6bcb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:04.111015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4592df55-8409-43d1-bb0c-93b3ac9d6bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:04.211386 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592df55-8409-43d1-bb0c-93b3ac9d6bcb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:04.222755 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c32d1-837c-424a-8f45-c9e515209059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:04.223652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c32d1-837c-424a-8f45-c9e515209059 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:04.223652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c32d1-837c-424a-8f45-c9e515209059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:04.223931 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c32d1-837c-424a-8f45-c9e515209059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:04.227764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-823c32d1-837c-424a-8f45-c9e515209059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:04.253374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c32d1-837c-424a-8f45-c9e515209059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:04.254801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c32d1-837c-424a-8f45-c9e515209059 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:04.265390 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1250/2472] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:04.800483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad9c57-738f-42c1-9913-cd33d320cd6a service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:04.812790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad9c57-738f-42c1-9913-cd33d320cd6a service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:04.817145 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216a65-338d-443e-9d1c-18685167dce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:04.817790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216a65-338d-443e-9d1c-18685167dce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:04.818353 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216a65-338d-443e-9d1c-18685167dce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:04.818599 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216a65-338d-443e-9d1c-18685167dce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:04.820993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-86216a65-338d-443e-9d1c-18685167dce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:04.946295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86216a65-338d-443e-9d1c-18685167dce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:04.946295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86216a65-338d-443e-9d1c-18685167dce0 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:04.957796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:04.960834 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1223/2473] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:05.758839 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c32d1-837c-424a-8f45-c9e515209059 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:05.767887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:05.776862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c32d1-837c-424a-8f45-c9e515209059 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:05.784571 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85265bd2-2a62-4d9f-a84d-8eca005baf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:05.785306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85265bd2-2a62-4d9f-a84d-8eca005baf03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:05.785653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85265bd2-2a62-4d9f-a84d-8eca005baf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:05.786058 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85265bd2-2a62-4d9f-a84d-8eca005baf03 admin admin] PATH_INFO: `/v3/users/d0e0e14b9db5436c9f526aea36834f51` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:05.787255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85265bd2-2a62-4d9f-a84d-8eca005baf03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e0e14b9db5436c9f526aea36834f51)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:05.789505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85265bd2-2a62-4d9f-a84d-8eca005baf03 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:05.881160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-85265bd2-2a62-4d9f-a84d-8eca005baf03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e0e14b9db5436c9f526aea36834f51'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:05.900744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-85265bd2-2a62-4d9f-a84d-8eca005baf03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e0e14b9db5436c9f526aea36834f51'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:05.901438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-85265bd2-2a62-4d9f-a84d-8eca005baf03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e0e14b9db5436c9f526aea36834f51'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:05.919999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-85265bd2-2a62-4d9f-a84d-8eca005baf03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e0e14b9db5436c9f526aea36834f51'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:05.921933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216a65-338d-443e-9d1c-18685167dce0 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:05.939062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-85265bd2-2a62-4d9f-a84d-8eca005baf03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e0e14b9db5436c9f526aea36834f51'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:05.952541 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1251/2474] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:05 2022] DELETE /identity/v3/users/d0e0e14b9db5436c9f526aea36834f51 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:05.959190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216a65-338d-443e-9d1c-18685167dce0 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:05.968285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51632f-da67-4f90-8655-59e861fc3e46 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:05.968665 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51632f-da67-4f90-8655-59e861fc3e46 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:05.969002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51632f-da67-4f90-8655-59e861fc3e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:06.002435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9b51632f-da67-4f90-8655-59e861fc3e46 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:06.003875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9b51632f-da67-4f90-8655-59e861fc3e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:06.085172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60d235-ba8c-4783-affe-2ca07bf0a706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:06.085694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60d235-ba8c-4783-affe-2ca07bf0a706 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:06.085994 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60d235-ba8c-4783-affe-2ca07bf0a706 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:06.086266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60d235-ba8c-4783-affe-2ca07bf0a706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:06.088206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8c60d235-ba8c-4783-affe-2ca07bf0a706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:06.104393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60d235-ba8c-4783-affe-2ca07bf0a706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:06.106413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60d235-ba8c-4783-affe-2ca07bf0a706 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:06.127222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1252/2475] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:06.131129 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1224/2476] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:06.139530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51632f-da67-4f90-8655-59e861fc3e46 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:06.141123 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9b51632f-da67-4f90-8655-59e861fc3e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:06.219403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51632f-da67-4f90-8655-59e861fc3e46 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:06.223892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae08ab-4c8c-4f72-a320-3e425eb2a124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:06.225399 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae08ab-4c8c-4f72-a320-3e425eb2a124 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:06.225886 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae08ab-4c8c-4f72-a320-3e425eb2a124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:06.226300 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae08ab-4c8c-4f72-a320-3e425eb2a124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:06.241771 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae08ab-4c8c-4f72-a320-3e425eb2a124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:06.243601 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae08ab-4c8c-4f72-a320-3e425eb2a124 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:06.255891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1253/2477] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:07.052737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60d235-ba8c-4783-affe-2ca07bf0a706 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:07.055492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8c60d235-ba8c-4783-affe-2ca07bf0a706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:07.072151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60d235-ba8c-4783-affe-2ca07bf0a706 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:07.080718 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:07.081586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:07.081992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:07.082639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] PATH_INFO: `/v3/projects/6449ae3887c64de6889b21729b3d0667` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:07.084017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6449ae3887c64de6889b21729b3d0667)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:07.087501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:07.174775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6449ae3887c64de6889b21729b3d0667', 'request_id': 'req-5cdd25c8-8d23-459f-b038-2bcf584442e7'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:07.188450 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6449ae3887c64de6889b21729b3d0667', 'request_id': 'req-5cdd25c8-8d23-459f-b038-2bcf584442e7'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:07.203460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6449ae3887c64de6889b21729b3d0667', 'request_id': 'req-5cdd25c8-8d23-459f-b038-2bcf584442e7'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:07.249109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] The token cache is being invalidate because project 6449ae3887c64de6889b21729b3d0667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:07.249109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:07.249109 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5cdd25c8-8d23-459f-b038-2bcf584442e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:07.253886 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1225/2478] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:07 2022] DELETE /identity/v3/projects/6449ae3887c64de6889b21729b3d0667 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:07.256007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262e982-b797-4994-aa27-aba45c3273ee None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:07.256495 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262e982-b797-4994-aa27-aba45c3273ee None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:07.256592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262e982-b797-4994-aa27-aba45c3273ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:07.294134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f262e982-b797-4994-aa27-aba45c3273ee None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:07.295779 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f262e982-b797-4994-aa27-aba45c3273ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:07.319176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:07.399913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1254/2479] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:07.409482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2c47f-cdec-4533-bca6-51b239860617 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:07.409813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2c47f-cdec-4533-bca6-51b239860617 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:07.410089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2c47f-cdec-4533-bca6-51b239860617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:07.437521 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-87b2c47f-cdec-4533-bca6-51b239860617 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:07.439086 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-87b2c47f-cdec-4533-bca6-51b239860617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:07.451217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1226/2480] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:07.455680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262e982-b797-4994-aa27-aba45c3273ee None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:07.472859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262e982-b797-4994-aa27-aba45c3273ee None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:07.485614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a8161-fe3c-43b7-9d78-9709a9f5c1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:07.486678 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a8161-fe3c-43b7-9d78-9709a9f5c1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:07.487149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a8161-fe3c-43b7-9d78-9709a9f5c1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:07.487498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a8161-fe3c-43b7-9d78-9709a9f5c1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:07.488478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a8161-fe3c-43b7-9d78-9709a9f5c1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:16:07.488909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a8161-fe3c-43b7-9d78-9709a9f5c1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:07.491329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a8161-fe3c-43b7-9d78-9709a9f5c1a2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:07.512322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1255/2481] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:16:07.518820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2c47f-cdec-4533-bca6-51b239860617 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:07.531709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2c47f-cdec-4533-bca6-51b239860617 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:07.546220 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d6331-c23f-4dc0-8f6c-ec501ef5e908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:07.547239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d6331-c23f-4dc0-8f6c-ec501ef5e908 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:07.548255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d6331-c23f-4dc0-8f6c-ec501ef5e908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:07.548754 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d6331-c23f-4dc0-8f6c-ec501ef5e908 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:07.549613 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d6331-c23f-4dc0-8f6c-ec501ef5e908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:07.552950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d6331-c23f-4dc0-8f6c-ec501ef5e908 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:07.596833 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1227/2482] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:07 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:07.601311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a8161-fe3c-43b7-9d78-9709a9f5c1a2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:07.612639 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a8161-fe3c-43b7-9d78-9709a9f5c1a2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:07.707834 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518a84e-af56-40e2-b206-a451c2f0e748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:07.708508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518a84e-af56-40e2-b206-a451c2f0e748 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:07.708826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518a84e-af56-40e2-b206-a451c2f0e748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:07.709138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518a84e-af56-40e2-b206-a451c2f0e748 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:07.710050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518a84e-af56-40e2-b206-a451c2f0e748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:07.713675 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518a84e-af56-40e2-b206-a451c2f0e748 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:07.742073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1256/2483] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:07 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:07.746631 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d6331-c23f-4dc0-8f6c-ec501ef5e908 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:07.757869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d6331-c23f-4dc0-8f6c-ec501ef5e908 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:07.768186 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be090d11-a96f-424a-ac85-7dc6109ee5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:07.768925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090d11-a96f-424a-ac85-7dc6109ee5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:07.769266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090d11-a96f-424a-ac85-7dc6109ee5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:07.769804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090d11-a96f-424a-ac85-7dc6109ee5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:07.770362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be090d11-a96f-424a-ac85-7dc6109ee5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:07.772265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be090d11-a96f-424a-ac85-7dc6109ee5c3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:07.785910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1228/2484] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:07.788276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518a84e-af56-40e2-b206-a451c2f0e748 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:07.801519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518a84e-af56-40e2-b206-a451c2f0e748 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:07.806563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083345c-0c90-4983-ad56-932f5b577a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:07.807179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083345c-0c90-4983-ad56-932f5b577a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:07.808975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083345c-0c90-4983-ad56-932f5b577a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:07.808975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083345c-0c90-4983-ad56-932f5b577a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:07.808975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083345c-0c90-4983-ad56-932f5b577a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:07.810424 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083345c-0c90-4983-ad56-932f5b577a96 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:07.827191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1257/2485] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:07.828699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be090d11-a96f-424a-ac85-7dc6109ee5c3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:07.839177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be090d11-a96f-424a-ac85-7dc6109ee5c3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:07.848180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d5fea-cf6d-4211-a31e-48fe84bd483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:07.848966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d5fea-cf6d-4211-a31e-48fe84bd483f admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:07.849319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d5fea-cf6d-4211-a31e-48fe84bd483f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:07.849675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d5fea-cf6d-4211-a31e-48fe84bd483f admin admin] PATH_INFO: `/v3/projects/e712bd067d2f46f1ad82a6ea007a86d1/users/7f64731bec74406692c4c3f53801bbb5/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:07.871210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d5fea-cf6d-4211-a31e-48fe84bd483f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e712bd067d2f46f1ad82a6ea007a86d1, user_id=7f64731bec74406692c4c3f53801bbb5, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:07.876314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d5fea-cf6d-4211-a31e-48fe84bd483f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:07.904820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1229/2486] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:07 2022] PUT /identity/v3/projects/e712bd067d2f46f1ad82a6ea007a86d1/users/7f64731bec74406692c4c3f53801bbb5/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:07.919210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f59e4-ed46-43f8-8a12-ee0003f9f87c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:07.919504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f59e4-ed46-43f8-8a12-ee0003f9f87c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:07.919909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f59e4-ed46-43f8-8a12-ee0003f9f87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:07.954563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bd8f59e4-ed46-43f8-8a12-ee0003f9f87c None None] MFA Rules not processed for user `7f64731bec74406692c4c3f53801bbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:07.955916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bd8f59e4-ed46-43f8-8a12-ee0003f9f87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:08.041911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1258/2487] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:08.050509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d5fea-cf6d-4211-a31e-48fe84bd483f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:08.052989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-239d5fea-cf6d-4211-a31e-48fe84bd483f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:08.060441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:08.164366 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d5fea-cf6d-4211-a31e-48fe84bd483f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:08.171120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04975ae7-d9d3-42bf-ae87-872e8e5c380a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:08.172019 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975ae7-d9d3-42bf-ae87-872e8e5c380a service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:08.172398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975ae7-d9d3-42bf-ae87-872e8e5c380a service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:08.172768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975ae7-d9d3-42bf-ae87-872e8e5c380a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:08.182516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04975ae7-d9d3-42bf-ae87-872e8e5c380a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:08.184424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04975ae7-d9d3-42bf-ae87-872e8e5c380a service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:08.195864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1230/2488] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:08.487207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f59e4-ed46-43f8-8a12-ee0003f9f87c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:08.513992 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:08.590378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f59e4-ed46-43f8-8a12-ee0003f9f87c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:08.594877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:08.595563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:08.595841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:08.596262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] PATH_INFO: `/v3/users/7f64731bec74406692c4c3f53801bbb5` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:08.597487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f64731bec74406692c4c3f53801bbb5)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:08.599468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:08.694392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f64731bec74406692c4c3f53801bbb5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:08.709895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f64731bec74406692c4c3f53801bbb5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:08.711340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f64731bec74406692c4c3f53801bbb5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:08.726137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f64731bec74406692c4c3f53801bbb5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:08.758791 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f64731bec74406692c4c3f53801bbb5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:08.770338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1259/2489] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:08 2022] DELETE /identity/v3/users/7f64731bec74406692c4c3f53801bbb5 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:08.775144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749218c3-f194-4b8a-ae8d-5a6def79195f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:08.775517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749218c3-f194-4b8a-ae8d-5a6def79195f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:08.776113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749218c3-f194-4b8a-ae8d-5a6def79195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:08.831048 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-749218c3-f194-4b8a-ae8d-5a6def79195f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:08.832454 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-749218c3-f194-4b8a-ae8d-5a6def79195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:08.953644 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1231/2490] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:08.968867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:08.970090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:09.114715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71c614-ca2d-4342-9f2d-380552de9372 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:09.119882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9a58-496f-4b36-a689-7b84626c5e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:09.120513 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9a58-496f-4b36-a689-7b84626c5e85 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:09.120957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9a58-496f-4b36-a689-7b84626c5e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:09.121151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9a58-496f-4b36-a689-7b84626c5e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:09.132891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc9a58-496f-4b36-a689-7b84626c5e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:09.135388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc9a58-496f-4b36-a689-7b84626c5e85 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:09.178067 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1260/2491] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:09.748085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749218c3-f194-4b8a-ae8d-5a6def79195f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:09.749781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-749218c3-f194-4b8a-ae8d-5a6def79195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:09.766693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749218c3-f194-4b8a-ae8d-5a6def79195f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:09.772348 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:09.773220 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:09.773719 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:09.774239 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] PATH_INFO: `/v3/projects/e712bd067d2f46f1ad82a6ea007a86d1` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:09.775596 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e712bd067d2f46f1ad82a6ea007a86d1)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:09.777934 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:09.878987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e712bd067d2f46f1ad82a6ea007a86d1', 'request_id': 'req-1e6938e4-363c-47aa-9f83-ba16e2451cbd'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:09.897944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e712bd067d2f46f1ad82a6ea007a86d1', 'request_id': 'req-1e6938e4-363c-47aa-9f83-ba16e2451cbd'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:09.925967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e712bd067d2f46f1ad82a6ea007a86d1', 'request_id': 'req-1e6938e4-363c-47aa-9f83-ba16e2451cbd'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:09.942619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] The token cache is being invalidate because project e712bd067d2f46f1ad82a6ea007a86d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:09.943105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:09.946701 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1e6938e4-363c-47aa-9f83-ba16e2451cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:09.952589 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1232/2492] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:09 2022] DELETE /identity/v3/projects/e712bd067d2f46f1ad82a6ea007a86d1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:09.953881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47f5e-ae06-43c5-89b1-e2136884af30 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:09.954352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47f5e-ae06-43c5-89b1-e2136884af30 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:09.954352 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47f5e-ae06-43c5-89b1-e2136884af30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:09.980189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-83f47f5e-ae06-43c5-89b1-e2136884af30 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:09.981725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-83f47f5e-ae06-43c5-89b1-e2136884af30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:10.056034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:10.117136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1261/2493] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:10.128549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba082079-0858-4f85-9834-983b4b86292f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:10.128839 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba082079-0858-4f85-9834-983b4b86292f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:10.129165 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba082079-0858-4f85-9834-983b4b86292f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:10.179575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ba082079-0858-4f85-9834-983b4b86292f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:10.180839 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ba082079-0858-4f85-9834-983b4b86292f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:10.191256 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1233/2494] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:10.195673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f47f5e-ae06-43c5-89b1-e2136884af30 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:10.211735 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f47f5e-ae06-43c5-89b1-e2136884af30 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:10.217362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6885d-52f5-42e3-94af-224d1c301645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:10.218072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6885d-52f5-42e3-94af-224d1c301645 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:10.218412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6885d-52f5-42e3-94af-224d1c301645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:10.218916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6885d-52f5-42e3-94af-224d1c301645 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:10.219970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6885d-52f5-42e3-94af-224d1c301645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:16:10.219970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6885d-52f5-42e3-94af-224d1c301645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:10.221536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6885d-52f5-42e3-94af-224d1c301645 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:10.233333 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1262/2495] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:16:10.238243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba082079-0858-4f85-9834-983b4b86292f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:10.248375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba082079-0858-4f85-9834-983b4b86292f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:10.252963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a8861-ab4f-4380-8d4c-c196cc398afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:10.255898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8861-ab4f-4380-8d4c-c196cc398afe admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:10.255898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8861-ab4f-4380-8d4c-c196cc398afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:10.255898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8861-ab4f-4380-8d4c-c196cc398afe admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:10.255898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a8861-ab4f-4380-8d4c-c196cc398afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:10.256838 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a8861-ab4f-4380-8d4c-c196cc398afe admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:10.261648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:10.287234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1234/2496] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:10 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:10.291365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6885d-52f5-42e3-94af-224d1c301645 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:10.303625 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6885d-52f5-42e3-94af-224d1c301645 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:10.373353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a57aa-08db-4cf6-896c-e8e22faf1291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:10.374401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a57aa-08db-4cf6-896c-e8e22faf1291 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:10.375209 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a57aa-08db-4cf6-896c-e8e22faf1291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:10.375492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a57aa-08db-4cf6-896c-e8e22faf1291 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:10.376133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a57aa-08db-4cf6-896c-e8e22faf1291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:10.378113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a57aa-08db-4cf6-896c-e8e22faf1291 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:10.410873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1263/2497] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:10 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:10.415427 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a8861-ab4f-4380-8d4c-c196cc398afe admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:10.429238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a8861-ab4f-4380-8d4c-c196cc398afe admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:10.433665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246aaf7e-4cc8-4e8c-a065-0af1f56584bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:10.437812 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aaf7e-4cc8-4e8c-a065-0af1f56584bc admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:10.438118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aaf7e-4cc8-4e8c-a065-0af1f56584bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:10.438387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aaf7e-4cc8-4e8c-a065-0af1f56584bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:10.439171 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246aaf7e-4cc8-4e8c-a065-0af1f56584bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:10.441954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246aaf7e-4cc8-4e8c-a065-0af1f56584bc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:10.464773 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a57aa-08db-4cf6-896c-e8e22faf1291 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:10.466351 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1235/2498] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:10.475594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a57aa-08db-4cf6-896c-e8e22faf1291 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:10.486214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb43dc8-97cb-4839-b579-249b6c13cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:10.486855 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb43dc8-97cb-4839-b579-249b6c13cdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:10.487137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb43dc8-97cb-4839-b579-249b6c13cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:10.487504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb43dc8-97cb-4839-b579-249b6c13cdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:10.488412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb43dc8-97cb-4839-b579-249b6c13cdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:10.490123 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb43dc8-97cb-4839-b579-249b6c13cdc8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:10.526834 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1264/2499] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:10.531652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246aaf7e-4cc8-4e8c-a065-0af1f56584bc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:10.545126 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246aaf7e-4cc8-4e8c-a065-0af1f56584bc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:10.553356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e5b03-0697-445d-a1ba-44813f35747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:10.554084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e5b03-0697-445d-a1ba-44813f35747d admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:10.555017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e5b03-0697-445d-a1ba-44813f35747d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:10.555287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e5b03-0697-445d-a1ba-44813f35747d admin admin] PATH_INFO: `/v3/projects/f3f9100f741342e6bb0777b7e88ee6dd/users/7b71bcb40fd543b4b4ede53a4ee2be37/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:10.618146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e5b03-0697-445d-a1ba-44813f35747d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f9100f741342e6bb0777b7e88ee6dd, user_id=7b71bcb40fd543b4b4ede53a4ee2be37, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:10.622073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e5b03-0697-445d-a1ba-44813f35747d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:10.652181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1236/2500] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:10 2022] PUT /identity/v3/projects/f3f9100f741342e6bb0777b7e88ee6dd/users/7b71bcb40fd543b4b4ede53a4ee2be37/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:10.662919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86884d-0615-4249-b0ac-aaaf7e1a05c6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:10.663284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86884d-0615-4249-b0ac-aaaf7e1a05c6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:10.663774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86884d-0615-4249-b0ac-aaaf7e1a05c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:10.720503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ab86884d-0615-4249-b0ac-aaaf7e1a05c6 None None] MFA Rules not processed for user `7b71bcb40fd543b4b4ede53a4ee2be37`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:10.721741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ab86884d-0615-4249-b0ac-aaaf7e1a05c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:10.803449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1265/2501] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:10.808353 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e5b03-0697-445d-a1ba-44813f35747d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:10.897639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e5b03-0697-445d-a1ba-44813f35747d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:10.903349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613683af-1cda-4bf5-9176-c62158763ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:10.904159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613683af-1cda-4bf5-9176-c62158763ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:10.904437 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613683af-1cda-4bf5-9176-c62158763ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:10.904708 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613683af-1cda-4bf5-9176-c62158763ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:10.905490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613683af-1cda-4bf5-9176-c62158763ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:10.907496 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613683af-1cda-4bf5-9176-c62158763ba7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:10.942379 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1237/2502] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:10 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:10.946348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86884d-0615-4249-b0ac-aaaf7e1a05c6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:10.957505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86884d-0615-4249-b0ac-aaaf7e1a05c6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:10.986875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:11.016743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa8228-1cdc-4f77-b23f-9b8025c17577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:11.017366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa8228-1cdc-4f77-b23f-9b8025c17577 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:11.017636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa8228-1cdc-4f77-b23f-9b8025c17577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:11.018066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa8228-1cdc-4f77-b23f-9b8025c17577 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:11.018711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa8228-1cdc-4f77-b23f-9b8025c17577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:11.020766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa8228-1cdc-4f77-b23f-9b8025c17577 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:11.046043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1266/2503] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:10 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:16:11.050097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613683af-1cda-4bf5-9176-c62158763ba7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:11.060544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613683af-1cda-4bf5-9176-c62158763ba7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:11.065325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351238d4-0791-4493-a8c7-1a7952507809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:11.065954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351238d4-0791-4493-a8c7-1a7952507809 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:11.066836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351238d4-0791-4493-a8c7-1a7952507809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:11.066836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351238d4-0791-4493-a8c7-1a7952507809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:11.067144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351238d4-0791-4493-a8c7-1a7952507809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:11.068764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351238d4-0791-4493-a8c7-1a7952507809 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:11.080199 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1238/2504] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:11.084644 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa8228-1cdc-4f77-b23f-9b8025c17577 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:11.095865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa8228-1cdc-4f77-b23f-9b8025c17577 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:11.100779 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231be99-2542-481a-8e63-8405dadb83ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:11.101471 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231be99-2542-481a-8e63-8405dadb83ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:11.101741 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231be99-2542-481a-8e63-8405dadb83ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:11.104937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231be99-2542-481a-8e63-8405dadb83ba admin admin] PATH_INFO: `/v3/projects/7474593eafa54b90bc3ee82803ffbee7/users/656f7556012d448998706cb1fbfdf350/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:11.119244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231be99-2542-481a-8e63-8405dadb83ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7474593eafa54b90bc3ee82803ffbee7, user_id=656f7556012d448998706cb1fbfdf350, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:11.122088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231be99-2542-481a-8e63-8405dadb83ba admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:11.137679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1267/2505] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:11 2022] PUT /identity/v3/projects/7474593eafa54b90bc3ee82803ffbee7/users/656f7556012d448998706cb1fbfdf350/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:11.141740 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351238d4-0791-4493-a8c7-1a7952507809 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:11.151915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351238d4-0791-4493-a8c7-1a7952507809 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:11.211538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106358c-9e5e-4993-8306-eb7c25e974ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:11.212233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106358c-9e5e-4993-8306-eb7c25e974ad admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:11.212423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106358c-9e5e-4993-8306-eb7c25e974ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:11.212694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106358c-9e5e-4993-8306-eb7c25e974ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:11.213354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106358c-9e5e-4993-8306-eb7c25e974ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:11.215031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106358c-9e5e-4993-8306-eb7c25e974ad admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:11.226765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1239/2506] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:11.231313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231be99-2542-481a-8e63-8405dadb83ba admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:11.244584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231be99-2542-481a-8e63-8405dadb83ba admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:11.250675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106358c-9e5e-4993-8306-eb7c25e974ad admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:11.252399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4106358c-9e5e-4993-8306-eb7c25e974ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:11.255082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e16d0-00de-4a0d-a541-0a4e363d932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:11.255764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e16d0-00de-4a0d-a541-0a4e363d932e admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:11.256041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e16d0-00de-4a0d-a541-0a4e363d932e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:11.256341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e16d0-00de-4a0d-a541-0a4e363d932e admin admin] PATH_INFO: `/v3/projects/7474593eafa54b90bc3ee82803ffbee7/users/656f7556012d448998706cb1fbfdf350/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:11.259232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e16d0-00de-4a0d-a541-0a4e363d932e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7474593eafa54b90bc3ee82803ffbee7, user_id=656f7556012d448998706cb1fbfdf350, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:11.262066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e16d0-00de-4a0d-a541-0a4e363d932e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:11.269007 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106358c-9e5e-4993-8306-eb7c25e974ad admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:11.283837 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1268/2507] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:11 2022] PUT /identity/v3/projects/7474593eafa54b90bc3ee82803ffbee7/users/656f7556012d448998706cb1fbfdf350/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:11.285456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c87d-8e32-4e5d-b351-2416736e87b7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:11.285746 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c87d-8e32-4e5d-b351-2416736e87b7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:11.286163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c87d-8e32-4e5d-b351-2416736e87b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:11.289559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:11.321135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1f52c87d-8e32-4e5d-b351-2416736e87b7 None None] MFA Rules not processed for user `656f7556012d448998706cb1fbfdf350`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:11.323226 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1f52c87d-8e32-4e5d-b351-2416736e87b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:11.342766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:11.343656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:11.343765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:11.344000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] PATH_INFO: `/v3/users/e5d4998f54924ecab01a6dbc64b6d9db` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:11.345155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d4998f54924ecab01a6dbc64b6d9db)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:11.347173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:11.407823 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1269/2508] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:11.408538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d4998f54924ecab01a6dbc64b6d9db'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:11.409517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d4998f54924ecab01a6dbc64b6d9db'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:11.422732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52c87d-8e32-4e5d-b351-2416736e87b7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:11.424164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1f52c87d-8e32-4e5d-b351-2416736e87b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:11.425586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d4998f54924ecab01a6dbc64b6d9db'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:11.439490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d4998f54924ecab01a6dbc64b6d9db'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:11.440696 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d4998f54924ecab01a6dbc64b6d9db'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:11.472071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1240/2509] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:11 2022] DELETE /identity/v3/users/e5d4998f54924ecab01a6dbc64b6d9db => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:11.516781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52c87d-8e32-4e5d-b351-2416736e87b7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:11.548251 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:11.582306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d991c-8579-49d2-a53c-b55b3f7f1611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:11.582933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d991c-8579-49d2-a53c-b55b3f7f1611 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:11.583205 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d991c-8579-49d2-a53c-b55b3f7f1611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:11.583469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d991c-8579-49d2-a53c-b55b3f7f1611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:11.585494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4d5d991c-8579-49d2-a53c-b55b3f7f1611 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:11.657411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d991c-8579-49d2-a53c-b55b3f7f1611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:11.658890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d991c-8579-49d2-a53c-b55b3f7f1611 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:11.660868 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:11.662615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:11.671858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1270/2510] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:11.736815 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e098f-4935-4fda-b2c9-14e647246926 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:11.741452 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:11.742125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:11.742399 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:11.742784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] PATH_INFO: `/v3/projects/b56654f66be9494db618d9c82a70ab38` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:11.743928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56654f66be9494db618d9c82a70ab38)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:11.745817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:11.797765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:11.807371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56654f66be9494db618d9c82a70ab38', 'request_id': 'req-677a3711-615d-4cbc-9d1c-b3576473f1ff'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:11.814779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56654f66be9494db618d9c82a70ab38', 'request_id': 'req-677a3711-615d-4cbc-9d1c-b3576473f1ff'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:11.823925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56654f66be9494db618d9c82a70ab38', 'request_id': 'req-677a3711-615d-4cbc-9d1c-b3576473f1ff'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:11.835944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] The token cache is being invalidate because project b56654f66be9494db618d9c82a70ab38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:11.836232 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:11.836878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-677a3711-615d-4cbc-9d1c-b3576473f1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:11.838474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1241/2511] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:11 2022] DELETE /identity/v3/projects/b56654f66be9494db618d9c82a70ab38 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:11.848319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5cc87-90c4-45d6-9462-6f868d76166b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:11.848589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5cc87-90c4-45d6-9462-6f868d76166b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:11.848880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5cc87-90c4-45d6-9462-6f868d76166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:11.872555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9ea5cc87-90c4-45d6-9462-6f868d76166b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:11.872673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9ea5cc87-90c4-45d6-9462-6f868d76166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:11.943963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1271/2512] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:11.953891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99117afc-108b-47c8-9cf9-585916a71920 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:11.953891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99117afc-108b-47c8-9cf9-585916a71920 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:11.954193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99117afc-108b-47c8-9cf9-585916a71920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:11.982181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-99117afc-108b-47c8-9cf9-585916a71920 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:11.983418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-99117afc-108b-47c8-9cf9-585916a71920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:11.998884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1242/2513] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:12.002529 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5cc87-90c4-45d6-9462-6f868d76166b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.013528 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5cc87-90c4-45d6-9462-6f868d76166b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.028295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99117afc-108b-47c8-9cf9-585916a71920 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.029553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713e642-d24b-41b2-afb2-2ea3389fa9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.030286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713e642-d24b-41b2-afb2-2ea3389fa9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.030662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713e642-d24b-41b2-afb2-2ea3389fa9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.030772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713e642-d24b-41b2-afb2-2ea3389fa9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.030914 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-99117afc-108b-47c8-9cf9-585916a71920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:12.031555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713e642-d24b-41b2-afb2-2ea3389fa9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:16:12.031861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713e642-d24b-41b2-afb2-2ea3389fa9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.033567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713e642-d24b-41b2-afb2-2ea3389fa9d4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.047272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1272/2514] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:16:12.052747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713e642-d24b-41b2-afb2-2ea3389fa9d4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.064787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713e642-d24b-41b2-afb2-2ea3389fa9d4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.069549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c05fe-014d-4a05-9f71-0e5c2d0d259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.070347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c05fe-014d-4a05-9f71-0e5c2d0d259c admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.070902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c05fe-014d-4a05-9f71-0e5c2d0d259c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.071123 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c05fe-014d-4a05-9f71-0e5c2d0d259c admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.072477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c05fe-014d-4a05-9f71-0e5c2d0d259c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.074148 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c05fe-014d-4a05-9f71-0e5c2d0d259c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.113298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1273/2515] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:12 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:12.117599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c05fe-014d-4a05-9f71-0e5c2d0d259c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.148329 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99117afc-108b-47c8-9cf9-585916a71920 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.173625 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:12.235157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c05fe-014d-4a05-9f71-0e5c2d0d259c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.242403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8b990-e1ff-41ea-95d4-e6627bd50dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.243330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8b990-e1ff-41ea-95d4-e6627bd50dea admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.243871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8b990-e1ff-41ea-95d4-e6627bd50dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.244239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8b990-e1ff-41ea-95d4-e6627bd50dea admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.245754 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8b990-e1ff-41ea-95d4-e6627bd50dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.250180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8b990-e1ff-41ea-95d4-e6627bd50dea admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.256566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20a762-464c-4d63-8083-5e119575b4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.257263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20a762-464c-4d63-8083-5e119575b4b3 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.257601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20a762-464c-4d63-8083-5e119575b4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.257884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20a762-464c-4d63-8083-5e119575b4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.259820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3a20a762-464c-4d63-8083-5e119575b4b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:12.278968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20a762-464c-4d63-8083-5e119575b4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.280742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20a762-464c-4d63-8083-5e119575b4b3 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.284155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1274/2516] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:12 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:12.285189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8b990-e1ff-41ea-95d4-e6627bd50dea admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.287260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b7f8b990-e1ff-41ea-95d4-e6627bd50dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:12.293006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1243/2517] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:12.294016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20a762-464c-4d63-8083-5e119575b4b3 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.304883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20a762-464c-4d63-8083-5e119575b4b3 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.311523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b950c2-3084-45d7-9091-045f92a62267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.311853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b950c2-3084-45d7-9091-045f92a62267 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.312119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b950c2-3084-45d7-9091-045f92a62267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.312397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b950c2-3084-45d7-9091-045f92a62267 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.313108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b950c2-3084-45d7-9091-045f92a62267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.314986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b950c2-3084-45d7-9091-045f92a62267 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.319313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8b990-e1ff-41ea-95d4-e6627bd50dea admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.331400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dfd23-73af-420e-915d-bfb908322323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.332849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dfd23-73af-420e-915d-bfb908322323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.333193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dfd23-73af-420e-915d-bfb908322323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.333537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dfd23-73af-420e-915d-bfb908322323 admin admin] PATH_INFO: `/v3/users/7b71bcb40fd543b4b4ede53a4ee2be37` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.334933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dfd23-73af-420e-915d-bfb908322323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b71bcb40fd543b4b4ede53a4ee2be37)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.338423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dfd23-73af-420e-915d-bfb908322323 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.339654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1244/2518] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:12.344578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b950c2-3084-45d7-9091-045f92a62267 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.358065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b950c2-3084-45d7-9091-045f92a62267 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.363749 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7e5a3-9b48-434a-b615-fce71e873aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.364401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e5a3-9b48-434a-b615-fce71e873aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.364677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e5a3-9b48-434a-b615-fce71e873aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.364951 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e5a3-9b48-434a-b615-fce71e873aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.365582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7e5a3-9b48-434a-b615-fce71e873aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.367372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7e5a3-9b48-434a-b615-fce71e873aaa admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.381595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1245/2519] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:12.385667 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7e5a3-9b48-434a-b615-fce71e873aaa admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.396564 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7e5a3-9b48-434a-b615-fce71e873aaa admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.401331 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14584541-9fff-4e1f-a402-2246f3283dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.402016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584541-9fff-4e1f-a402-2246f3283dae admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.402300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584541-9fff-4e1f-a402-2246f3283dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.402600 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584541-9fff-4e1f-a402-2246f3283dae admin admin] PATH_INFO: `/v3/projects/1cc9149901b243fbb3f8b241f33ccad1/users/5c15f7689be245368a43983c8a3b6b34/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.408920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-970dfd23-73af-420e-915d-bfb908322323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b71bcb40fd543b4b4ede53a4ee2be37'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:12.418477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-970dfd23-73af-420e-915d-bfb908322323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b71bcb40fd543b4b4ede53a4ee2be37'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:12.420307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-970dfd23-73af-420e-915d-bfb908322323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b71bcb40fd543b4b4ede53a4ee2be37'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:12.420499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14584541-9fff-4e1f-a402-2246f3283dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc9149901b243fbb3f8b241f33ccad1, user_id=5c15f7689be245368a43983c8a3b6b34, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.423036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14584541-9fff-4e1f-a402-2246f3283dae admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.427862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-970dfd23-73af-420e-915d-bfb908322323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b71bcb40fd543b4b4ede53a4ee2be37'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:12.434358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:12.439813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1246/2520] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:12 2022] PUT /identity/v3/projects/1cc9149901b243fbb3f8b241f33ccad1/users/5c15f7689be245368a43983c8a3b6b34/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:12.441755 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-970dfd23-73af-420e-915d-bfb908322323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b71bcb40fd543b4b4ede53a4ee2be37'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:12.448025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1275/2521] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:12 2022] DELETE /identity/v3/users/7b71bcb40fd543b4b4ede53a4ee2be37 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:12.450878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b94f4-2ad6-4d0d-80bb-53c33079f8fa None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.451316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b94f4-2ad6-4d0d-80bb-53c33079f8fa None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.451589 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b94f4-2ad6-4d0d-80bb-53c33079f8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.452248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7ed58-a31e-4bc2-8629-cedd39d53846 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.452535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7ed58-a31e-4bc2-8629-cedd39d53846 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.452804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7ed58-a31e-4bc2-8629-cedd39d53846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.475686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-dec7ed58-a31e-4bc2-8629-cedd39d53846 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:12.477760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dec7ed58-a31e-4bc2-8629-cedd39d53846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:12.484674 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9d1b94f4-2ad6-4d0d-80bb-53c33079f8fa None None] MFA Rules not processed for user `5c15f7689be245368a43983c8a3b6b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:12.486272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9d1b94f4-2ad6-4d0d-80bb-53c33079f8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:12.553201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1276/2522] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:12.563343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7ed58-a31e-4bc2-8629-cedd39d53846 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.565410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dec7ed58-a31e-4bc2-8629-cedd39d53846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:12.569608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1247/2523] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:12.574268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b94f4-2ad6-4d0d-80bb-53c33079f8fa None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.575923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9d1b94f4-2ad6-4d0d-80bb-53c33079f8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:12.591267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b94f4-2ad6-4d0d-80bb-53c33079f8fa None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.596809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78173909-6903-4e73-9584-d897143e91f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.597246 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78173909-6903-4e73-9584-d897143e91f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.597594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78173909-6903-4e73-9584-d897143e91f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.597961 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78173909-6903-4e73-9584-d897143e91f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.598785 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78173909-6903-4e73-9584-d897143e91f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.601176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78173909-6903-4e73-9584-d897143e91f7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.614395 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:12.632525 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7ed58-a31e-4bc2-8629-cedd39d53846 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.635227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1248/2524] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:12 2022] POST /identity/v3/projects => generated 393 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:12.639056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58600c26-0650-486e-a02f-54f0447200ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.639687 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58600c26-0650-486e-a02f-54f0447200ee service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.639848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78173909-6903-4e73-9584-d897143e91f7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.640006 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58600c26-0650-486e-a02f-54f0447200ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.640292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58600c26-0650-486e-a02f-54f0447200ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.650822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58600c26-0650-486e-a02f-54f0447200ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.652306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58600c26-0650-486e-a02f-54f0447200ee service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.664468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1277/2525] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:12.706728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78173909-6903-4e73-9584-d897143e91f7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.714732 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe8565-a83e-41dd-8c1d-4d297cf1812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.715236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe8565-a83e-41dd-8c1d-4d297cf1812b admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.715500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe8565-a83e-41dd-8c1d-4d297cf1812b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.715823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe8565-a83e-41dd-8c1d-4d297cf1812b admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.716547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe8565-a83e-41dd-8c1d-4d297cf1812b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.718668 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe8565-a83e-41dd-8c1d-4d297cf1812b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.744781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1249/2526] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:12 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:16:12.746100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58600c26-0650-486e-a02f-54f0447200ee service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.756356 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58600c26-0650-486e-a02f-54f0447200ee service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.760998 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141a194-060c-44ee-bde1-b949393df753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.761597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a194-060c-44ee-bde1-b949393df753 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.761905 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a194-060c-44ee-bde1-b949393df753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.762187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a194-060c-44ee-bde1-b949393df753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.763006 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141a194-060c-44ee-bde1-b949393df753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.764651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141a194-060c-44ee-bde1-b949393df753 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.778169 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1278/2527] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:12.779503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe8565-a83e-41dd-8c1d-4d297cf1812b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.789635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe8565-a83e-41dd-8c1d-4d297cf1812b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.795181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323b663-411b-41e8-88b0-d5d9958836d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.795888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b663-411b-41e8-88b0-d5d9958836d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.796164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b663-411b-41e8-88b0-d5d9958836d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.796433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b663-411b-41e8-88b0-d5d9958836d5 admin admin] PATH_INFO: `/v3/projects/c2cdadf7c4f448729b21fc06b0b48746/users/dedef9d24c57405fb0d4f6e75f5b9dc0/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.813213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323b663-411b-41e8-88b0-d5d9958836d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2cdadf7c4f448729b21fc06b0b48746, user_id=dedef9d24c57405fb0d4f6e75f5b9dc0, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.815896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323b663-411b-41e8-88b0-d5d9958836d5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.834857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1250/2528] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:12 2022] PUT /identity/v3/projects/c2cdadf7c4f448729b21fc06b0b48746/users/dedef9d24c57405fb0d4f6e75f5b9dc0/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:12.838877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141a194-060c-44ee-bde1-b949393df753 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.849174 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141a194-060c-44ee-bde1-b949393df753 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.905865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c8021-eece-4b21-bd93-eabba3669ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.906484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c8021-eece-4b21-bd93-eabba3669ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.906760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c8021-eece-4b21-bd93-eabba3669ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.907063 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c8021-eece-4b21-bd93-eabba3669ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.907719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c8021-eece-4b21-bd93-eabba3669ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.909312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c8021-eece-4b21-bd93-eabba3669ff4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.919367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1279/2529] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:12.923966 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323b663-411b-41e8-88b0-d5d9958836d5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.935770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323b663-411b-41e8-88b0-d5d9958836d5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.941226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daa5ba-4cad-4421-bfd3-a57f2135093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:12.942027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daa5ba-4cad-4421-bfd3-a57f2135093d admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.942340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daa5ba-4cad-4421-bfd3-a57f2135093d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.942924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daa5ba-4cad-4421-bfd3-a57f2135093d admin admin] PATH_INFO: `/v3/projects/c2cdadf7c4f448729b21fc06b0b48746/users/dedef9d24c57405fb0d4f6e75f5b9dc0/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:12.945060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c8021-eece-4b21-bd93-eabba3669ff4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:12.945619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76daa5ba-4cad-4421-bfd3-a57f2135093d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2cdadf7c4f448729b21fc06b0b48746, user_id=dedef9d24c57405fb0d4f6e75f5b9dc0, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:12.947185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e33c8021-eece-4b21-bd93-eabba3669ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:12.948386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76daa5ba-4cad-4421-bfd3-a57f2135093d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:12.960090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1251/2530] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:12 2022] PUT /identity/v3/projects/c2cdadf7c4f448729b21fc06b0b48746/users/dedef9d24c57405fb0d4f6e75f5b9dc0/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:12.961364 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c8021-eece-4b21-bd93-eabba3669ff4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:12.979267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea3ef0-bf3b-4adb-8b6c-a20ed6073f1d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:12.979640 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea3ef0-bf3b-4adb-8b6c-a20ed6073f1d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:12.979981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea3ef0-bf3b-4adb-8b6c-a20ed6073f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:13.015270 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2cea3ef0-bf3b-4adb-8b6c-a20ed6073f1d None None] MFA Rules not processed for user `dedef9d24c57405fb0d4f6e75f5b9dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:13.016641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2cea3ef0-bf3b-4adb-8b6c-a20ed6073f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:13.025516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:13.027276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:13.028100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:13.028373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:13.028685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] PATH_INFO: `/v3/projects/f3f9100f741342e6bb0777b7e88ee6dd` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:13.029826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f9100f741342e6bb0777b7e88ee6dd)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:13.032517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:13.086849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f9100f741342e6bb0777b7e88ee6dd', 'request_id': 'req-c67d2144-a3fd-42da-bce6-b9ae70f3208c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.096039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f9100f741342e6bb0777b7e88ee6dd', 'request_id': 'req-c67d2144-a3fd-42da-bce6-b9ae70f3208c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.101863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f9100f741342e6bb0777b7e88ee6dd', 'request_id': 'req-c67d2144-a3fd-42da-bce6-b9ae70f3208c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.107235 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1252/2531] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:13.112683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:13.116739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] The token cache is being invalidate because project f3f9100f741342e6bb0777b7e88ee6dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:13.117111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.117927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.122767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1280/2532] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:12 2022] DELETE /identity/v3/projects/f3f9100f741342e6bb0777b7e88ee6dd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:13.127455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea3ef0-bf3b-4adb-8b6c-a20ed6073f1d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:13.127622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:13.129094 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:13.129277 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2cea3ef0-bf3b-4adb-8b6c-a20ed6073f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:13.209248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea3ef0-bf3b-4adb-8b6c-a20ed6073f1d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:13.209546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d2144-a3fd-42da-bce6-b9ae70f3208c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:13.216483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:13.217150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:13.217433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:13.217805 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] PATH_INFO: `/v3/users/656f7556012d448998706cb1fbfdf350` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:13.218911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656f7556012d448998706cb1fbfdf350)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:13.220850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:13.272452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656f7556012d448998706cb1fbfdf350'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.273527 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15eab1-ddfe-474e-8f95-e9a15913a4fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:13.274172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15eab1-ddfe-474e-8f95-e9a15913a4fc service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:13.274440 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15eab1-ddfe-474e-8f95-e9a15913a4fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:13.274711 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15eab1-ddfe-474e-8f95-e9a15913a4fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:13.276476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5d15eab1-ddfe-474e-8f95-e9a15913a4fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:13.281105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656f7556012d448998706cb1fbfdf350'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.281773 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656f7556012d448998706cb1fbfdf350'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.289231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656f7556012d448998706cb1fbfdf350'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.301150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656f7556012d448998706cb1fbfdf350'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.307347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1281/2533] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:13 2022] DELETE /identity/v3/users/656f7556012d448998706cb1fbfdf350 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:13.342470 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15eab1-ddfe-474e-8f95-e9a15913a4fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:13.343924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15eab1-ddfe-474e-8f95-e9a15913a4fc service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:13.353544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1253/2534] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:13 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:13.404223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:13.405857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:13.482651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923fdb3-f45b-4fa8-8633-a40732f10b56 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:13.491045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b5015-6ae9-4fe1-9bf1-821e609cb98f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:13.492803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b5015-6ae9-4fe1-9bf1-821e609cb98f service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:13.493207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b5015-6ae9-4fe1-9bf1-821e609cb98f service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:13.493491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b5015-6ae9-4fe1-9bf1-821e609cb98f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:13.495533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-015b5015-6ae9-4fe1-9bf1-821e609cb98f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:13.543887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:13.589336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b5015-6ae9-4fe1-9bf1-821e609cb98f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:13.590881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b5015-6ae9-4fe1-9bf1-821e609cb98f service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:13.608468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1282/2535] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:13.616605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15eab1-ddfe-474e-8f95-e9a15913a4fc service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:13.628588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15eab1-ddfe-474e-8f95-e9a15913a4fc service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:13.636704 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:13.686410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:13.687087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:13.687466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:13.687853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] PATH_INFO: `/v3/projects/7474593eafa54b90bc3ee82803ffbee7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:13.689218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7474593eafa54b90bc3ee82803ffbee7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:13.691428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:13.745947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7474593eafa54b90bc3ee82803ffbee7', 'request_id': 'req-17052500-d567-4192-b329-89a8ecdced38'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.751931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7474593eafa54b90bc3ee82803ffbee7', 'request_id': 'req-17052500-d567-4192-b329-89a8ecdced38'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.760245 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7474593eafa54b90bc3ee82803ffbee7', 'request_id': 'req-17052500-d567-4192-b329-89a8ecdced38'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.778065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] The token cache is being invalidate because project 7474593eafa54b90bc3ee82803ffbee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:13.778400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.779171 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-17052500-d567-4192-b329-89a8ecdced38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:13.784031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1254/2536] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:13 2022] DELETE /identity/v3/projects/7474593eafa54b90bc3ee82803ffbee7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:13.788752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d6a7-4fd1-498d-a157-1a875466fa84 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:13.789037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d6a7-4fd1-498d-a157-1a875466fa84 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:13.789309 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d6a7-4fd1-498d-a157-1a875466fa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:13.812041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c891d6a7-4fd1-498d-a157-1a875466fa84 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:13.814155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c891d6a7-4fd1-498d-a157-1a875466fa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:13.885449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1283/2537] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:13.895389 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43272-a1e7-43db-a84b-8e42639b7fc0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:13.896008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43272-a1e7-43db-a84b-8e42639b7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:13.896008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43272-a1e7-43db-a84b-8e42639b7fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:13.932789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a6f43272-a1e7-43db-a84b-8e42639b7fc0 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:13.934652 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a6f43272-a1e7-43db-a84b-8e42639b7fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:13.947421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1255/2538] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:13.952587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891d6a7-4fd1-498d-a157-1a875466fa84 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:13.963972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891d6a7-4fd1-498d-a157-1a875466fa84 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:13.969081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5644b-b0a4-4995-ab8d-a3f8b2988ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:13.969787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5644b-b0a4-4995-ab8d-a3f8b2988ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:13.970163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5644b-b0a4-4995-ab8d-a3f8b2988ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:13.970510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5644b-b0a4-4995-ab8d-a3f8b2988ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:13.971250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5644b-b0a4-4995-ab8d-a3f8b2988ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:16:13.971628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5644b-b0a4-4995-ab8d-a3f8b2988ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:13.973292 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5644b-b0a4-4995-ab8d-a3f8b2988ad4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:13.993878 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1284/2539] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:16:13.998689 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f43272-a1e7-43db-a84b-8e42639b7fc0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:14.011279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f43272-a1e7-43db-a84b-8e42639b7fc0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:14.018586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248b9b5-1799-4952-b3bf-662dcf251156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:14.019654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248b9b5-1799-4952-b3bf-662dcf251156 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.019853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248b9b5-1799-4952-b3bf-662dcf251156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.020121 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248b9b5-1799-4952-b3bf-662dcf251156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.020872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248b9b5-1799-4952-b3bf-662dcf251156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:14.023159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248b9b5-1799-4952-b3bf-662dcf251156 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:14.061665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1256/2540] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:13 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:14.064604 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5644b-b0a4-4995-ab8d-a3f8b2988ad4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:14.075943 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5644b-b0a4-4995-ab8d-a3f8b2988ad4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:14.143755 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920b6c0-7132-4dae-ac0c-473436c653cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:14.144583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920b6c0-7132-4dae-ac0c-473436c653cb admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.144903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920b6c0-7132-4dae-ac0c-473436c653cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.145311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920b6c0-7132-4dae-ac0c-473436c653cb admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.145940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920b6c0-7132-4dae-ac0c-473436c653cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:14.148264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920b6c0-7132-4dae-ac0c-473436c653cb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:14.181874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1285/2541] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:14 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:14.186795 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248b9b5-1799-4952-b3bf-662dcf251156 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:14.199326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248b9b5-1799-4952-b3bf-662dcf251156 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:14.204664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced1d75-0857-475d-af79-6852e8811f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:14.205299 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced1d75-0857-475d-af79-6852e8811f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.205572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced1d75-0857-475d-af79-6852e8811f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.205884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced1d75-0857-475d-af79-6852e8811f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.206718 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced1d75-0857-475d-af79-6852e8811f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:14.208388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced1d75-0857-475d-af79-6852e8811f6e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:14.220865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1257/2542] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:14.225497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920b6c0-7132-4dae-ac0c-473436c653cb admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:14.237993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920b6c0-7132-4dae-ac0c-473436c653cb admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:14.244539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a7060-a59f-4f2f-8011-9490583a2bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:14.245259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7060-a59f-4f2f-8011-9490583a2bca admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.245635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7060-a59f-4f2f-8011-9490583a2bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.246007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7060-a59f-4f2f-8011-9490583a2bca admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.246809 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a7060-a59f-4f2f-8011-9490583a2bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:14.248510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a7060-a59f-4f2f-8011-9490583a2bca admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:14.260767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1286/2543] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:14.265188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced1d75-0857-475d-af79-6852e8811f6e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:14.275505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced1d75-0857-475d-af79-6852e8811f6e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:14.280984 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e2f16-2880-4277-be67-0012325959ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:14.281641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e2f16-2880-4277-be67-0012325959ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.281954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e2f16-2880-4277-be67-0012325959ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.282226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e2f16-2880-4277-be67-0012325959ce admin admin] PATH_INFO: `/v3/projects/20cca9c10f274a62b27076a4d738af45/users/8ddaa4db5763475fa41b3e4e7d84ae0f/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.297927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e2f16-2880-4277-be67-0012325959ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cca9c10f274a62b27076a4d738af45, user_id=8ddaa4db5763475fa41b3e4e7d84ae0f, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:14.302174 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e2f16-2880-4277-be67-0012325959ce admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:14.320716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1258/2544] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:14 2022] PUT /identity/v3/projects/20cca9c10f274a62b27076a4d738af45/users/8ddaa4db5763475fa41b3e4e7d84ae0f/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:14.331687 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442447a-8ffb-4cc6-be9a-5890d4a82d09 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.331968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442447a-8ffb-4cc6-be9a-5890d4a82d09 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.332238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442447a-8ffb-4cc6-be9a-5890d4a82d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.392925 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c442447a-8ffb-4cc6-be9a-5890d4a82d09 None None] MFA Rules not processed for user `8ddaa4db5763475fa41b3e4e7d84ae0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:14.394274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c442447a-8ffb-4cc6-be9a-5890d4a82d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:14.424255 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:14.463060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1287/2545] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:14.468593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e2f16-2880-4277-be67-0012325959ce admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:14.515538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:14.539186 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e2f16-2880-4277-be67-0012325959ce admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:14.545641 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21087b-a47f-4757-a714-818820ec5b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:14.546291 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21087b-a47f-4757-a714-818820ec5b45 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.546570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21087b-a47f-4757-a714-818820ec5b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.546842 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21087b-a47f-4757-a714-818820ec5b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.547447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21087b-a47f-4757-a714-818820ec5b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:14.549379 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21087b-a47f-4757-a714-818820ec5b45 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:14.582912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1259/2546] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:14 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:14.584163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442447a-8ffb-4cc6-be9a-5890d4a82d09 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:14.597107 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442447a-8ffb-4cc6-be9a-5890d4a82d09 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:14.679815 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18e8ed-5054-4703-9444-afd6f76d1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:14.680447 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e8ed-5054-4703-9444-afd6f76d1a98 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.680774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e8ed-5054-4703-9444-afd6f76d1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.681050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e8ed-5054-4703-9444-afd6f76d1a98 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.681705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18e8ed-5054-4703-9444-afd6f76d1a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:14.684207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18e8ed-5054-4703-9444-afd6f76d1a98 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:14.722808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1288/2547] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:14 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:14.726869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21087b-a47f-4757-a714-818820ec5b45 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:14.744146 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21087b-a47f-4757-a714-818820ec5b45 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:14.750084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286b956-f7ab-407d-a084-a8493af774ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:14.750766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286b956-f7ab-407d-a084-a8493af774ae admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.751107 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286b956-f7ab-407d-a084-a8493af774ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.751506 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286b956-f7ab-407d-a084-a8493af774ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.752272 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286b956-f7ab-407d-a084-a8493af774ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:14.754149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286b956-f7ab-407d-a084-a8493af774ae admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:14.769161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1260/2548] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:14.773508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18e8ed-5054-4703-9444-afd6f76d1a98 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:14.785088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18e8ed-5054-4703-9444-afd6f76d1a98 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:14.789954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a39c8-ec24-4ce0-a1a9-9b7eb45b8eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:14.790627 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a39c8-ec24-4ce0-a1a9-9b7eb45b8eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.790905 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a39c8-ec24-4ce0-a1a9-9b7eb45b8eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.791176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a39c8-ec24-4ce0-a1a9-9b7eb45b8eb5 admin admin] PATH_INFO: `/v3/projects/9f411c6ed91a4de98bd12be42db498e9/users/64d86241c52547458b9d1a4da7bc9d26/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.807956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a39c8-ec24-4ce0-a1a9-9b7eb45b8eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f411c6ed91a4de98bd12be42db498e9, user_id=64d86241c52547458b9d1a4da7bc9d26, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:14.810999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a39c8-ec24-4ce0-a1a9-9b7eb45b8eb5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:14.827699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1289/2549] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:14 2022] PUT /identity/v3/projects/9f411c6ed91a4de98bd12be42db498e9/users/64d86241c52547458b9d1a4da7bc9d26/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:14.831942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286b956-f7ab-407d-a084-a8493af774ae admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:14.843194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286b956-f7ab-407d-a084-a8493af774ae admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:14.921186 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf1847-82b1-4f49-8da7-d5d0d5bd7e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:14.921895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1847-82b1-4f49-8da7-d5d0d5bd7e27 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.922104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1847-82b1-4f49-8da7-d5d0d5bd7e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.922370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1847-82b1-4f49-8da7-d5d0d5bd7e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.923118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf1847-82b1-4f49-8da7-d5d0d5bd7e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:14.924701 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf1847-82b1-4f49-8da7-d5d0d5bd7e27 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:14.943197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1261/2550] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:14.944554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a39c8-ec24-4ce0-a1a9-9b7eb45b8eb5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:14.951654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d4c9-6d21-4b59-8b3d-727d65e404bd None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.953280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d4c9-6d21-4b59-8b3d-727d65e404bd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.954831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d4c9-6d21-4b59-8b3d-727d65e404bd None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.959335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a39c8-ec24-4ce0-a1a9-9b7eb45b8eb5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:14.960256 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1262/2551] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:16:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:16:14.966553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cd8d4-9206-4f12-9c61-e0cf403cae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:14.967508 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cd8d4-9206-4f12-9c61-e0cf403cae9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.968036 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cd8d4-9206-4f12-9c61-e0cf403cae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.968456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cd8d4-9206-4f12-9c61-e0cf403cae9a admin admin] PATH_INFO: `/v3/projects/9f411c6ed91a4de98bd12be42db498e9/users/64d86241c52547458b9d1a4da7bc9d26/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.971707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4035e-2896-4dd1-8c7f-fbbbdd182a63 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:14.972160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4035e-2896-4dd1-8c7f-fbbbdd182a63 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:14.972579 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4035e-2896-4dd1-8c7f-fbbbdd182a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:14.975387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cd8d4-9206-4f12-9c61-e0cf403cae9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f411c6ed91a4de98bd12be42db498e9, user_id=64d86241c52547458b9d1a4da7bc9d26, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:14.980232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cd8d4-9206-4f12-9c61-e0cf403cae9a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:14.996758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1290/2552] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:14 2022] PUT /identity/v3/projects/9f411c6ed91a4de98bd12be42db498e9/users/64d86241c52547458b9d1a4da7bc9d26/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:15.009019 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165903-71c0-4e8c-9c2d-992589667309 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:15.009302 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165903-71c0-4e8c-9c2d-992589667309 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:15.009575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165903-71c0-4e8c-9c2d-992589667309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:15.013080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6ec4035e-2896-4dd1-8c7f-fbbbdd182a63 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:15.014498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6ec4035e-2896-4dd1-8c7f-fbbbdd182a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:15.047465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-aa165903-71c0-4e8c-9c2d-992589667309 None None] MFA Rules not processed for user `64d86241c52547458b9d1a4da7bc9d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:15.050801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aa165903-71c0-4e8c-9c2d-992589667309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:15.165304 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1291/2553] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:15.178206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1263/2554] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:16:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:15.186679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa165903-71c0-4e8c-9c2d-992589667309 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:15.188124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aa165903-71c0-4e8c-9c2d-992589667309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:15.197982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:15.234603 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4035e-2896-4dd1-8c7f-fbbbdd182a63 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:15.236227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6ec4035e-2896-4dd1-8c7f-fbbbdd182a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:15.256001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa165903-71c0-4e8c-9c2d-992589667309 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:15.260921 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec93113-ca4e-4f4a-a1a2-8c9e69fd22e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22e60fc95af4a0a94b15f9ed9e3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:15.262159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93113-ca4e-4f4a-a1a2-8c9e69fd22e3 service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:15.262300 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93113-ca4e-4f4a-a1a2-8c9e69fd22e3 service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:15.262482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93113-ca4e-4f4a-a1a2-8c9e69fd22e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:15.290853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec93113-ca4e-4f4a-a1a2-8c9e69fd22e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:15.292296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec93113-ca4e-4f4a-a1a2-8c9e69fd22e3 service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:15.301900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:15.304990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1292/2555] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:15.319720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4035e-2896-4dd1-8c7f-fbbbdd182a63 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:15.324613 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f18f9-212a-4cb2-8d98-243688daee23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:15.325617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f18f9-212a-4cb2-8d98-243688daee23 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:15.326087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f18f9-212a-4cb2-8d98-243688daee23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:15.326365 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f18f9-212a-4cb2-8d98-243688daee23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:15.337784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f18f9-212a-4cb2-8d98-243688daee23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:15.343144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f18f9-212a-4cb2-8d98-243688daee23 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:15.356540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1264/2556] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:15.408289 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e893a7-bd0f-4bac-850f-6e68f815887f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:15.408567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e893a7-bd0f-4bac-850f-6e68f815887f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:15.408830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e893a7-bd0f-4bac-850f-6e68f815887f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:15.410391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1293/2557] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:16:15.415496 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1f67-d1a3-4031-83c5-897c8bd18a55 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:15.415820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1f67-d1a3-4031-83c5-897c8bd18a55 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:15.416142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1f67-d1a3-4031-83c5-897c8bd18a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:15.438804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-59bb1f67-d1a3-4031-83c5-897c8bd18a55 None None] MFA Rules not processed for user `d512b60a42ed456a82dff11d17b77c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:15.440253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-59bb1f67-d1a3-4031-83c5-897c8bd18a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:15.498696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e893a7-bd0f-4bac-850f-6e68f815887f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:15.506548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1265/2558] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:15.514796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e893a7-bd0f-4bac-850f-6e68f815887f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:15.519024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c0a0d-1dd0-4cf0-bd10-2c03f6ed7e14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:15.519777 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c0a0d-1dd0-4cf0-bd10-2c03f6ed7e14 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:15.521062 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb1f67-d1a3-4031-83c5-897c8bd18a55 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:15.523244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-59bb1f67-d1a3-4031-83c5-897c8bd18a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:15.526259 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c0a0d-1dd0-4cf0-bd10-2c03f6ed7e14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:15.526539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c0a0d-1dd0-4cf0-bd10-2c03f6ed7e14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:15.535189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb1f67-d1a3-4031-83c5-897c8bd18a55 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:15.539194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307b8fb-a7ce-46c1-80fc-bdf01873b63c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:15.539816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307b8fb-a7ce-46c1-80fc-bdf01873b63c service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:15.540290 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307b8fb-a7ce-46c1-80fc-bdf01873b63c service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:15.540553 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307b8fb-a7ce-46c1-80fc-bdf01873b63c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:15.548971 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307b8fb-a7ce-46c1-80fc-bdf01873b63c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:15.550617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307b8fb-a7ce-46c1-80fc-bdf01873b63c service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:15.562075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1266/2559] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:15.610760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c0a0d-1dd0-4cf0-bd10-2c03f6ed7e14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:15.612917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c0a0d-1dd0-4cf0-bd10-2c03f6ed7e14 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:15.623786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1294/2560] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:15.662216 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d96f8-b904-4255-a88a-a4ecf87aee72 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:15.662528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d96f8-b904-4255-a88a-a4ecf87aee72 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:15.663251 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d96f8-b904-4255-a88a-a4ecf87aee72 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:15.664865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1267/2561] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 22 22:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 22:16:15.673673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354575-aad8-4663-8d97-8bb5a7c28121 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:15.674218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354575-aad8-4663-8d97-8bb5a7c28121 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:15.674551 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354575-aad8-4663-8d97-8bb5a7c28121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:15.704312 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-33354575-aad8-4663-8d97-8bb5a7c28121 None None] MFA Rules not processed for user `a044973e9e84495dbf8d14e19fc84716`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:15.706270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-33354575-aad8-4663-8d97-8bb5a7c28121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:15.728168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1295/2562] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 22 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:15.743204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d96f8-b904-4255-a88a-a4ecf87aee72 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:15.745401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e20d96f8-b904-4255-a88a-a4ecf87aee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:15.770175 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d96f8-b904-4255-a88a-a4ecf87aee72 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:15.775263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59b3f6-86e1-437f-867f-1a49a0e3b3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:15.775953 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59b3f6-86e1-437f-867f-1a49a0e3b3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:15.776260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59b3f6-86e1-437f-867f-1a49a0e3b3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:15.776783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59b3f6-86e1-437f-867f-1a49a0e3b3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:15.796626 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59b3f6-86e1-437f-867f-1a49a0e3b3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:15.798448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59b3f6-86e1-437f-867f-1a49a0e3b3c1 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:15.812395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1268/2563] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:17.389751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33354575-aad8-4663-8d97-8bb5a7c28121 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:17.390909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-33354575-aad8-4663-8d97-8bb5a7c28121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:17.461136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33354575-aad8-4663-8d97-8bb5a7c28121 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:17.467875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d38b72-dcc6-4720-a3c6-c162a47b9950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:17.469278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d38b72-dcc6-4720-a3c6-c162a47b9950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:17.469543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d38b72-dcc6-4720-a3c6-c162a47b9950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:17.469818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d38b72-dcc6-4720-a3c6-c162a47b9950 admin admin] PATH_INFO: `/v3/users/5c15f7689be245368a43983c8a3b6b34` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:17.471101 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d38b72-dcc6-4720-a3c6-c162a47b9950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c15f7689be245368a43983c8a3b6b34)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:17.473043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d38b72-dcc6-4720-a3c6-c162a47b9950 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:17.534493 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:17.537599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-59d38b72-dcc6-4720-a3c6-c162a47b9950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c15f7689be245368a43983c8a3b6b34'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:17.550136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-59d38b72-dcc6-4720-a3c6-c162a47b9950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c15f7689be245368a43983c8a3b6b34'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:17.550769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-59d38b72-dcc6-4720-a3c6-c162a47b9950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c15f7689be245368a43983c8a3b6b34'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:17.560673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-59d38b72-dcc6-4720-a3c6-c162a47b9950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c15f7689be245368a43983c8a3b6b34'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:17.574350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-59d38b72-dcc6-4720-a3c6-c162a47b9950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c15f7689be245368a43983c8a3b6b34'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:17.587264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1296/2564] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:17 2022] DELETE /identity/v3/users/5c15f7689be245368a43983c8a3b6b34 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:17.596657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb452-85b8-4e3e-9569-59609befd74e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:17.597229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb452-85b8-4e3e-9569-59609befd74e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:17.597229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb452-85b8-4e3e-9569-59609befd74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:17.617181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c68cb452-85b8-4e3e-9569-59609befd74e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:17.618457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c68cb452-85b8-4e3e-9569-59609befd74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:17.638192 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f9639-178a-4af0-b1d9-9c05b01bb382 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:17.638474 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f9639-178a-4af0-b1d9-9c05b01bb382 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:17.638747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f9639-178a-4af0-b1d9-9c05b01bb382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:17.660125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0e6f9639-178a-4af0-b1d9-9c05b01bb382 None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:17.661360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0e6f9639-178a-4af0-b1d9-9c05b01bb382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:17.684635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1269/2565] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:17.695087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cb452-85b8-4e3e-9569-59609befd74e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:17.696895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c68cb452-85b8-4e3e-9569-59609befd74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:17.732983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1297/2566] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:17.745891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f9639-178a-4af0-b1d9-9c05b01bb382 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:17.747518 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0e6f9639-178a-4af0-b1d9-9c05b01bb382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:17.765741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cb452-85b8-4e3e-9569-59609befd74e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:17.769659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2e834-449d-4d0b-97f5-1109ce5e6428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:17.770312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2e834-449d-4d0b-97f5-1109ce5e6428 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:17.770637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2e834-449d-4d0b-97f5-1109ce5e6428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:17.770861 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2e834-449d-4d0b-97f5-1109ce5e6428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:17.780972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2e834-449d-4d0b-97f5-1109ce5e6428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:17.782502 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2e834-449d-4d0b-97f5-1109ce5e6428 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:17.795205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1270/2567] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:17.822062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f9639-178a-4af0-b1d9-9c05b01bb382 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:17.830108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe079b15-7423-4751-aa75-2d1db60a2663 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:17.830750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079b15-7423-4751-aa75-2d1db60a2663 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:17.831314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079b15-7423-4751-aa75-2d1db60a2663 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:17.831314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079b15-7423-4751-aa75-2d1db60a2663 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:17.840517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe079b15-7423-4751-aa75-2d1db60a2663 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:17.842348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe079b15-7423-4751-aa75-2d1db60a2663 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:17.850873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1298/2568] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:16:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 22:16:18.177959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2e834-449d-4d0b-97f5-1109ce5e6428 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:18.179586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-04f2e834-449d-4d0b-97f5-1109ce5e6428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:18.195647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2e834-449d-4d0b-97f5-1109ce5e6428 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:18.203154 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:18.204132 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:18.204607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:18.205077 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] PATH_INFO: `/v3/projects/1cc9149901b243fbb3f8b241f33ccad1` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:18.206571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc9149901b243fbb3f8b241f33ccad1)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:18.210995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:18.214130 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:18.301913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc9149901b243fbb3f8b241f33ccad1', 'request_id': 'req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:18.316360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc9149901b243fbb3f8b241f33ccad1', 'request_id': 'req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:18.331474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc9149901b243fbb3f8b241f33ccad1', 'request_id': 'req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:18.364049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] The token cache is being invalidate because project 1cc9149901b243fbb3f8b241f33ccad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:18.364396 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:18.365101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:18.371106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1271/2569] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:18 2022] DELETE /identity/v3/projects/1cc9149901b243fbb3f8b241f33ccad1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:18.375051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe079b15-7423-4751-aa75-2d1db60a2663 service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:18.392178 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe079b15-7423-4751-aa75-2d1db60a2663 service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:18.490546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:18.502137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8058649-a0cd-4e6a-98ef-3a3213bc85ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:18.503853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8058649-a0cd-4e6a-98ef-3a3213bc85ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:18.504489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8058649-a0cd-4e6a-98ef-3a3213bc85ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:18.504984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8058649-a0cd-4e6a-98ef-3a3213bc85ff admin admin] PATH_INFO: `/v3/users/dedef9d24c57405fb0d4f6e75f5b9dc0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:18.506875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8058649-a0cd-4e6a-98ef-3a3213bc85ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=dedef9d24c57405fb0d4f6e75f5b9dc0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:18.511002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8058649-a0cd-4e6a-98ef-3a3213bc85ff admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:18.653880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e8058649-a0cd-4e6a-98ef-3a3213bc85ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dedef9d24c57405fb0d4f6e75f5b9dc0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:18.673360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e8058649-a0cd-4e6a-98ef-3a3213bc85ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dedef9d24c57405fb0d4f6e75f5b9dc0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:18.674179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e8058649-a0cd-4e6a-98ef-3a3213bc85ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dedef9d24c57405fb0d4f6e75f5b9dc0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:18.700813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e8058649-a0cd-4e6a-98ef-3a3213bc85ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dedef9d24c57405fb0d4f6e75f5b9dc0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:18.735490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e8058649-a0cd-4e6a-98ef-3a3213bc85ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dedef9d24c57405fb0d4f6e75f5b9dc0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:18.748657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1299/2570] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:18 2022] DELETE /identity/v3/users/dedef9d24c57405fb0d4f6e75f5b9dc0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:19.333664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:19.338078 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:19.371228 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffe99c-16a7-4f5d-8952-b396e2f668a5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:19.519033 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:19.519979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:19.520520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:19.520878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] PATH_INFO: `/v3/projects/c2cdadf7c4f448729b21fc06b0b48746` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:19.522586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2cdadf7c4f448729b21fc06b0b48746)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:19.524950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:19.625211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2cdadf7c4f448729b21fc06b0b48746', 'request_id': 'req-48465ad1-6c12-4397-8c6c-56c9fa5a3616'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:19.632860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2cdadf7c4f448729b21fc06b0b48746', 'request_id': 'req-48465ad1-6c12-4397-8c6c-56c9fa5a3616'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:19.644545 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2cdadf7c4f448729b21fc06b0b48746', 'request_id': 'req-48465ad1-6c12-4397-8c6c-56c9fa5a3616'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:19.664833 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] The token cache is being invalidate because project c2cdadf7c4f448729b21fc06b0b48746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:19.668081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:19.668081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-48465ad1-6c12-4397-8c6c-56c9fa5a3616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:19.673448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1272/2571] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:19 2022] DELETE /identity/v3/projects/c2cdadf7c4f448729b21fc06b0b48746 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:19.675676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ab38d-562e-44ab-be2d-95b08ffa49fe None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:19.676213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ab38d-562e-44ab-be2d-95b08ffa49fe None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:19.676298 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ab38d-562e-44ab-be2d-95b08ffa49fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:19.721044 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-671ab38d-562e-44ab-be2d-95b08ffa49fe None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:19.724326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-671ab38d-562e-44ab-be2d-95b08ffa49fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:19.906045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1300/2572] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:19.909942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c403f-6289-4bdb-9b97-953e6a9adee8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:19.909942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c403f-6289-4bdb-9b97-953e6a9adee8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:19.909942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c403f-6289-4bdb-9b97-953e6a9adee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:19.944538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6d1c403f-6289-4bdb-9b97-953e6a9adee8 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:19.944795 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6d1c403f-6289-4bdb-9b97-953e6a9adee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:19.954054 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1273/2573] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:19.958522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ab38d-562e-44ab-be2d-95b08ffa49fe None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:19.978894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ab38d-562e-44ab-be2d-95b08ffa49fe None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:19.985751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c319d-edad-42da-9d7e-5f25014918e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:19.986657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c319d-edad-42da-9d7e-5f25014918e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:19.987021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c319d-edad-42da-9d7e-5f25014918e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:19.987463 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c319d-edad-42da-9d7e-5f25014918e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:19.988537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c319d-edad-42da-9d7e-5f25014918e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:16:19.988537 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c319d-edad-42da-9d7e-5f25014918e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:19.990530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c319d-edad-42da-9d7e-5f25014918e5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:20.014712 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1301/2574] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:16:20.019770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c403f-6289-4bdb-9b97-953e6a9adee8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:20.033341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c403f-6289-4bdb-9b97-953e6a9adee8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:20.039631 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b618c-8d21-4d9a-afdc-4c203a0f816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:20.040418 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b618c-8d21-4d9a-afdc-4c203a0f816d admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:20.040705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b618c-8d21-4d9a-afdc-4c203a0f816d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:20.040987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b618c-8d21-4d9a-afdc-4c203a0f816d admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:20.041601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b618c-8d21-4d9a-afdc-4c203a0f816d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:20.044384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b618c-8d21-4d9a-afdc-4c203a0f816d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:20.069754 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:20.112779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1274/2575] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:20 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:20.117153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c319d-edad-42da-9d7e-5f25014918e5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:20.131343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c319d-edad-42da-9d7e-5f25014918e5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:20.261349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c112-17ed-455e-8b43-f4935317763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:20.262436 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c112-17ed-455e-8b43-f4935317763c admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:20.262891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c112-17ed-455e-8b43-f4935317763c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:20.263161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c112-17ed-455e-8b43-f4935317763c admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:20.263833 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0c112-17ed-455e-8b43-f4935317763c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:20.266181 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0c112-17ed-455e-8b43-f4935317763c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:20.280915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:20.300781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1302/2576] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:20 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:20.302136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b618c-8d21-4d9a-afdc-4c203a0f816d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:20.314880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b618c-8d21-4d9a-afdc-4c203a0f816d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:20.320354 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12db543-3947-42fa-9adc-610ff86dd2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:20.322836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12db543-3947-42fa-9adc-610ff86dd2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:20.323006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12db543-3947-42fa-9adc-610ff86dd2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:20.323192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12db543-3947-42fa-9adc-610ff86dd2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:20.323899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12db543-3947-42fa-9adc-610ff86dd2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:20.326258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12db543-3947-42fa-9adc-610ff86dd2d1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:20.337296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1275/2577] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:20.343156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c112-17ed-455e-8b43-f4935317763c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:20.361799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c112-17ed-455e-8b43-f4935317763c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:20.385577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2de63d-e4fa-43c3-926d-346f4bc56c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:20.386297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de63d-e4fa-43c3-926d-346f4bc56c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:20.386579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de63d-e4fa-43c3-926d-346f4bc56c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:20.386859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de63d-e4fa-43c3-926d-346f4bc56c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:20.387590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2de63d-e4fa-43c3-926d-346f4bc56c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:20.389393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2de63d-e4fa-43c3-926d-346f4bc56c9f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:20.403372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1303/2578] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:20.408250 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12db543-3947-42fa-9adc-610ff86dd2d1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:20.430395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12db543-3947-42fa-9adc-610ff86dd2d1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:20.440936 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a244bf-3e07-4722-9818-1da13781e52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:20.442395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a244bf-3e07-4722-9818-1da13781e52c admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:20.443026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a244bf-3e07-4722-9818-1da13781e52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:20.443589 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a244bf-3e07-4722-9818-1da13781e52c admin admin] PATH_INFO: `/v3/projects/075ba19f7d5b475ba2ec6b51da305d6b/users/9347d8340b3f4d5dad006fa0be9127b3/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:20.464208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a244bf-3e07-4722-9818-1da13781e52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=075ba19f7d5b475ba2ec6b51da305d6b, user_id=9347d8340b3f4d5dad006fa0be9127b3, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:20.467811 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a244bf-3e07-4722-9818-1da13781e52c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:20.483424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1276/2579] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:20 2022] PUT /identity/v3/projects/075ba19f7d5b475ba2ec6b51da305d6b/users/9347d8340b3f4d5dad006fa0be9127b3/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:20.494703 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226afd4-1219-4deb-9e97-3981ce69cfc8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:20.495050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226afd4-1219-4deb-9e97-3981ce69cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:20.495452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226afd4-1219-4deb-9e97-3981ce69cfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:20.543936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e226afd4-1219-4deb-9e97-3981ce69cfc8 None None] MFA Rules not processed for user `9347d8340b3f4d5dad006fa0be9127b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:20.545220 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e226afd4-1219-4deb-9e97-3981ce69cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:20.617245 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1304/2580] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:20.621860 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a244bf-3e07-4722-9818-1da13781e52c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:20.723592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a244bf-3e07-4722-9818-1da13781e52c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:20.729153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a6ea0-697f-4803-b0d5-b4fd04dbb9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:20.729776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a6ea0-697f-4803-b0d5-b4fd04dbb9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:20.730077 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a6ea0-697f-4803-b0d5-b4fd04dbb9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:20.730342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a6ea0-697f-4803-b0d5-b4fd04dbb9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:20.731010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a6ea0-697f-4803-b0d5-b4fd04dbb9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:20.733117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a6ea0-697f-4803-b0d5-b4fd04dbb9e4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:20.770071 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1277/2581] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:20 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:20.774397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226afd4-1219-4deb-9e97-3981ce69cfc8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:20.786343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226afd4-1219-4deb-9e97-3981ce69cfc8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:20.876582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87ecc2-069d-4a4e-9b8f-7adde6a9b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:20.877922 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ecc2-069d-4a4e-9b8f-7adde6a9b6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:20.881956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ecc2-069d-4a4e-9b8f-7adde6a9b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:20.882496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ecc2-069d-4a4e-9b8f-7adde6a9b6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:20.883437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87ecc2-069d-4a4e-9b8f-7adde6a9b6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:20.885816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87ecc2-069d-4a4e-9b8f-7adde6a9b6b4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:20.911087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1305/2582] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:20 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:20.915431 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a6ea0-697f-4803-b0d5-b4fd04dbb9e4 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:20.927001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a6ea0-697f-4803-b0d5-b4fd04dbb9e4 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:20.931671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3091f9-2ff7-48ec-8534-85b94f2f7469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:20.932284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3091f9-2ff7-48ec-8534-85b94f2f7469 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:20.932558 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3091f9-2ff7-48ec-8534-85b94f2f7469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:20.932823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3091f9-2ff7-48ec-8534-85b94f2f7469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:20.933525 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3091f9-2ff7-48ec-8534-85b94f2f7469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:20.935224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3091f9-2ff7-48ec-8534-85b94f2f7469 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:20.954633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1278/2583] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:20.958993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87ecc2-069d-4a4e-9b8f-7adde6a9b6b4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:20.969494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87ecc2-069d-4a4e-9b8f-7adde6a9b6b4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:20.974281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50286862-3497-409b-8807-5e849eb535b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:20.974952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50286862-3497-409b-8807-5e849eb535b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:20.975237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50286862-3497-409b-8807-5e849eb535b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:20.975492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50286862-3497-409b-8807-5e849eb535b1 admin admin] PATH_INFO: `/v3/projects/8e1015f8ca2d40318fa26b5823a361a6/users/fb868ce47d054dde827d235b1be9edc9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:20.992272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50286862-3497-409b-8807-5e849eb535b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1015f8ca2d40318fa26b5823a361a6, user_id=fb868ce47d054dde827d235b1be9edc9, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:20.994993 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50286862-3497-409b-8807-5e849eb535b1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:21.020819 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1306/2584] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:20 2022] PUT /identity/v3/projects/8e1015f8ca2d40318fa26b5823a361a6/users/fb868ce47d054dde827d235b1be9edc9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:21.024927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3091f9-2ff7-48ec-8534-85b94f2f7469 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:21.038314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3091f9-2ff7-48ec-8534-85b94f2f7469 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:21.110434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4572e-c7f2-4894-bb1c-bb9190daef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:21.111256 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4572e-c7f2-4894-bb1c-bb9190daef26 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:21.111531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4572e-c7f2-4894-bb1c-bb9190daef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:21.111800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4572e-c7f2-4894-bb1c-bb9190daef26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:21.112737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4572e-c7f2-4894-bb1c-bb9190daef26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:21.114179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4572e-c7f2-4894-bb1c-bb9190daef26 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:21.125718 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1279/2585] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:21.130204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50286862-3497-409b-8807-5e849eb535b1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:21.141359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50286862-3497-409b-8807-5e849eb535b1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:21.149564 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a161369-a6c9-41fc-9976-6be2968ffaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:21.150488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161369-a6c9-41fc-9976-6be2968ffaa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:21.151326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161369-a6c9-41fc-9976-6be2968ffaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:21.151701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161369-a6c9-41fc-9976-6be2968ffaa1 admin admin] PATH_INFO: `/v3/projects/8e1015f8ca2d40318fa26b5823a361a6/users/fb868ce47d054dde827d235b1be9edc9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:21.154175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a161369-a6c9-41fc-9976-6be2968ffaa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1015f8ca2d40318fa26b5823a361a6, user_id=fb868ce47d054dde827d235b1be9edc9, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:21.157745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a161369-a6c9-41fc-9976-6be2968ffaa1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:21.181610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906f34-985e-44ed-9fdb-bec823953d88 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:21.181892 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906f34-985e-44ed-9fdb-bec823953d88 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:21.182168 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906f34-985e-44ed-9fdb-bec823953d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:21.185007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1307/2586] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:21 2022] PUT /identity/v3/projects/8e1015f8ca2d40318fa26b5823a361a6/users/fb868ce47d054dde827d235b1be9edc9/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:21.240480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f3906f34-985e-44ed-9fdb-bec823953d88 None None] MFA Rules not processed for user `fb868ce47d054dde827d235b1be9edc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:21.244633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f3906f34-985e-44ed-9fdb-bec823953d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:21.287576 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:21.370915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1280/2587] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:21.392780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a161369-a6c9-41fc-9976-6be2968ffaa1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:21.394669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9a161369-a6c9-41fc-9976-6be2968ffaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:21.445469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:21.544670 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a161369-a6c9-41fc-9976-6be2968ffaa1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:21.551487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e579e-0f7a-4a9c-ad2b-c8dd2933e092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:21.561867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e579e-0f7a-4a9c-ad2b-c8dd2933e092 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:21.562320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e579e-0f7a-4a9c-ad2b-c8dd2933e092 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:21.562608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e579e-0f7a-4a9c-ad2b-c8dd2933e092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:21.583617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e579e-0f7a-4a9c-ad2b-c8dd2933e092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:21.585146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e579e-0f7a-4a9c-ad2b-c8dd2933e092 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:21.601491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1308/2588] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:22.150128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3906f34-985e-44ed-9fdb-bec823953d88 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:22.223970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3906f34-985e-44ed-9fdb-bec823953d88 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:22.228620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:22.229256 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:22.229531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:22.229801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] PATH_INFO: `/v3/users/9347d8340b3f4d5dad006fa0be9127b3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:22.230956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9347d8340b3f4d5dad006fa0be9127b3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:22.233053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:22.299659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9347d8340b3f4d5dad006fa0be9127b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:22.300403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9347d8340b3f4d5dad006fa0be9127b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:22.311606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9347d8340b3f4d5dad006fa0be9127b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:22.319671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9347d8340b3f4d5dad006fa0be9127b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:22.320382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9347d8340b3f4d5dad006fa0be9127b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:22.355001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1281/2589] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:22 2022] DELETE /identity/v3/users/9347d8340b3f4d5dad006fa0be9127b3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:22.360104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821637d-0e2d-4aec-b248-e84b125e5a83 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:22.360997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821637d-0e2d-4aec-b248-e84b125e5a83 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:22.361430 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821637d-0e2d-4aec-b248-e84b125e5a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:22.386474 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1821637d-0e2d-4aec-b248-e84b125e5a83 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:22.395038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1821637d-0e2d-4aec-b248-e84b125e5a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:22.476354 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1309/2590] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:22.488173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:22.494039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:22.534796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:22.565192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ad955-81a2-41f3-93a6-2040287f4666 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:22.566774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e4f92-2bfa-4ff3-bc4d-941592c46ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:22.570639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e4f92-2bfa-4ff3-bc4d-941592c46ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:22.571067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e4f92-2bfa-4ff3-bc4d-941592c46ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:22.571423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e4f92-2bfa-4ff3-bc4d-941592c46ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:22.594781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e4f92-2bfa-4ff3-bc4d-941592c46ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:22.596572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e4f92-2bfa-4ff3-bc4d-941592c46ca7 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:22.634697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1282/2591] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:22.850218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821637d-0e2d-4aec-b248-e84b125e5a83 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:22.850218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1821637d-0e2d-4aec-b248-e84b125e5a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:22.866377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821637d-0e2d-4aec-b248-e84b125e5a83 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:22.884752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:22.885418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:22.885693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:22.886370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] PATH_INFO: `/v3/users/8ddaa4db5763475fa41b3e4e7d84ae0f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:22.887181 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddaa4db5763475fa41b3e4e7d84ae0f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:22.889498 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:23.024403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddaa4db5763475fa41b3e4e7d84ae0f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.050384 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddaa4db5763475fa41b3e4e7d84ae0f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.051492 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddaa4db5763475fa41b3e4e7d84ae0f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.064351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddaa4db5763475fa41b3e4e7d84ae0f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.116002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddaa4db5763475fa41b3e4e7d84ae0f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.129810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1310/2592] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:22 2022] DELETE /identity/v3/users/8ddaa4db5763475fa41b3e4e7d84ae0f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:23.135119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6412-f177-482a-bda0-ffeb0dddc5cb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:23.135380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6412-f177-482a-bda0-ffeb0dddc5cb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:23.135725 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6412-f177-482a-bda0-ffeb0dddc5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:23.175097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fe6b6412-f177-482a-bda0-ffeb0dddc5cb None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:23.182554 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fe6b6412-f177-482a-bda0-ffeb0dddc5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:23.214841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:23.216446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:23.274235 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1283/2593] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:23.275794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b6412-f177-482a-bda0-ffeb0dddc5cb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:23.277711 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fe6b6412-f177-482a-bda0-ffeb0dddc5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:23.294830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:23.332950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017aac9-bf2a-4e46-8316-326f92856038 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:23.337870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:23.338653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:23.338935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:23.339210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] PATH_INFO: `/v3/projects/075ba19f7d5b475ba2ec6b51da305d6b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:23.340917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=075ba19f7d5b475ba2ec6b51da305d6b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:23.345024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:23.349041 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b6412-f177-482a-bda0-ffeb0dddc5cb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:23.353574 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5087e-4b77-4ba9-bf7b-7ec327230974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:23.357296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5087e-4b77-4ba9-bf7b-7ec327230974 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:23.357296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5087e-4b77-4ba9-bf7b-7ec327230974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:23.357296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5087e-4b77-4ba9-bf7b-7ec327230974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:23.369147 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5087e-4b77-4ba9-bf7b-7ec327230974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:23.370952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5087e-4b77-4ba9-bf7b-7ec327230974 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:23.382737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1284/2594] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:23.438461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075ba19f7d5b475ba2ec6b51da305d6b', 'request_id': 'req-b28773d7-4b70-484f-bad6-31478e5368f3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.452270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075ba19f7d5b475ba2ec6b51da305d6b', 'request_id': 'req-b28773d7-4b70-484f-bad6-31478e5368f3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.459477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075ba19f7d5b475ba2ec6b51da305d6b', 'request_id': 'req-b28773d7-4b70-484f-bad6-31478e5368f3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.477738 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] The token cache is being invalidate because project 075ba19f7d5b475ba2ec6b51da305d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:23.482136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.483065 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.486053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1311/2595] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:23 2022] DELETE /identity/v3/projects/075ba19f7d5b475ba2ec6b51da305d6b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:23.491018 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5087e-4b77-4ba9-bf7b-7ec327230974 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:23.511316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5087e-4b77-4ba9-bf7b-7ec327230974 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:23.651727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:23.652421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:23.652699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:23.652967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] PATH_INFO: `/v3/users/fb868ce47d054dde827d235b1be9edc9` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:23.654602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb868ce47d054dde827d235b1be9edc9)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:23.657302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:23.701395 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:23.732000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:23.735475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:23.756879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28773d7-4b70-484f-bad6-31478e5368f3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:23.759095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb868ce47d054dde827d235b1be9edc9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.763989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb868ce47d054dde827d235b1be9edc9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.775674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:23.777551 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:23.777781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb868ce47d054dde827d235b1be9edc9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.778348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:23.778869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] PATH_INFO: `/v3/projects/20cca9c10f274a62b27076a4d738af45` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:23.786776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20cca9c10f274a62b27076a4d738af45)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:23.790828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:23.794789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb868ce47d054dde827d235b1be9edc9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.795788 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb868ce47d054dde827d235b1be9edc9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.818312 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1285/2596] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:23 2022] DELETE /identity/v3/users/fb868ce47d054dde827d235b1be9edc9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:23.907791 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20cca9c10f274a62b27076a4d738af45', 'request_id': 'req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.929817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20cca9c10f274a62b27076a4d738af45', 'request_id': 'req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.963265 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20cca9c10f274a62b27076a4d738af45', 'request_id': 'req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.991617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] The token cache is being invalidate because project 20cca9c10f274a62b27076a4d738af45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:23.991911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.992606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:23.994605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1312/2597] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:23 2022] DELETE /identity/v3/projects/20cca9c10f274a62b27076a4d738af45 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:23.999285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:24.001188 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:24.157218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da5a86-e7e9-4f02-a5f8-8a5082f08541 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:24.272408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:24.273137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:24.273460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:24.273730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] PATH_INFO: `/v3/users/64d86241c52547458b9d1a4da7bc9d26` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:24.275355 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d86241c52547458b9d1a4da7bc9d26)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:24.277547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:24.372905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d86241c52547458b9d1a4da7bc9d26'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:24.374781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d86241c52547458b9d1a4da7bc9d26'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:24.377601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:24.394820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d86241c52547458b9d1a4da7bc9d26'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:24.403428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d86241c52547458b9d1a4da7bc9d26'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:24.404462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d86241c52547458b9d1a4da7bc9d26'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:24.430713 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1286/2598] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:23 2022] DELETE /identity/v3/users/64d86241c52547458b9d1a4da7bc9d26 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:25.043770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:25.045421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:25.070963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388b5e4-4ffe-4ea6-b92c-8ea759917db1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:25.208629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:25.240882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:25.241696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.246706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.246706 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] PATH_INFO: `/v3/projects/8e1015f8ca2d40318fa26b5823a361a6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.248321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1015f8ca2d40318fa26b5823a361a6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:25.250617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:25.291992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:25.294164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:25.325767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b984f-262d-495c-88d7-5c1b192ea7e8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:25.369141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1015f8ca2d40318fa26b5823a361a6', 'request_id': 'req-e85aa2a8-4ef1-4742-ba13-f110d632bff6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:25.385346 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1015f8ca2d40318fa26b5823a361a6', 'request_id': 'req-e85aa2a8-4ef1-4742-ba13-f110d632bff6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:25.394159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1015f8ca2d40318fa26b5823a361a6', 'request_id': 'req-e85aa2a8-4ef1-4742-ba13-f110d632bff6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:25.409328 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] The token cache is being invalidate because project 8e1015f8ca2d40318fa26b5823a361a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:25.409659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:25.410378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e85aa2a8-4ef1-4742-ba13-f110d632bff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:25.416597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1313/2599] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:25 2022] DELETE /identity/v3/projects/8e1015f8ca2d40318fa26b5823a361a6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:25.418532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b23bf-8eeb-4c3c-aa82-56ad2737b683 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.418822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b23bf-8eeb-4c3c-aa82-56ad2737b683 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.419369 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b23bf-8eeb-4c3c-aa82-56ad2737b683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.459137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7c7b23bf-8eeb-4c3c-aa82-56ad2737b683 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:25.460408 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7c7b23bf-8eeb-4c3c-aa82-56ad2737b683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:25.461730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:25.462487 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.462736 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.463028 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] PATH_INFO: `/v3/projects/9f411c6ed91a4de98bd12be42db498e9` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.465630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f411c6ed91a4de98bd12be42db498e9)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:25.467653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:25.475449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1314/2600] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:25.486772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfddd2f-9c81-456b-b4c1-75fb12ab0191 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.489818 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfddd2f-9c81-456b-b4c1-75fb12ab0191 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.490894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfddd2f-9c81-456b-b4c1-75fb12ab0191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.516778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4dfddd2f-9c81-456b-b4c1-75fb12ab0191 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:25.518403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4dfddd2f-9c81-456b-b4c1-75fb12ab0191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:25.527307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1315/2601] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:25.547215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfddd2f-9c81-456b-b4c1-75fb12ab0191 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:25.556541 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f411c6ed91a4de98bd12be42db498e9', 'request_id': 'req-9382f16b-8ab3-4156-b1bf-30c5aeb68299'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:25.560171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfddd2f-9c81-456b-b4c1-75fb12ab0191 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:25.564492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f411c6ed91a4de98bd12be42db498e9', 'request_id': 'req-9382f16b-8ab3-4156-b1bf-30c5aeb68299'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:25.579050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f411c6ed91a4de98bd12be42db498e9', 'request_id': 'req-9382f16b-8ab3-4156-b1bf-30c5aeb68299'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:25.601606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] The token cache is being invalidate because project 9f411c6ed91a4de98bd12be42db498e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:25.601995 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:25.604139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9382f16b-8ab3-4156-b1bf-30c5aeb68299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:25.609294 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1287/2602] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:25 2022] DELETE /identity/v3/projects/9f411c6ed91a4de98bd12be42db498e9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:25.614391 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90202d3-f40a-403e-986c-3c69374c9722 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.614744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90202d3-f40a-403e-986c-3c69374c9722 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.615020 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90202d3-f40a-403e-986c-3c69374c9722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.660572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e90202d3-f40a-403e-986c-3c69374c9722 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:25.661901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e90202d3-f40a-403e-986c-3c69374c9722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:25.680226 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71632e82-3ab4-4460-b548-3eba8dddfef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:25.680953 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71632e82-3ab4-4460-b548-3eba8dddfef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.681306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71632e82-3ab4-4460-b548-3eba8dddfef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.681585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71632e82-3ab4-4460-b548-3eba8dddfef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.683522 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71632e82-3ab4-4460-b548-3eba8dddfef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:16:25.684164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71632e82-3ab4-4460-b548-3eba8dddfef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:25.694320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71632e82-3ab4-4460-b548-3eba8dddfef5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:25.730709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1316/2603] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:16:25.733109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71632e82-3ab4-4460-b548-3eba8dddfef5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:25.735547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:25.736532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-71632e82-3ab4-4460-b548-3eba8dddfef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:25.752146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71632e82-3ab4-4460-b548-3eba8dddfef5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:25.759887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c1a6d-ab02-40ef-80e1-1ddf2ff1e14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:25.760743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c1a6d-ab02-40ef-80e1-1ddf2ff1e14c admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.761195 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c1a6d-ab02-40ef-80e1-1ddf2ff1e14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.761636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c1a6d-ab02-40ef-80e1-1ddf2ff1e14c admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.762469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c1a6d-ab02-40ef-80e1-1ddf2ff1e14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:25.764739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c1a6d-ab02-40ef-80e1-1ddf2ff1e14c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:25.774865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1288/2604] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:25.776681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbafb06-b988-48a1-92b6-2800fbafdcd4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.776975 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbafb06-b988-48a1-92b6-2800fbafdcd4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.777246 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbafb06-b988-48a1-92b6-2800fbafdcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.804485 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1bbafb06-b988-48a1-92b6-2800fbafdcd4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:25.805904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1bbafb06-b988-48a1-92b6-2800fbafdcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:25.818208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1317/2605] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:25 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:25.818446 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1289/2606] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:25.820602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c1a6d-ab02-40ef-80e1-1ddf2ff1e14c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:25.820760 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbafb06-b988-48a1-92b6-2800fbafdcd4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:25.833202 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbafb06-b988-48a1-92b6-2800fbafdcd4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:25.872988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:25.907592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c1a6d-ab02-40ef-80e1-1ddf2ff1e14c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:25.913256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952a083-443b-46ba-8057-18dbd379377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:25.914124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952a083-443b-46ba-8057-18dbd379377a admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.914586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952a083-443b-46ba-8057-18dbd379377a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.915022 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952a083-443b-46ba-8057-18dbd379377a admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.915828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952a083-443b-46ba-8057-18dbd379377a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:25.918029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952a083-443b-46ba-8057-18dbd379377a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:25.939412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151b33e-f1ab-490a-80c5-875e568e6015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:25.940229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151b33e-f1ab-490a-80c5-875e568e6015 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.940505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151b33e-f1ab-490a-80c5-875e568e6015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.940773 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151b33e-f1ab-490a-80c5-875e568e6015 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.941416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151b33e-f1ab-490a-80c5-875e568e6015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:16:25.941725 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151b33e-f1ab-490a-80c5-875e568e6015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:25.943412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151b33e-f1ab-490a-80c5-875e568e6015 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:25.951438 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1318/2607] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:25 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:25.955807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952a083-443b-46ba-8057-18dbd379377a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:25.961974 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1290/2608] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:16:25.963017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151b33e-f1ab-490a-80c5-875e568e6015 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:25.975463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151b33e-f1ab-490a-80c5-875e568e6015 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:25.976360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952a083-443b-46ba-8057-18dbd379377a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:25.981308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91da2f-59b8-46f9-b92e-6869b8cee0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:25.982076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91da2f-59b8-46f9-b92e-6869b8cee0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.982446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91da2f-59b8-46f9-b92e-6869b8cee0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.983212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91da2f-59b8-46f9-b92e-6869b8cee0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.984320 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91da2f-59b8-46f9-b92e-6869b8cee0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:25.986704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91da2f-59b8-46f9-b92e-6869b8cee0dc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:25.993865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd12f12-fada-4087-9471-8791426d39ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:25.996770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd12f12-fada-4087-9471-8791426d39ba admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:25.997327 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd12f12-fada-4087-9471-8791426d39ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:25.998053 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd12f12-fada-4087-9471-8791426d39ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:25.999769 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd12f12-fada-4087-9471-8791426d39ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.000044 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1319/2609] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:26.003580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd12f12-fada-4087-9471-8791426d39ba admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.004131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91da2f-59b8-46f9-b92e-6869b8cee0dc admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.019222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91da2f-59b8-46f9-b92e-6869b8cee0dc admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.024635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cf49b-05a4-4de3-9280-9f64b4dadb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.025372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cf49b-05a4-4de3-9280-9f64b4dadb16 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.025716 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cf49b-05a4-4de3-9280-9f64b4dadb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.026099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cf49b-05a4-4de3-9280-9f64b4dadb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.027020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cf49b-05a4-4de3-9280-9f64b4dadb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.029239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cf49b-05a4-4de3-9280-9f64b4dadb16 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.049295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1320/2610] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:26.053450 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cf49b-05a4-4de3-9280-9f64b4dadb16 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.054786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1291/2611] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:25 2022] POST /identity/v3/projects => generated 389 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:26.059302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd12f12-fada-4087-9471-8791426d39ba admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.064399 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cf49b-05a4-4de3-9280-9f64b4dadb16 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.137433 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd12f12-fada-4087-9471-8791426d39ba admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.142245 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedbda5-a7ff-4e64-8a47-10b7fc1b9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.142544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1282f-7b45-4811-9101-2da17514a92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.142884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedbda5-a7ff-4e64-8a47-10b7fc1b9f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.143135 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedbda5-a7ff-4e64-8a47-10b7fc1b9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.143411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedbda5-a7ff-4e64-8a47-10b7fc1b9f92 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.143608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1282f-7b45-4811-9101-2da17514a92b admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.143898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1282f-7b45-4811-9101-2da17514a92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.144106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedbda5-a7ff-4e64-8a47-10b7fc1b9f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.144323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1282f-7b45-4811-9101-2da17514a92b admin admin] PATH_INFO: `/v3/projects/218e63d6175e4f91a9e19850f9cbc08b/users/107b496ead4241c985eedf949ad6ca9d/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.146224 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedbda5-a7ff-4e64-8a47-10b7fc1b9f92 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.161138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1282f-7b45-4811-9101-2da17514a92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=218e63d6175e4f91a9e19850f9cbc08b, user_id=107b496ead4241c985eedf949ad6ca9d, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.163909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1282f-7b45-4811-9101-2da17514a92b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.169317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1292/2612] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:26 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:26.173917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedbda5-a7ff-4e64-8a47-10b7fc1b9f92 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.177728 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1321/2613] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:26 2022] PUT /identity/v3/projects/218e63d6175e4f91a9e19850f9cbc08b/users/107b496ead4241c985eedf949ad6ca9d/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:26.184379 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedbda5-a7ff-4e64-8a47-10b7fc1b9f92 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.188020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ddc7-b134-4ae0-867c-705646306709 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.188308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ddc7-b134-4ae0-867c-705646306709 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.188766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ddc7-b134-4ae0-867c-705646306709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.220515 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9f74ddc7-b134-4ae0-867c-705646306709 None None] MFA Rules not processed for user `107b496ead4241c985eedf949ad6ca9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:26.221770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9f74ddc7-b134-4ae0-867c-705646306709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:26.240915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:26.252849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad6dcf-a48f-4c0c-9b4a-710d4bf3bb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.254117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad6dcf-a48f-4c0c-9b4a-710d4bf3bb48 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.254403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad6dcf-a48f-4c0c-9b4a-710d4bf3bb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.254679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad6dcf-a48f-4c0c-9b4a-710d4bf3bb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.255634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad6dcf-a48f-4c0c-9b4a-710d4bf3bb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.257317 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad6dcf-a48f-4c0c-9b4a-710d4bf3bb48 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.270105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1293/2614] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:26.274526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad6dcf-a48f-4c0c-9b4a-710d4bf3bb48 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.286337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad6dcf-a48f-4c0c-9b4a-710d4bf3bb48 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.292014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fb18d-075b-40af-9a10-d6930fb4828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.292784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb18d-075b-40af-9a10-d6930fb4828e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.293081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb18d-075b-40af-9a10-d6930fb4828e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.293441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb18d-075b-40af-9a10-d6930fb4828e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.294265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fb18d-075b-40af-9a10-d6930fb4828e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.296304 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fb18d-075b-40af-9a10-d6930fb4828e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.309412 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1322/2615] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:26.310684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1294/2616] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:26.316888 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74ddc7-b134-4ae0-867c-705646306709 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.325547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fb18d-075b-40af-9a10-d6930fb4828e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.327627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-675fb18d-075b-40af-9a10-d6930fb4828e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:26.331470 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74ddc7-b134-4ae0-867c-705646306709 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.338033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d282f6-fa18-40d9-832b-71ad7f1f5b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.338831 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d282f6-fa18-40d9-832b-71ad7f1f5b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.339310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d282f6-fa18-40d9-832b-71ad7f1f5b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.339648 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d282f6-fa18-40d9-832b-71ad7f1f5b69 admin admin] PATH_INFO: `/v3/projects/573e680ee4354024912fe5c6a01ade70/users/bdae9ba36daa4ce886e854e86097ae75/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.359865 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d282f6-fa18-40d9-832b-71ad7f1f5b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573e680ee4354024912fe5c6a01ade70, user_id=bdae9ba36daa4ce886e854e86097ae75, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.362994 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d282f6-fa18-40d9-832b-71ad7f1f5b69 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.367227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:26.383661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1323/2617] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:26 2022] PUT /identity/v3/projects/573e680ee4354024912fe5c6a01ade70/users/bdae9ba36daa4ce886e854e86097ae75/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:26.393781 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe690e0-ff89-4298-8e27-225c868129b6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.394081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe690e0-ff89-4298-8e27-225c868129b6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.394357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe690e0-ff89-4298-8e27-225c868129b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.398470 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fb18d-075b-40af-9a10-d6930fb4828e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.428049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1fe690e0-ff89-4298-8e27-225c868129b6 None None] MFA Rules not processed for user `bdae9ba36daa4ce886e854e86097ae75`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:26.429299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1fe690e0-ff89-4298-8e27-225c868129b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:26.451027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b17ae-72a6-42fe-83dc-b9551dbddb0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.451784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b17ae-72a6-42fe-83dc-b9551dbddb0d service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.452699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b17ae-72a6-42fe-83dc-b9551dbddb0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.452972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b17ae-72a6-42fe-83dc-b9551dbddb0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.496293 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1324/2618] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:26.501263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe690e0-ff89-4298-8e27-225c868129b6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.514817 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b17ae-72a6-42fe-83dc-b9551dbddb0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.516457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b17ae-72a6-42fe-83dc-b9551dbddb0d service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.526300 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1295/2619] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:26.548284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b17ae-72a6-42fe-83dc-b9551dbddb0d service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.575406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe690e0-ff89-4298-8e27-225c868129b6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.581713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab60267-e236-4a8d-b7e4-539a1bbfecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.582343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab60267-e236-4a8d-b7e4-539a1bbfecf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.582614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab60267-e236-4a8d-b7e4-539a1bbfecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.582871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab60267-e236-4a8d-b7e4-539a1bbfecf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.583505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab60267-e236-4a8d-b7e4-539a1bbfecf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.585398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab60267-e236-4a8d-b7e4-539a1bbfecf8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.614777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:26.624249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1325/2620] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:26 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:16:26.625228 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab60267-e236-4a8d-b7e4-539a1bbfecf8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.633238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b17ae-72a6-42fe-83dc-b9551dbddb0d service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.693219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c493d3-34c5-4956-b916-f357d4c44508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.693913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c493d3-34c5-4956-b916-f357d4c44508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.694189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c493d3-34c5-4956-b916-f357d4c44508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.694457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c493d3-34c5-4956-b916-f357d4c44508 admin admin] PATH_INFO: `/v3/users/107b496ead4241c985eedf949ad6ca9d` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.695606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c493d3-34c5-4956-b916-f357d4c44508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=107b496ead4241c985eedf949ad6ca9d)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.697170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab60267-e236-4a8d-b7e4-539a1bbfecf8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.697571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c493d3-34c5-4956-b916-f357d4c44508 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.708749 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb5dd8-650c-4115-88ab-eb8b62291b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.709575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb5dd8-650c-4115-88ab-eb8b62291b5a admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.710332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb5dd8-650c-4115-88ab-eb8b62291b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.710601 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb5dd8-650c-4115-88ab-eb8b62291b5a admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.711241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb5dd8-650c-4115-88ab-eb8b62291b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.713203 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb5dd8-650c-4115-88ab-eb8b62291b5a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.734774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:26.741459 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1326/2621] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:26 2022] POST /identity/v3/users => generated 301 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:26.745382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb5dd8-650c-4115-88ab-eb8b62291b5a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.760843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb5dd8-650c-4115-88ab-eb8b62291b5a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.763308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-08c493d3-34c5-4956-b916-f357d4c44508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107b496ead4241c985eedf949ad6ca9d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:26.764266 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-08c493d3-34c5-4956-b916-f357d4c44508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107b496ead4241c985eedf949ad6ca9d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:26.766314 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d849786-8af9-4646-8c32-0d1c97a4825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.767242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d849786-8af9-4646-8c32-0d1c97a4825b admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.767517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d849786-8af9-4646-8c32-0d1c97a4825b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.767786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d849786-8af9-4646-8c32-0d1c97a4825b admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.768947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d849786-8af9-4646-8c32-0d1c97a4825b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.770917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d849786-8af9-4646-8c32-0d1c97a4825b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.774638 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-08c493d3-34c5-4956-b916-f357d4c44508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107b496ead4241c985eedf949ad6ca9d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:26.783407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1327/2622] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:26.783612 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-08c493d3-34c5-4956-b916-f357d4c44508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107b496ead4241c985eedf949ad6ca9d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:26.784360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-08c493d3-34c5-4956-b916-f357d4c44508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107b496ead4241c985eedf949ad6ca9d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:26.787507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d849786-8af9-4646-8c32-0d1c97a4825b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.789257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5d849786-8af9-4646-8c32-0d1c97a4825b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:26.802756 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d849786-8af9-4646-8c32-0d1c97a4825b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.807570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1296/2623] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:26 2022] DELETE /identity/v3/users/107b496ead4241c985eedf949ad6ca9d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:26.807713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877c6ec-87f9-4eaf-ad6c-e6a77f232493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.808317 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877c6ec-87f9-4eaf-ad6c-e6a77f232493 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.808595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877c6ec-87f9-4eaf-ad6c-e6a77f232493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.808933 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877c6ec-87f9-4eaf-ad6c-e6a77f232493 admin admin] PATH_INFO: `/v3/projects/ca9a02f2a3754589b77b04b5910af4ee/users/dfeb24ab32ce4f789b4243f804f5b464/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.811818 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2a51-7dcf-4d20-81e7-6555e6ac6690 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.812035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2a51-7dcf-4d20-81e7-6555e6ac6690 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.812316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2a51-7dcf-4d20-81e7-6555e6ac6690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.825505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877c6ec-87f9-4eaf-ad6c-e6a77f232493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9a02f2a3754589b77b04b5910af4ee, user_id=dfeb24ab32ce4f789b4243f804f5b464, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.828556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877c6ec-87f9-4eaf-ad6c-e6a77f232493 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.834731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f24e2a51-7dcf-4d20-81e7-6555e6ac6690 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:26.836624 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f24e2a51-7dcf-4d20-81e7-6555e6ac6690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:26.846338 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1328/2624] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:26 2022] PUT /identity/v3/projects/ca9a02f2a3754589b77b04b5910af4ee/users/dfeb24ab32ce4f789b4243f804f5b464/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:26.850198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877c6ec-87f9-4eaf-ad6c-e6a77f232493 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.903979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1297/2625] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:26.911981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877c6ec-87f9-4eaf-ad6c-e6a77f232493 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.914613 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e2a51-7dcf-4d20-81e7-6555e6ac6690 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.915951 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f24e2a51-7dcf-4d20-81e7-6555e6ac6690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:26.917296 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa80da-a792-409a-8505-d9a180d8bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.918040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa80da-a792-409a-8505-d9a180d8bd63 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.918323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa80da-a792-409a-8505-d9a180d8bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.918599 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa80da-a792-409a-8505-d9a180d8bd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.919247 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa80da-a792-409a-8505-d9a180d8bd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.920880 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa80da-a792-409a-8505-d9a180d8bd63 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.929827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:26.931161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1329/2626] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:26.935387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa80da-a792-409a-8505-d9a180d8bd63 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:26.946163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa80da-a792-409a-8505-d9a180d8bd63 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.950715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52cacc-f2f0-4329-a54a-3789a6c374cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:26.951357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52cacc-f2f0-4329-a54a-3789a6c374cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.951655 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52cacc-f2f0-4329-a54a-3789a6c374cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.951920 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52cacc-f2f0-4329-a54a-3789a6c374cb admin admin] PATH_INFO: `/v3/projects/ca9a02f2a3754589b77b04b5910af4ee/users/dfeb24ab32ce4f789b4243f804f5b464/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:26.953805 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52cacc-f2f0-4329-a54a-3789a6c374cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9a02f2a3754589b77b04b5910af4ee, user_id=dfeb24ab32ce4f789b4243f804f5b464, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:26.956455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52cacc-f2f0-4329-a54a-3789a6c374cb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:26.967001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1330/2627] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:26 2022] PUT /identity/v3/projects/ca9a02f2a3754589b77b04b5910af4ee/users/dfeb24ab32ce4f789b4243f804f5b464/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:26.976059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e2a51-7dcf-4d20-81e7-6555e6ac6690 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:26.978600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4c6ac-d4c8-46a6-9f1f-0bab1ff717e7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:26.978882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4c6ac-d4c8-46a6-9f1f-0bab1ff717e7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:26.979156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4c6ac-d4c8-46a6-9f1f-0bab1ff717e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.007180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c2e4c6ac-d4c8-46a6-9f1f-0bab1ff717e7 None None] MFA Rules not processed for user `dfeb24ab32ce4f789b4243f804f5b464`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:27.008389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c2e4c6ac-d4c8-46a6-9f1f-0bab1ff717e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:27.027238 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c554398-7332-4040-ba81-c7269eca7ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:27.027850 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c554398-7332-4040-ba81-c7269eca7ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.028134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c554398-7332-4040-ba81-c7269eca7ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.028396 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c554398-7332-4040-ba81-c7269eca7ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.079421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1331/2628] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:27.089992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c554398-7332-4040-ba81-c7269eca7ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:27.090134 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4c6ac-d4c8-46a6-9f1f-0bab1ff717e7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:27.091488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c2e4c6ac-d4c8-46a6-9f1f-0bab1ff717e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:27.091600 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c554398-7332-4040-ba81-c7269eca7ec3 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:27.101371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1298/2629] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:27.127595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:27.152375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4c6ac-d4c8-46a6-9f1f-0bab1ff717e7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:27.156789 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007230a-4d09-4990-ace2-107a3df120d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:27.157403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007230a-4d09-4990-ace2-107a3df120d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.157672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007230a-4d09-4990-ace2-107a3df120d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.157981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007230a-4d09-4990-ace2-107a3df120d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.167285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007230a-4d09-4990-ace2-107a3df120d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:27.168782 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007230a-4d09-4990-ace2-107a3df120d1 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:27.178906 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1332/2630] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:27.324192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c554398-7332-4040-ba81-c7269eca7ec3 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:27.335199 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c554398-7332-4040-ba81-c7269eca7ec3 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:27.340257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84a647-7a3d-4baf-988f-f372129e3a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:27.341039 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84a647-7a3d-4baf-988f-f372129e3a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.341379 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84a647-7a3d-4baf-988f-f372129e3a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.341736 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84a647-7a3d-4baf-988f-f372129e3a99 admin admin] PATH_INFO: `/v3/users/bdae9ba36daa4ce886e854e86097ae75` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.342956 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84a647-7a3d-4baf-988f-f372129e3a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdae9ba36daa4ce886e854e86097ae75)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:27.345106 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84a647-7a3d-4baf-988f-f372129e3a99 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:27.398285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007230a-4d09-4990-ace2-107a3df120d1 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:27.405122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2007230a-4d09-4990-ace2-107a3df120d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:27.414947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2a84a647-7a3d-4baf-988f-f372129e3a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdae9ba36daa4ce886e854e86097ae75'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:27.416241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2a84a647-7a3d-4baf-988f-f372129e3a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdae9ba36daa4ce886e854e86097ae75'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:27.419593 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007230a-4d09-4990-ace2-107a3df120d1 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:27.425217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:27.426059 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.426454 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.426786 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] PATH_INFO: `/v3/projects/218e63d6175e4f91a9e19850f9cbc08b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.427536 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2a84a647-7a3d-4baf-988f-f372129e3a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdae9ba36daa4ce886e854e86097ae75'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:27.428179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=218e63d6175e4f91a9e19850f9cbc08b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:27.430225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:27.435910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2a84a647-7a3d-4baf-988f-f372129e3a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdae9ba36daa4ce886e854e86097ae75'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:27.436940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2a84a647-7a3d-4baf-988f-f372129e3a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdae9ba36daa4ce886e854e86097ae75'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:27.445180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:27.457105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1299/2631] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:27 2022] DELETE /identity/v3/users/bdae9ba36daa4ce886e854e86097ae75 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:27.461717 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51366b22-d814-49d0-914e-97179dacabf7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.462066 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51366b22-d814-49d0-914e-97179dacabf7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.462338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51366b22-d814-49d0-914e-97179dacabf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.480232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218e63d6175e4f91a9e19850f9cbc08b', 'request_id': 'req-2917fa09-e54b-4406-97c2-ab66627bd3a2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:27.481201 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-51366b22-d814-49d0-914e-97179dacabf7 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:27.482435 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-51366b22-d814-49d0-914e-97179dacabf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:27.489811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218e63d6175e4f91a9e19850f9cbc08b', 'request_id': 'req-2917fa09-e54b-4406-97c2-ab66627bd3a2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:27.497447 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218e63d6175e4f91a9e19850f9cbc08b', 'request_id': 'req-2917fa09-e54b-4406-97c2-ab66627bd3a2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:27.515062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] The token cache is being invalidate because project 218e63d6175e4f91a9e19850f9cbc08b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:27.515358 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:27.516002 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2917fa09-e54b-4406-97c2-ab66627bd3a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:27.517876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1333/2632] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:27 2022] DELETE /identity/v3/projects/218e63d6175e4f91a9e19850f9cbc08b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:27.522502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37b95-b0ff-46a8-a74e-100caebfebc1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.522896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37b95-b0ff-46a8-a74e-100caebfebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.523268 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37b95-b0ff-46a8-a74e-100caebfebc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.544972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9bb37b95-b0ff-46a8-a74e-100caebfebc1 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:27.546336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9bb37b95-b0ff-46a8-a74e-100caebfebc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:27.546883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1300/2633] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:27.556790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51366b22-d814-49d0-914e-97179dacabf7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:27.557348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1334/2634] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:27.562650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-51366b22-d814-49d0-914e-97179dacabf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:27.566061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdc03e-94a1-4613-88a8-5b3df4f7331f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.566339 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdc03e-94a1-4613-88a8-5b3df4f7331f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.566607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdc03e-94a1-4613-88a8-5b3df4f7331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.586523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0bcdc03e-94a1-4613-88a8-5b3df4f7331f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:27.587647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0bcdc03e-94a1-4613-88a8-5b3df4f7331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:27.595849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1335/2635] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:27.600136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdc03e-94a1-4613-88a8-5b3df4f7331f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:27.610560 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdc03e-94a1-4613-88a8-5b3df4f7331f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:27.617643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bdd95-6f30-42cc-8904-816a60e34bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:27.618331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bdd95-6f30-42cc-8904-816a60e34bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.618609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bdd95-6f30-42cc-8904-816a60e34bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.618876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bdd95-6f30-42cc-8904-816a60e34bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.619539 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bdd95-6f30-42cc-8904-816a60e34bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:16:27.619841 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bdd95-6f30-42cc-8904-816a60e34bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:27.621478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bdd95-6f30-42cc-8904-816a60e34bb4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:27.626267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51366b22-d814-49d0-914e-97179dacabf7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:27.631750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c857c-588b-4655-b133-401b965b2a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:27.632654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c857c-588b-4655-b133-401b965b2a0c service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.632933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c857c-588b-4655-b133-401b965b2a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.633203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c857c-588b-4655-b133-401b965b2a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.637883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1336/2636] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:16:27.638919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bdd95-6f30-42cc-8904-816a60e34bb4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:27.643774 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c857c-588b-4655-b133-401b965b2a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:27.645957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c857c-588b-4655-b133-401b965b2a0c service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:27.649400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bdd95-6f30-42cc-8904-816a60e34bb4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:27.654975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3139e4-f3eb-40f6-a1b3-3c4a64c4efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:27.655596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3139e4-f3eb-40f6-a1b3-3c4a64c4efb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.655922 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3139e4-f3eb-40f6-a1b3-3c4a64c4efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.656199 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3139e4-f3eb-40f6-a1b3-3c4a64c4efb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.656845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3139e4-f3eb-40f6-a1b3-3c4a64c4efb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:27.657372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1301/2637] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:27.658844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3139e4-f3eb-40f6-a1b3-3c4a64c4efb5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:27.694944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1337/2638] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:27 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:27.705589 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c857c-588b-4655-b133-401b965b2a0c service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:27.715482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c857c-588b-4655-b133-401b965b2a0c service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:27.792954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50a122-8c3e-45c8-8eb5-88e32e98a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:27.793706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a122-8c3e-45c8-8eb5-88e32e98a1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.794218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a122-8c3e-45c8-8eb5-88e32e98a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.794587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a122-8c3e-45c8-8eb5-88e32e98a1b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.795511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50a122-8c3e-45c8-8eb5-88e32e98a1b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:27.798244 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50a122-8c3e-45c8-8eb5-88e32e98a1b1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:27.823846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1302/2639] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:27 2022] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:27.828146 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3139e4-f3eb-40f6-a1b3-3c4a64c4efb5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:27.840015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3139e4-f3eb-40f6-a1b3-3c4a64c4efb5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:27.845488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22a5fe-dd66-4836-acd4-c1df57dc1979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:27.846303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22a5fe-dd66-4836-acd4-c1df57dc1979 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.846798 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22a5fe-dd66-4836-acd4-c1df57dc1979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.847072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22a5fe-dd66-4836-acd4-c1df57dc1979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.847868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22a5fe-dd66-4836-acd4-c1df57dc1979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:27.849719 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22a5fe-dd66-4836-acd4-c1df57dc1979 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:27.868987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1338/2640] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:27.870775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50a122-8c3e-45c8-8eb5-88e32e98a1b1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:27.882690 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50a122-8c3e-45c8-8eb5-88e32e98a1b1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:27.888067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84433c6a-9c35-429a-bf36-64473e569b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:27.888686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84433c6a-9c35-429a-bf36-64473e569b4b admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.888964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84433c6a-9c35-429a-bf36-64473e569b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.891676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84433c6a-9c35-429a-bf36-64473e569b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.891676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84433c6a-9c35-429a-bf36-64473e569b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:27.891676 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84433c6a-9c35-429a-bf36-64473e569b4b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:27.902836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1303/2641] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:27.907559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22a5fe-dd66-4836-acd4-c1df57dc1979 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:27.919125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22a5fe-dd66-4836-acd4-c1df57dc1979 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:27.925143 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12467e9-f9ce-41ae-b0d4-3a017878b1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:27.926153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12467e9-f9ce-41ae-b0d4-3a017878b1a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.926355 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12467e9-f9ce-41ae-b0d4-3a017878b1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.927076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12467e9-f9ce-41ae-b0d4-3a017878b1a2 admin admin] PATH_INFO: `/v3/projects/c20949ca20d942799093267161f4d3b5/users/0e1dec81bb7247f2ad32de847a8b32bb/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:27.946817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12467e9-f9ce-41ae-b0d4-3a017878b1a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20949ca20d942799093267161f4d3b5, user_id=0e1dec81bb7247f2ad32de847a8b32bb, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:27.951932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12467e9-f9ce-41ae-b0d4-3a017878b1a2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:27.971050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1339/2642] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:27 2022] PUT /identity/v3/projects/c20949ca20d942799093267161f4d3b5/users/0e1dec81bb7247f2ad32de847a8b32bb/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:27.981944 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca08f8-e9fc-4ff4-ba0e-da4eae89467d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:27.982407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca08f8-e9fc-4ff4-ba0e-da4eae89467d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:27.982688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca08f8-e9fc-4ff4-ba0e-da4eae89467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:28.021857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:28.024026 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12467e9-f9ce-41ae-b0d4-3a017878b1a2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:28.026292 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2aca08f8-e9fc-4ff4-ba0e-da4eae89467d None None] MFA Rules not processed for user `0e1dec81bb7247f2ad32de847a8b32bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:28.028360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2aca08f8-e9fc-4ff4-ba0e-da4eae89467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:28.031575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e12467e9-f9ce-41ae-b0d4-3a017878b1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:28.098592 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:28.121223 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1304/2643] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:28.129514 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12467e9-f9ce-41ae-b0d4-3a017878b1a2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:28.134137 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca08f8-e9fc-4ff4-ba0e-da4eae89467d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:28.135517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2aca08f8-e9fc-4ff4-ba0e-da4eae89467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:28.135989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:28.136875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:28.137160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:28.137661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] PATH_INFO: `/v3/projects/573e680ee4354024912fe5c6a01ade70` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:28.138972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=573e680ee4354024912fe5c6a01ade70)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:28.141388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:28.194951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573e680ee4354024912fe5c6a01ade70', 'request_id': 'req-f5229959-4c08-4d15-aa3e-06b59afe4761'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.199737 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca08f8-e9fc-4ff4-ba0e-da4eae89467d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:28.204637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573e680ee4354024912fe5c6a01ade70', 'request_id': 'req-f5229959-4c08-4d15-aa3e-06b59afe4761'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.211171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573e680ee4354024912fe5c6a01ade70', 'request_id': 'req-f5229959-4c08-4d15-aa3e-06b59afe4761'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.225272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] The token cache is being invalidate because project 573e680ee4354024912fe5c6a01ade70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:28.225667 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.226449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.228039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1340/2644] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:28 2022] DELETE /identity/v3/projects/573e680ee4354024912fe5c6a01ade70 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:28.231853 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:28.233254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:28.255675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69999f-0770-4cf0-b2d0-f3ef3318dcaf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22e60fc95af4a0a94b15f9ed9e3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:28.256329 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69999f-0770-4cf0-b2d0-f3ef3318dcaf service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:28.256605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69999f-0770-4cf0-b2d0-f3ef3318dcaf service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:28.256873 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69999f-0770-4cf0-b2d0-f3ef3318dcaf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:28.259056 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7f69999f-0770-4cf0-b2d0-f3ef3318dcaf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:28.302607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5229959-4c08-4d15-aa3e-06b59afe4761 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:28.307464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c2dac-7d62-4fce-9f62-0307895e4017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:28.308109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c2dac-7d62-4fce-9f62-0307895e4017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:28.308388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c2dac-7d62-4fce-9f62-0307895e4017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:28.308659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c2dac-7d62-4fce-9f62-0307895e4017 admin admin] PATH_INFO: `/v3/users/dfeb24ab32ce4f789b4243f804f5b464` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:28.309797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c2dac-7d62-4fce-9f62-0307895e4017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfeb24ab32ce4f789b4243f804f5b464)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:28.311850 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c2dac-7d62-4fce-9f62-0307895e4017 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:28.317182 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69999f-0770-4cf0-b2d0-f3ef3318dcaf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:28.318692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69999f-0770-4cf0-b2d0-f3ef3318dcaf service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:28.327727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1305/2645] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:28.363017 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-783c2dac-7d62-4fce-9f62-0307895e4017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfeb24ab32ce4f789b4243f804f5b464'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.371902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-783c2dac-7d62-4fce-9f62-0307895e4017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfeb24ab32ce4f789b4243f804f5b464'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.372585 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-783c2dac-7d62-4fce-9f62-0307895e4017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfeb24ab32ce4f789b4243f804f5b464'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.380308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-783c2dac-7d62-4fce-9f62-0307895e4017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfeb24ab32ce4f789b4243f804f5b464'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.387963 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:28.397652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-783c2dac-7d62-4fce-9f62-0307895e4017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfeb24ab32ce4f789b4243f804f5b464'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.404824 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1341/2646] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:28 2022] DELETE /identity/v3/users/dfeb24ab32ce4f789b4243f804f5b464 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:28.707318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69999f-0770-4cf0-b2d0-f3ef3318dcaf service glance] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:28.722285 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69999f-0770-4cf0-b2d0-f3ef3318dcaf service glance] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:28.732933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:28.789687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:28.790384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:28.790657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:28.790923 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] PATH_INFO: `/v3/projects/ca9a02f2a3754589b77b04b5910af4ee` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:28.792066 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9a02f2a3754589b77b04b5910af4ee)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:28.794063 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:28.848608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9a02f2a3754589b77b04b5910af4ee', 'request_id': 'req-03c803c5-d483-41a3-a927-a54bb384153c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.870533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9a02f2a3754589b77b04b5910af4ee', 'request_id': 'req-03c803c5-d483-41a3-a927-a54bb384153c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.870533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9a02f2a3754589b77b04b5910af4ee', 'request_id': 'req-03c803c5-d483-41a3-a927-a54bb384153c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.881209 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] The token cache is being invalidate because project ca9a02f2a3754589b77b04b5910af4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:28.881469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.882141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-03c803c5-d483-41a3-a927-a54bb384153c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:28.883681 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1306/2647] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:28 2022] DELETE /identity/v3/projects/ca9a02f2a3754589b77b04b5910af4ee => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:28.888680 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff7973-a2c9-4828-9ce8-1984f207f449 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:28.889124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff7973-a2c9-4828-9ce8-1984f207f449 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:28.889593 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff7973-a2c9-4828-9ce8-1984f207f449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:28.911594 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ebff7973-a2c9-4828-9ce8-1984f207f449 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:28.912816 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ebff7973-a2c9-4828-9ce8-1984f207f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:28.975111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1342/2648] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:28.983637 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e3590-f1ee-4832-ac82-f6c82a8968a8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:28.983915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e3590-f1ee-4832-ac82-f6c82a8968a8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:28.984182 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e3590-f1ee-4832-ac82-f6c82a8968a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:29.005579 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f96e3590-f1ee-4832-ac82-f6c82a8968a8 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:29.006648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f96e3590-f1ee-4832-ac82-f6c82a8968a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:29.015752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1307/2649] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:29.020221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff7973-a2c9-4828-9ce8-1984f207f449 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:29.031223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff7973-a2c9-4828-9ce8-1984f207f449 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:29.036454 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f191dca-6e3d-4c63-b8f8-3227807f040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:29.037070 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f191dca-6e3d-4c63-b8f8-3227807f040e admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:29.037348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f191dca-6e3d-4c63-b8f8-3227807f040e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:29.037623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f191dca-6e3d-4c63-b8f8-3227807f040e admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:29.038313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f191dca-6e3d-4c63-b8f8-3227807f040e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:16:29.038616 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f191dca-6e3d-4c63-b8f8-3227807f040e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:29.040213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f191dca-6e3d-4c63-b8f8-3227807f040e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:29.055901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1343/2650] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:16:29.057388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e3590-f1ee-4832-ac82-f6c82a8968a8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:29.070027 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e3590-f1ee-4832-ac82-f6c82a8968a8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:29.076775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86c43c-35f2-4c77-8582-de2929edfc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:29.077460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86c43c-35f2-4c77-8582-de2929edfc36 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:29.077795 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86c43c-35f2-4c77-8582-de2929edfc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:29.078152 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86c43c-35f2-4c77-8582-de2929edfc36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:29.079120 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86c43c-35f2-4c77-8582-de2929edfc36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:29.081587 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86c43c-35f2-4c77-8582-de2929edfc36 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:29.117867 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1308/2651] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:29 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:29.120382 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f191dca-6e3d-4c63-b8f8-3227807f040e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:29.131397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f191dca-6e3d-4c63-b8f8-3227807f040e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:29.197451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8008ba-7d63-4089-8934-65711efdd015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:29.198093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8008ba-7d63-4089-8934-65711efdd015 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:29.198523 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8008ba-7d63-4089-8934-65711efdd015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:29.198803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8008ba-7d63-4089-8934-65711efdd015 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:29.199449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8008ba-7d63-4089-8934-65711efdd015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:29.201391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8008ba-7d63-4089-8934-65711efdd015 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:29.228517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1344/2652] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:29 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:29.229845 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86c43c-35f2-4c77-8582-de2929edfc36 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:29.245230 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86c43c-35f2-4c77-8582-de2929edfc36 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:29.251899 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122f54b-2001-4ead-a751-7761d33ee4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:29.252590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f54b-2001-4ead-a751-7761d33ee4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:29.252870 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f54b-2001-4ead-a751-7761d33ee4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:29.253139 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f54b-2001-4ead-a751-7761d33ee4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:29.253796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122f54b-2001-4ead-a751-7761d33ee4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:29.255897 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122f54b-2001-4ead-a751-7761d33ee4c0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:29.266888 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1309/2653] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:29.270807 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8008ba-7d63-4089-8934-65711efdd015 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:29.282573 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8008ba-7d63-4089-8934-65711efdd015 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:29.287328 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73afc41-2efc-4fb2-813f-f911fe92aac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:29.287948 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73afc41-2efc-4fb2-813f-f911fe92aac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:29.288225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73afc41-2efc-4fb2-813f-f911fe92aac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:29.288496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73afc41-2efc-4fb2-813f-f911fe92aac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:29.289179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73afc41-2efc-4fb2-813f-f911fe92aac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:29.290866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73afc41-2efc-4fb2-813f-f911fe92aac6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:29.427578 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1345/2654] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:29.433368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122f54b-2001-4ead-a751-7761d33ee4c0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:29.444820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122f54b-2001-4ead-a751-7761d33ee4c0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:29.450563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae75e-e865-49d4-a50a-08bd8dd3bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:29.451216 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae75e-e865-49d4-a50a-08bd8dd3bddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:29.451488 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae75e-e865-49d4-a50a-08bd8dd3bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:29.451821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae75e-e865-49d4-a50a-08bd8dd3bddd admin admin] PATH_INFO: `/v3/projects/b906c93a04b242b39c10475541341dab/users/dcb015b42c2340bda57a3a3eb361de50/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:29.469415 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ae75e-e865-49d4-a50a-08bd8dd3bddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b906c93a04b242b39c10475541341dab, user_id=dcb015b42c2340bda57a3a3eb361de50, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:29.473183 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ae75e-e865-49d4-a50a-08bd8dd3bddd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:29.490508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1310/2655] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:29 2022] PUT /identity/v3/projects/b906c93a04b242b39c10475541341dab/users/dcb015b42c2340bda57a3a3eb361de50/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:29.496277 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9359-bfe7-4e1c-8007-27207850588a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:29.496542 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9359-bfe7-4e1c-8007-27207850588a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:29.496796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9359-bfe7-4e1c-8007-27207850588a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:29.524884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-910b9359-bfe7-4e1c-8007-27207850588a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:29.526204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-910b9359-bfe7-4e1c-8007-27207850588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:29.587842 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:29.606747 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1346/2656] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:29.619530 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae75e-e865-49d4-a50a-08bd8dd3bddd admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:29.621625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-691ae75e-e865-49d4-a50a-08bd8dd3bddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:29.669122 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:29.687477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae75e-e865-49d4-a50a-08bd8dd3bddd admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:29.694141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a78d15-96b1-4882-8683-7395e3397c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:29.695075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a78d15-96b1-4882-8683-7395e3397c13 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:29.695685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a78d15-96b1-4882-8683-7395e3397c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:29.696455 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a78d15-96b1-4882-8683-7395e3397c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:29.708462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a78d15-96b1-4882-8683-7395e3397c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:29.709963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a78d15-96b1-4882-8683-7395e3397c13 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:29.722594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1311/2657] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:30.569735 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b8127-fe33-44d8-bbb4-6c32dbcd21cb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:30.570329 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b8127-fe33-44d8-bbb4-6c32dbcd21cb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:30.570577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b8127-fe33-44d8-bbb4-6c32dbcd21cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:30.603854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-804b8127-fe33-44d8-bbb4-6c32dbcd21cb None None] MFA Rules not processed for user `dcb015b42c2340bda57a3a3eb361de50`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:30.605144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-804b8127-fe33-44d8-bbb4-6c32dbcd21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:30.687183 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1347/2658] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:30.698824 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a78d15-96b1-4882-8683-7395e3397c13 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:30.707124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-37a78d15-96b1-4882-8683-7395e3397c13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:30.777284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a78d15-96b1-4882-8683-7395e3397c13 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:30.781233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02456a23-da8f-4e22-87de-eb97da4bb9a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:30.781935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02456a23-da8f-4e22-87de-eb97da4bb9a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:30.782206 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02456a23-da8f-4e22-87de-eb97da4bb9a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:30.782481 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02456a23-da8f-4e22-87de-eb97da4bb9a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:30.791008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02456a23-da8f-4e22-87de-eb97da4bb9a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:30.792460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02456a23-da8f-4e22-87de-eb97da4bb9a7 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:30.804263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1312/2659] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:31.743385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed08451-1fc9-4837-b3e6-0a78b308b662 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:31.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed08451-1fc9-4837-b3e6-0a78b308b662 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:31.744197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed08451-1fc9-4837-b3e6-0a78b308b662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:31.769874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4ed08451-1fc9-4837-b3e6-0a78b308b662 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:31.771082 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4ed08451-1fc9-4837-b3e6-0a78b308b662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:31.781693 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1348/2660] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 22 22:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:31.800767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02456a23-da8f-4e22-87de-eb97da4bb9a7 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:31.802258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-02456a23-da8f-4e22-87de-eb97da4bb9a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:31.883340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02456a23-da8f-4e22-87de-eb97da4bb9a7 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:31.890052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ce6b2-f870-49d0-aa1e-4eb4dd00176b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:31.890670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce6b2-f870-49d0-aa1e-4eb4dd00176b service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:31.891044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce6b2-f870-49d0-aa1e-4eb4dd00176b service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:31.891321 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce6b2-f870-49d0-aa1e-4eb4dd00176b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:31.901012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ce6b2-f870-49d0-aa1e-4eb4dd00176b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:31.902656 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ce6b2-f870-49d0-aa1e-4eb4dd00176b service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:31.913018 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1313/2661] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:32.284214 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c4e5-0d35-4e47-b51d-7732d83f543a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:32.284500 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c4e5-0d35-4e47-b51d-7732d83f543a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:32.284771 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c4e5-0d35-4e47-b51d-7732d83f543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:32.305211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bf10c4e5-0d35-4e47-b51d-7732d83f543a None None] MFA Rules not processed for user `dcb015b42c2340bda57a3a3eb361de50`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:32.306357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bf10c4e5-0d35-4e47-b51d-7732d83f543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:32.315788 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1349/2662] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:34.865393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea33c3-6832-43c2-9067-1bc4bfc419dc None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:34.865912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea33c3-6832-43c2-9067-1bc4bfc419dc None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:34.865912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea33c3-6832-43c2-9067-1bc4bfc419dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:34.887252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-09ea33c3-6832-43c2-9067-1bc4bfc419dc None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:34.888479 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-09ea33c3-6832-43c2-9067-1bc4bfc419dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:34.898105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1314/2663] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 22 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:34.913365 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10c4e5-0d35-4e47-b51d-7732d83f543a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:34.926327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10c4e5-0d35-4e47-b51d-7732d83f543a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:34.933083 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30881f33-5a15-42bf-a9da-1a232e703ce9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:34.933679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30881f33-5a15-42bf-a9da-1a232e703ce9 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:34.933999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30881f33-5a15-42bf-a9da-1a232e703ce9 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:34.934258 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30881f33-5a15-42bf-a9da-1a232e703ce9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:34.943168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30881f33-5a15-42bf-a9da-1a232e703ce9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:34.944757 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30881f33-5a15-42bf-a9da-1a232e703ce9 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:34.956558 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1350/2664] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:35.086152 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714fd4-be60-48a9-919c-c0e2747f6d90 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:35.086429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714fd4-be60-48a9-919c-c0e2747f6d90 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:35.086905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714fd4-be60-48a9-919c-c0e2747f6d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:35.119057 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8a714fd4-be60-48a9-919c-c0e2747f6d90 None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:35.120313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8a714fd4-be60-48a9-919c-c0e2747f6d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:35.196034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1315/2665] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 22 22:16:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:35.211185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30881f33-5a15-42bf-a9da-1a232e703ce9 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:35.212871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-30881f33-5a15-42bf-a9da-1a232e703ce9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:35.253114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a714fd4-be60-48a9-919c-c0e2747f6d90 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:35.271616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a714fd4-be60-48a9-919c-c0e2747f6d90 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:35.275517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff21910-0f1a-458d-83ac-c5a91bd2c4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:35.276255 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff21910-0f1a-458d-83ac-c5a91bd2c4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:35.276608 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff21910-0f1a-458d-83ac-c5a91bd2c4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:35.276879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff21910-0f1a-458d-83ac-c5a91bd2c4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:35.278937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8ff21910-0f1a-458d-83ac-c5a91bd2c4c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:35.286000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:35.295595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30881f33-5a15-42bf-a9da-1a232e703ce9 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:35.300657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8337d1f-7d52-42cd-8f9d-9fe65b3d7653 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:35.301266 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8337d1f-7d52-42cd-8f9d-9fe65b3d7653 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:35.301547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8337d1f-7d52-42cd-8f9d-9fe65b3d7653 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:35.301817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8337d1f-7d52-42cd-8f9d-9fe65b3d7653 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:35.309985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8337d1f-7d52-42cd-8f9d-9fe65b3d7653 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:35.311483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8337d1f-7d52-42cd-8f9d-9fe65b3d7653 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:35.319478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1351/2666] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:16:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:16:35.346978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff21910-0f1a-458d-83ac-c5a91bd2c4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:35.348498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff21910-0f1a-458d-83ac-c5a91bd2c4c7 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:35.358342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1316/2667] 10.222.0.20 () {60 vars in 1396 bytes} [Thu Sep 22 22:16:35 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:16:38.178088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16899-725f-46e8-a20a-7d7aab68960a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:38.178653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16899-725f-46e8-a20a-7d7aab68960a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:38.178653 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16899-725f-46e8-a20a-7d7aab68960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:38.198769 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c5d16899-725f-46e8-a20a-7d7aab68960a None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:38.199975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c5d16899-725f-46e8-a20a-7d7aab68960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:38.210391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1352/2668] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 22 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:38.226400 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff21910-0f1a-458d-83ac-c5a91bd2c4c7 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:38.228273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8ff21910-0f1a-458d-83ac-c5a91bd2c4c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:38.246068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff21910-0f1a-458d-83ac-c5a91bd2c4c7 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:38.253010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88673de-b09c-424e-a0ce-1f74cfa81296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:38.253750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88673de-b09c-424e-a0ce-1f74cfa81296 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:38.254055 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88673de-b09c-424e-a0ce-1f74cfa81296 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:38.254325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88673de-b09c-424e-a0ce-1f74cfa81296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:38.263843 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88673de-b09c-424e-a0ce-1f74cfa81296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:38.265419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88673de-b09c-424e-a0ce-1f74cfa81296 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:38.274916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1317/2669] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:41.242654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a7c2d-4562-45a8-a3ec-3fc408d3fb65 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:41.243213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a7c2d-4562-45a8-a3ec-3fc408d3fb65 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:41.243213 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a7c2d-4562-45a8-a3ec-3fc408d3fb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:41.264340 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d11a7c2d-4562-45a8-a3ec-3fc408d3fb65 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:41.265570 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d11a7c2d-4562-45a8-a3ec-3fc408d3fb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:41.274393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1353/2670] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 22 22:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:41.291298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88673de-b09c-424e-a0ce-1f74cfa81296 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:41.303113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88673de-b09c-424e-a0ce-1f74cfa81296 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:41.309311 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f24ec-13b0-4c34-90e1-8187fd428848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:41.309943 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f24ec-13b0-4c34-90e1-8187fd428848 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:41.310213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f24ec-13b0-4c34-90e1-8187fd428848 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:41.310479 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f24ec-13b0-4c34-90e1-8187fd428848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:41.319208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f24ec-13b0-4c34-90e1-8187fd428848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:41.320754 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f24ec-13b0-4c34-90e1-8187fd428848 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:41.330377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1318/2671] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:44.420977 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26505f-7539-4a49-9688-83e8a372e244 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:44.421485 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26505f-7539-4a49-9688-83e8a372e244 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:44.421580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26505f-7539-4a49-9688-83e8a372e244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:44.443125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8a26505f-7539-4a49-9688-83e8a372e244 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:44.444467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8a26505f-7539-4a49-9688-83e8a372e244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:44.453584 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1354/2672] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 22 22:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:44.473451 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f24ec-13b0-4c34-90e1-8187fd428848 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:44.485750 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f24ec-13b0-4c34-90e1-8187fd428848 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:44.492358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd43f18-9532-419c-b3fd-b6a2ac34a331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:44.492959 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd43f18-9532-419c-b3fd-b6a2ac34a331 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:44.493308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd43f18-9532-419c-b3fd-b6a2ac34a331 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:44.493597 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd43f18-9532-419c-b3fd-b6a2ac34a331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:44.502903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd43f18-9532-419c-b3fd-b6a2ac34a331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:44.504485 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd43f18-9532-419c-b3fd-b6a2ac34a331 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:44.514105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1319/2673] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:48.626968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda3c39-c824-49e6-9c4d-707166112c14 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:48.627469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda3c39-c824-49e6-9c4d-707166112c14 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:48.627469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda3c39-c824-49e6-9c4d-707166112c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:48.648576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-abda3c39-c824-49e6-9c4d-707166112c14 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:48.650893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-abda3c39-c824-49e6-9c4d-707166112c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:48.658814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1355/2674] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 22 22:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:48.677445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd43f18-9532-419c-b3fd-b6a2ac34a331 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:48.689074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd43f18-9532-419c-b3fd-b6a2ac34a331 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:48.695321 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543d7ed-6c1e-4ce9-a996-65df20389033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:48.695980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d7ed-6c1e-4ce9-a996-65df20389033 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:48.696287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d7ed-6c1e-4ce9-a996-65df20389033 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:48.696595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d7ed-6c1e-4ce9-a996-65df20389033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:48.705528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543d7ed-6c1e-4ce9-a996-65df20389033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:48.709029 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543d7ed-6c1e-4ce9-a996-65df20389033 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:48.719472 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1320/2675] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:49.110206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb425a3c-ac0a-4956-a697-550ee13837b8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:49.110534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb425a3c-ac0a-4956-a697-550ee13837b8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:49.110803 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb425a3c-ac0a-4956-a697-550ee13837b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:49.130964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cb425a3c-ac0a-4956-a697-550ee13837b8 None None] MFA Rules not processed for user `dcb015b42c2340bda57a3a3eb361de50`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:49.132170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cb425a3c-ac0a-4956-a697-550ee13837b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:49.140226 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1356/2676] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:16:52.804021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543d7ed-6c1e-4ce9-a996-65df20389033 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:52.805765 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2543d7ed-6c1e-4ce9-a996-65df20389033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:52.820410 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543d7ed-6c1e-4ce9-a996-65df20389033 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:52.827246 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:52.827957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:52.828235 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:52.828520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] PATH_INFO: `/v3/users/0e1dec81bb7247f2ad32de847a8b32bb` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:52.829674 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1dec81bb7247f2ad32de847a8b32bb)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:52.831601 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:52.883947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1dec81bb7247f2ad32de847a8b32bb'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:52.884580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1dec81bb7247f2ad32de847a8b32bb'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:52.894243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1dec81bb7247f2ad32de847a8b32bb'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:52.901889 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1dec81bb7247f2ad32de847a8b32bb'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:52.902550 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1dec81bb7247f2ad32de847a8b32bb'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:52.921622 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1321/2677] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:16:52 2022] DELETE /identity/v3/users/0e1dec81bb7247f2ad32de847a8b32bb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:52.926552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2c32d-6161-4dcd-be2e-79e21bf754cf None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:52.927065 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2c32d-6161-4dcd-be2e-79e21bf754cf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:52.927401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2c32d-6161-4dcd-be2e-79e21bf754cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:52.946974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1ca2c32d-6161-4dcd-be2e-79e21bf754cf None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:52.948418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1ca2c32d-6161-4dcd-be2e-79e21bf754cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:52.953469 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:53.008207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1357/2678] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:53.017515 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:53.019042 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:53.055720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:53.085639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d48df-7fc9-49bc-b79d-4dd46bef4eeb admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:53.090159 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef344c-dc04-4456-ba4f-4a4db1d7c3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:53.090880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef344c-dc04-4456-ba4f-4a4db1d7c3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:53.091173 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef344c-dc04-4456-ba4f-4a4db1d7c3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:53.091441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef344c-dc04-4456-ba4f-4a4db1d7c3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:53.102529 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef344c-dc04-4456-ba4f-4a4db1d7c3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:53.104096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef344c-dc04-4456-ba4f-4a4db1d7c3f2 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:53.116187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1322/2679] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:53.476770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2c32d-6161-4dcd-be2e-79e21bf754cf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:53.478274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1ca2c32d-6161-4dcd-be2e-79e21bf754cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:53.491053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2c32d-6161-4dcd-be2e-79e21bf754cf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:53.495758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:53.496393 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:53.496704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:53.497243 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] PATH_INFO: `/v3/projects/c20949ca20d942799093267161f4d3b5` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:53.498465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20949ca20d942799093267161f4d3b5)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:53.500403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:53.555556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20949ca20d942799093267161f4d3b5', 'request_id': 'req-cf635db7-68de-4514-8450-1100f6ef593d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:53.563883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20949ca20d942799093267161f4d3b5', 'request_id': 'req-cf635db7-68de-4514-8450-1100f6ef593d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:53.569713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20949ca20d942799093267161f4d3b5', 'request_id': 'req-cf635db7-68de-4514-8450-1100f6ef593d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:53.586076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] The token cache is being invalidate because project c20949ca20d942799093267161f4d3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:16:53.586363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:53.587010 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cf635db7-68de-4514-8450-1100f6ef593d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:16:53.588559 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1358/2680] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:16:53 2022] DELETE /identity/v3/projects/c20949ca20d942799093267161f4d3b5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:16:53.593594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b75c3-b95a-4256-b0f0-8c15f1a06ab1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:53.593967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b75c3-b95a-4256-b0f0-8c15f1a06ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:53.594287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b75c3-b95a-4256-b0f0-8c15f1a06ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:53.614723 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-894b75c3-b95a-4256-b0f0-8c15f1a06ab1 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:53.616001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-894b75c3-b95a-4256-b0f0-8c15f1a06ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:53.673877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1323/2681] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:53.682114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b0618-3d39-4434-8add-0cada12b75bc None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:53.682431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b0618-3d39-4434-8add-0cada12b75bc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:53.682700 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b0618-3d39-4434-8add-0cada12b75bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:53.704039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-116b0618-3d39-4434-8add-0cada12b75bc None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:53.705161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-116b0618-3d39-4434-8add-0cada12b75bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:53.713944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1359/2682] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:53.718349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b75c3-b95a-4256-b0f0-8c15f1a06ab1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:53.728375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b75c3-b95a-4256-b0f0-8c15f1a06ab1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:53.733513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317c6b7-4b66-475f-9879-659583ca2674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:53.734145 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c6b7-4b66-475f-9879-659583ca2674 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:53.734419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c6b7-4b66-475f-9879-659583ca2674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:53.734686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c6b7-4b66-475f-9879-659583ca2674 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:53.735672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317c6b7-4b66-475f-9879-659583ca2674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:16:53.735968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317c6b7-4b66-475f-9879-659583ca2674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:53.737578 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317c6b7-4b66-475f-9879-659583ca2674 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:53.749851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1324/2683] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:16:53.755799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b0618-3d39-4434-8add-0cada12b75bc None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:53.765608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b0618-3d39-4434-8add-0cada12b75bc None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:53.770981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c53cc-baf2-49a2-8b7d-3503c35813ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:53.771606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c53cc-baf2-49a2-8b7d-3503c35813ec admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:53.771906 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c53cc-baf2-49a2-8b7d-3503c35813ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:53.772159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c53cc-baf2-49a2-8b7d-3503c35813ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:53.772780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c53cc-baf2-49a2-8b7d-3503c35813ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:53.774688 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c53cc-baf2-49a2-8b7d-3503c35813ec admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:53.804322 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1360/2684] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:16:53 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:53.809303 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317c6b7-4b66-475f-9879-659583ca2674 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:53.819933 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317c6b7-4b66-475f-9879-659583ca2674 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:53.880733 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4b326-d94b-402e-8d07-7c4c45679591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:53.881334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4b326-d94b-402e-8d07-7c4c45679591 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:53.881606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4b326-d94b-402e-8d07-7c4c45679591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:53.881869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4b326-d94b-402e-8d07-7c4c45679591 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:53.882508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4b326-d94b-402e-8d07-7c4c45679591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:53.884469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4b326-d94b-402e-8d07-7c4c45679591 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:53.908756 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1325/2685] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:16:53 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:16:53.913088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c53cc-baf2-49a2-8b7d-3503c35813ec admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:53.924217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c53cc-baf2-49a2-8b7d-3503c35813ec admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:53.929057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1a7b-0c8b-45b4-b06d-f05794818be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:53.929676 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1a7b-0c8b-45b4-b06d-f05794818be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:53.929937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1a7b-0c8b-45b4-b06d-f05794818be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:53.930202 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1a7b-0c8b-45b4-b06d-f05794818be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:53.930844 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a1a7b-0c8b-45b4-b06d-f05794818be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:53.933004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a1a7b-0c8b-45b4-b06d-f05794818be3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:53.942947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1361/2686] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:16:53.947243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4b326-d94b-402e-8d07-7c4c45679591 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:53.962259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4b326-d94b-402e-8d07-7c4c45679591 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:53.968180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a7ef1-f5a4-4cab-8135-9a8f2280fbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:53.968777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a7ef1-f5a4-4cab-8135-9a8f2280fbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:53.969047 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a7ef1-f5a4-4cab-8135-9a8f2280fbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:53.969308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a7ef1-f5a4-4cab-8135-9a8f2280fbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:53.969987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a7ef1-f5a4-4cab-8135-9a8f2280fbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:53.971586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a7ef1-f5a4-4cab-8135-9a8f2280fbd7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:53.983182 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1326/2687] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:16:53.988074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1a7b-0c8b-45b4-b06d-f05794818be3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:53.998731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1a7b-0c8b-45b4-b06d-f05794818be3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:54.004276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75342f-101c-4fd3-9567-aafd740619a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:54.004926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75342f-101c-4fd3-9567-aafd740619a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:54.005222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75342f-101c-4fd3-9567-aafd740619a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:54.005490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75342f-101c-4fd3-9567-aafd740619a9 admin admin] PATH_INFO: `/v3/projects/bf537f198893480083a76e208aea5f7f/users/2247d9f65ac044cf8c8b1a42d1535b60/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:54.020241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75342f-101c-4fd3-9567-aafd740619a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf537f198893480083a76e208aea5f7f, user_id=2247d9f65ac044cf8c8b1a42d1535b60, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:54.022913 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75342f-101c-4fd3-9567-aafd740619a9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:54.038951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1362/2688] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:16:53 2022] PUT /identity/v3/projects/bf537f198893480083a76e208aea5f7f/users/2247d9f65ac044cf8c8b1a42d1535b60/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:16:54.056287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbd711-d2b2-40dc-a40c-772115247c10 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:54.056716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbd711-d2b2-40dc-a40c-772115247c10 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:54.057214 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbd711-d2b2-40dc-a40c-772115247c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:54.085401 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-73fbd711-d2b2-40dc-a40c-772115247c10 None None] MFA Rules not processed for user `2247d9f65ac044cf8c8b1a42d1535b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:16:54.086629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-73fbd711-d2b2-40dc-a40c-772115247c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:54.112631 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:54.156570 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1327/2689] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:16:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:16:54.168287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75342f-101c-4fd3-9567-aafd740619a9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:54.170273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bd75342f-101c-4fd3-9567-aafd740619a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:54.208887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:54.234952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75342f-101c-4fd3-9567-aafd740619a9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:54.239094 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a56f48-b415-42a4-8943-436104b8e227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:54.239694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56f48-b415-42a4-8943-436104b8e227 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:54.239964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56f48-b415-42a4-8943-436104b8e227 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:54.240225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56f48-b415-42a4-8943-436104b8e227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:54.249904 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a56f48-b415-42a4-8943-436104b8e227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:54.251414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a56f48-b415-42a4-8943-436104b8e227 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:54.261475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1363/2690] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:16:59.163031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbd711-d2b2-40dc-a40c-772115247c10 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:16:59.164657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-73fbd711-d2b2-40dc-a40c-772115247c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:59.242595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbd711-d2b2-40dc-a40c-772115247c10 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:16:59.249142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ea327-12da-4e7f-b84c-fa8c9c14a5fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:16:59.249758 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ea327-12da-4e7f-b84c-fa8c9c14a5fa service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:16:59.250068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ea327-12da-4e7f-b84c-fa8c9c14a5fa service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:16:59.250340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ea327-12da-4e7f-b84c-fa8c9c14a5fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:16:59.252124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3f8ea327-12da-4e7f-b84c-fa8c9c14a5fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:16:59.270085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ea327-12da-4e7f-b84c-fa8c9c14a5fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:16:59.270085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ea327-12da-4e7f-b84c-fa8c9c14a5fa service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:16:59.278940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1328/2691] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:16:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:04.256368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=12 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:04.500633 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a56f48-b415-42a4-8943-436104b8e227 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:04.569462 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a56f48-b415-42a4-8943-436104b8e227 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:04.576622 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee0a0f-21d7-465e-af9c-7050aa25144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:04.577535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee0a0f-21d7-465e-af9c-7050aa25144b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:04.577811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee0a0f-21d7-465e-af9c-7050aa25144b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:04.578178 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee0a0f-21d7-465e-af9c-7050aa25144b admin admin] PATH_INFO: `/v3/users/2247d9f65ac044cf8c8b1a42d1535b60` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:04.580012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee0a0f-21d7-465e-af9c-7050aa25144b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2247d9f65ac044cf8c8b1a42d1535b60)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:04.583025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee0a0f-21d7-465e-af9c-7050aa25144b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:04.640547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-eeee0a0f-21d7-465e-af9c-7050aa25144b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2247d9f65ac044cf8c8b1a42d1535b60'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:04.648273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-eeee0a0f-21d7-465e-af9c-7050aa25144b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2247d9f65ac044cf8c8b1a42d1535b60'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:04.649061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-eeee0a0f-21d7-465e-af9c-7050aa25144b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2247d9f65ac044cf8c8b1a42d1535b60'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:04.656252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-eeee0a0f-21d7-465e-af9c-7050aa25144b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2247d9f65ac044cf8c8b1a42d1535b60'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:04.668115 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-eeee0a0f-21d7-465e-af9c-7050aa25144b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2247d9f65ac044cf8c8b1a42d1535b60'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:04.674405 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1364/2692] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:17:04 2022] DELETE /identity/v3/users/2247d9f65ac044cf8c8b1a42d1535b60 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:04.679119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec3e2-77a4-4ffc-be07-24325b1d3ff4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:04.679607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec3e2-77a4-4ffc-be07-24325b1d3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:04.679607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec3e2-77a4-4ffc-be07-24325b1d3ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:04.701343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-475ec3e2-77a4-4ffc-be07-24325b1d3ff4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:04.702625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-475ec3e2-77a4-4ffc-be07-24325b1d3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:04.812939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a7b24-9329-4b4b-97eb-5773424edbd5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:04.813187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a7b24-9329-4b4b-97eb-5773424edbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:04.813483 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a7b24-9329-4b4b-97eb-5773424edbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:04.852556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-399a7b24-9329-4b4b-97eb-5773424edbd5 None None] MFA Rules not processed for user `ecb55920b3334d0db3bb8934094ba28c`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:04.854464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-399a7b24-9329-4b4b-97eb-5773424edbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:04.913776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1329/2693] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:04.917191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1365/2694] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:04.924254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ec3e2-77a4-4ffc-be07-24325b1d3ff4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:04.925893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-475ec3e2-77a4-4ffc-be07-24325b1d3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:04.996865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ec3e2-77a4-4ffc-be07-24325b1d3ff4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:05.000732 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4e094-ce76-4603-b430-b96605a99d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:05.001340 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e094-ce76-4603-b430-b96605a99d62 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:05.001638 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e094-ce76-4603-b430-b96605a99d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:05.001939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e094-ce76-4603-b430-b96605a99d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:05.007798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:05.012182 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4e094-ce76-4603-b430-b96605a99d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:05.013602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4e094-ce76-4603-b430-b96605a99d62 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:05.023569 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1330/2695] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:05.554759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a7b24-9329-4b4b-97eb-5773424edbd5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:05.556421 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-399a7b24-9329-4b4b-97eb-5773424edbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:05.570482 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a7b24-9329-4b4b-97eb-5773424edbd5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:05.575663 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:05.576810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:05.577239 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:05.577929 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] PATH_INFO: `/v3/projects/bf537f198893480083a76e208aea5f7f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:05.579490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf537f198893480083a76e208aea5f7f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:05.581536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:05.605221 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:05.647027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf537f198893480083a76e208aea5f7f', 'request_id': 'req-2e5dc293-3bbb-49a1-99d8-b07356d5c495'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:05.656353 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf537f198893480083a76e208aea5f7f', 'request_id': 'req-2e5dc293-3bbb-49a1-99d8-b07356d5c495'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:05.666228 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf537f198893480083a76e208aea5f7f', 'request_id': 'req-2e5dc293-3bbb-49a1-99d8-b07356d5c495'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:05.686433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] The token cache is being invalidate because project bf537f198893480083a76e208aea5f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:17:05.686724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:05.687870 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2e5dc293-3bbb-49a1-99d8-b07356d5c495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:05.689874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1366/2696] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:17:05 2022] DELETE /identity/v3/projects/bf537f198893480083a76e208aea5f7f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:05.694439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e437aa-e203-43d8-a581-02135c53107c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:05.694929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e437aa-e203-43d8-a581-02135c53107c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:05.696003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e437aa-e203-43d8-a581-02135c53107c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:05.746915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-42e437aa-e203-43d8-a581-02135c53107c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:05.748439 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-42e437aa-e203-43d8-a581-02135c53107c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:05.819680 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1331/2697] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:17:05.827997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa95f57-4672-4482-922e-95ebcdd96db6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:05.828297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa95f57-4672-4482-922e-95ebcdd96db6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:05.828544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa95f57-4672-4482-922e-95ebcdd96db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:05.851476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1fa95f57-4672-4482-922e-95ebcdd96db6 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:05.852752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1fa95f57-4672-4482-922e-95ebcdd96db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:05.863597 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1367/2698] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:05.868397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e437aa-e203-43d8-a581-02135c53107c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:05.879739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e437aa-e203-43d8-a581-02135c53107c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:05.884764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bb36f-4072-4e97-9943-c4df07378cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:05.885369 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bb36f-4072-4e97-9943-c4df07378cda admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:05.885654 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bb36f-4072-4e97-9943-c4df07378cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:05.886031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bb36f-4072-4e97-9943-c4df07378cda admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:05.886646 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bb36f-4072-4e97-9943-c4df07378cda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:17:05.887000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bb36f-4072-4e97-9943-c4df07378cda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:05.888837 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bb36f-4072-4e97-9943-c4df07378cda admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:05.917567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1332/2699] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:17:05.918804 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa95f57-4672-4482-922e-95ebcdd96db6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:05.937161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa95f57-4672-4482-922e-95ebcdd96db6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:05.943088 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52742476-43bd-4378-9fcb-3d511d91f233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:05.943710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742476-43bd-4378-9fcb-3d511d91f233 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:05.943987 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742476-43bd-4378-9fcb-3d511d91f233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:05.944381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742476-43bd-4378-9fcb-3d511d91f233 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:05.944900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52742476-43bd-4378-9fcb-3d511d91f233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:05.946878 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52742476-43bd-4378-9fcb-3d511d91f233 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:05.980271 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1368/2700] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:05 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:17:05.984371 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bb36f-4072-4e97-9943-c4df07378cda admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:05.996797 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bb36f-4072-4e97-9943-c4df07378cda admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:06.071112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ac5d7-728f-47f6-8ad3-d0472631c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:06.071655 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac5d7-728f-47f6-8ad3-d0472631c98c admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:06.071931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac5d7-728f-47f6-8ad3-d0472631c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:06.072225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac5d7-728f-47f6-8ad3-d0472631c98c admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:06.072831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ac5d7-728f-47f6-8ad3-d0472631c98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:06.074775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ac5d7-728f-47f6-8ad3-d0472631c98c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:06.098000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1333/2701] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:05 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:06.102294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52742476-43bd-4378-9fcb-3d511d91f233 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:06.115138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52742476-43bd-4378-9fcb-3d511d91f233 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:06.122104 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf0866-641b-4fdd-9165-14e584e73354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:06.122724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf0866-641b-4fdd-9165-14e584e73354 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:06.122999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf0866-641b-4fdd-9165-14e584e73354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:06.123264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf0866-641b-4fdd-9165-14e584e73354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:06.124272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf0866-641b-4fdd-9165-14e584e73354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:06.126090 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf0866-641b-4fdd-9165-14e584e73354 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:06.137049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1369/2702] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:06.141466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ac5d7-728f-47f6-8ad3-d0472631c98c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:06.152353 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ac5d7-728f-47f6-8ad3-d0472631c98c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:06.158866 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecb051-b255-4e37-9931-3cafa2a44a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:06.159505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecb051-b255-4e37-9931-3cafa2a44a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:06.159781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecb051-b255-4e37-9931-3cafa2a44a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:06.160112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecb051-b255-4e37-9931-3cafa2a44a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:06.160896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecb051-b255-4e37-9931-3cafa2a44a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:06.162611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecb051-b255-4e37-9931-3cafa2a44a28 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:06.177967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1334/2703] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:06.179216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf0866-641b-4fdd-9165-14e584e73354 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:06.191906 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf0866-641b-4fdd-9165-14e584e73354 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:06.197327 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b14c3-24e6-4463-8b7c-7c2848180a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:06.198024 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b14c3-24e6-4463-8b7c-7c2848180a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:06.198299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b14c3-24e6-4463-8b7c-7c2848180a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:06.198569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b14c3-24e6-4463-8b7c-7c2848180a90 admin admin] PATH_INFO: `/v3/projects/a319629d43b94fccbafcd26017b6d4ee/users/dc21667714ed48ca9f616d561ca9bc95/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:06.219834 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b14c3-24e6-4463-8b7c-7c2848180a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a319629d43b94fccbafcd26017b6d4ee, user_id=dc21667714ed48ca9f616d561ca9bc95, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:06.222504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b14c3-24e6-4463-8b7c-7c2848180a90 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:06.239031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1370/2704] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:06 2022] PUT /identity/v3/projects/a319629d43b94fccbafcd26017b6d4ee/users/dc21667714ed48ca9f616d561ca9bc95/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:17:06.244431 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae8d1b-9011-46a0-9805-bdf2849df0e5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:06.244827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae8d1b-9011-46a0-9805-bdf2849df0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:06.245185 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae8d1b-9011-46a0-9805-bdf2849df0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:06.265781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d2ae8d1b-9011-46a0-9805-bdf2849df0e5 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:06.267170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d2ae8d1b-9011-46a0-9805-bdf2849df0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:06.335180 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:06.353258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1335/2705] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:06.365465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b14c3-24e6-4463-8b7c-7c2848180a90 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:06.369944 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-db0b14c3-24e6-4463-8b7c-7c2848180a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:06.431897 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b14c3-24e6-4463-8b7c-7c2848180a90 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:06.435490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e412a69-0a9e-4f10-9997-c72e7ef86fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:06.436123 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412a69-0a9e-4f10-9997-c72e7ef86fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:06.436392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412a69-0a9e-4f10-9997-c72e7ef86fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:06.436654 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412a69-0a9e-4f10-9997-c72e7ef86fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:06.446027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e412a69-0a9e-4f10-9997-c72e7ef86fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:06.447605 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e412a69-0a9e-4f10-9997-c72e7ef86fc5 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:06.457189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1371/2706] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:17:07.180108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f105d7-710c-4a06-aaba-45ba79f2b28b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:07.180633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f105d7-710c-4a06-aaba-45ba79f2b28b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:07.181083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f105d7-710c-4a06-aaba-45ba79f2b28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:07.205752 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-53f105d7-710c-4a06-aaba-45ba79f2b28b None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:07.207309 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-53f105d7-710c-4a06-aaba-45ba79f2b28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:07.273408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1336/2707] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:17:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:07.300108 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e412a69-0a9e-4f10-9997-c72e7ef86fc5 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:07.301699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3e412a69-0a9e-4f10-9997-c72e7ef86fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:07.356704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:07.387308 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e412a69-0a9e-4f10-9997-c72e7ef86fc5 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:07.393059 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb4880-4a8a-4c54-9e12-8be0b0973cc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:07.393951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb4880-4a8a-4c54-9e12-8be0b0973cc9 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:07.394524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb4880-4a8a-4c54-9e12-8be0b0973cc9 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:07.394957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb4880-4a8a-4c54-9e12-8be0b0973cc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:07.404179 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb4880-4a8a-4c54-9e12-8be0b0973cc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:07.406645 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb4880-4a8a-4c54-9e12-8be0b0973cc9 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:07.416225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1372/2708] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:17:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:17:13.291849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893900-8d9f-4644-98d0-3d013b15c696 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:13.292960 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893900-8d9f-4644-98d0-3d013b15c696 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:13.293388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893900-8d9f-4644-98d0-3d013b15c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:13.341771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-db893900-8d9f-4644-98d0-3d013b15c696 None None] MFA Rules not processed for user `dc21667714ed48ca9f616d561ca9bc95`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:13.343532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-db893900-8d9f-4644-98d0-3d013b15c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:13.449602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1337/2709] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:13.455710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb4880-4a8a-4c54-9e12-8be0b0973cc9 service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:13.472740 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb4880-4a8a-4c54-9e12-8be0b0973cc9 service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:13.479796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120345b-e030-4a97-9d02-5cb6dbcab3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:13.480814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120345b-e030-4a97-9d02-5cb6dbcab3aa admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:13.481339 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120345b-e030-4a97-9d02-5cb6dbcab3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:13.481869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120345b-e030-4a97-9d02-5cb6dbcab3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:13.482952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120345b-e030-4a97-9d02-5cb6dbcab3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:13.486959 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120345b-e030-4a97-9d02-5cb6dbcab3aa admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:13.543771 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1373/2710] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:13 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:13.544783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db893900-8d9f-4644-98d0-3d013b15c696 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:13.567192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db893900-8d9f-4644-98d0-3d013b15c696 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:13.667742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e0c55-b72c-4ec0-ba14-b207b3bc177c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:13.668568 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e0c55-b72c-4ec0-ba14-b207b3bc177c admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:13.668904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e0c55-b72c-4ec0-ba14-b207b3bc177c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:13.669330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e0c55-b72c-4ec0-ba14-b207b3bc177c admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:13.670081 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e0c55-b72c-4ec0-ba14-b207b3bc177c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:13.677448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e0c55-b72c-4ec0-ba14-b207b3bc177c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:13.712687 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1338/2711] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:13 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:13.717094 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120345b-e030-4a97-9d02-5cb6dbcab3aa admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:13.728745 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120345b-e030-4a97-9d02-5cb6dbcab3aa admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:13.733723 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e6dab-a61e-4cc6-9097-2f5a2f46f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:13.735092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e6dab-a61e-4cc6-9097-2f5a2f46f831 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:13.736556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e6dab-a61e-4cc6-9097-2f5a2f46f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:13.736822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e6dab-a61e-4cc6-9097-2f5a2f46f831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:13.737580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e6dab-a61e-4cc6-9097-2f5a2f46f831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:13.739183 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e6dab-a61e-4cc6-9097-2f5a2f46f831 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:13.763119 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e0c55-b72c-4ec0-ba14-b207b3bc177c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:13.773200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1374/2712] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:13.778273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e0c55-b72c-4ec0-ba14-b207b3bc177c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:13.787275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa9a9-dfbd-49f7-bccf-d246936e1c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:13.788378 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa9a9-dfbd-49f7-bccf-d246936e1c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:13.788828 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa9a9-dfbd-49f7-bccf-d246936e1c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:13.789096 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa9a9-dfbd-49f7-bccf-d246936e1c84 admin admin] PATH_INFO: `/v3/projects/82f7a72f93b14ea49780f2133f574cea/users/f634630f68ae4ede97e083eb7731e0f6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:13.807645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fa9a9-dfbd-49f7-bccf-d246936e1c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f7a72f93b14ea49780f2133f574cea, user_id=f634630f68ae4ede97e083eb7731e0f6, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:13.810334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fa9a9-dfbd-49f7-bccf-d246936e1c84 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:13.821213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:13.830878 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1339/2713] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:13 2022] PUT /identity/v3/projects/82f7a72f93b14ea49780f2133f574cea/users/f634630f68ae4ede97e083eb7731e0f6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:13.832326 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e6dab-a61e-4cc6-9097-2f5a2f46f831 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:13.844424 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e6dab-a61e-4cc6-9097-2f5a2f46f831 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:13.915967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cff440-b298-4374-855c-93c192324dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:13.916615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff440-b298-4374-855c-93c192324dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:13.916889 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff440-b298-4374-855c-93c192324dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:13.917166 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff440-b298-4374-855c-93c192324dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:13.917924 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cff440-b298-4374-855c-93c192324dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:13.919487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cff440-b298-4374-855c-93c192324dc2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:13.931318 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1375/2714] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:13.935559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa9a9-dfbd-49f7-bccf-d246936e1c84 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:13.949330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa9a9-dfbd-49f7-bccf-d246936e1c84 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:13.954460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bfe72-3482-47ea-9c3f-83d39af689dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:13.955138 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bfe72-3482-47ea-9c3f-83d39af689dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:13.955409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bfe72-3482-47ea-9c3f-83d39af689dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:13.955849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bfe72-3482-47ea-9c3f-83d39af689dd admin admin] PATH_INFO: `/v3/projects/82f7a72f93b14ea49780f2133f574cea/users/f634630f68ae4ede97e083eb7731e0f6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:13.957851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bfe72-3482-47ea-9c3f-83d39af689dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f7a72f93b14ea49780f2133f574cea, user_id=f634630f68ae4ede97e083eb7731e0f6, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:13.960521 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bfe72-3482-47ea-9c3f-83d39af689dd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:13.989548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1340/2715] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:13 2022] PUT /identity/v3/projects/82f7a72f93b14ea49780f2133f574cea/users/f634630f68ae4ede97e083eb7731e0f6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:17:21.659714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12561607-f120-458c-b805-977d5d40038f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:21.660234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12561607-f120-458c-b805-977d5d40038f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:21.660360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12561607-f120-458c-b805-977d5d40038f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:21.730114 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-12561607-f120-458c-b805-977d5d40038f None None] MFA Rules not processed for user `f634630f68ae4ede97e083eb7731e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:21.737634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-12561607-f120-458c-b805-977d5d40038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:21.810930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a52c1-6e1e-46f1-a229-c6849e1c76fa None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:21.811821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a52c1-6e1e-46f1-a229-c6849e1c76fa None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:21.812249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a52c1-6e1e-46f1-a229-c6849e1c76fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:21.863622 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c64a52c1-6e1e-46f1-a229-c6849e1c76fa None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:21.866141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c64a52c1-6e1e-46f1-a229-c6849e1c76fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:21.903389 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1376/2716] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:21.938901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12561607-f120-458c-b805-977d5d40038f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:21.941011 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-12561607-f120-458c-b805-977d5d40038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:21.975602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:22.012314 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1341/2717] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 22 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:17:22.034441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a52c1-6e1e-46f1-a229-c6849e1c76fa None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:22.037008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c64a52c1-6e1e-46f1-a229-c6849e1c76fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:22.064294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12561607-f120-458c-b805-977d5d40038f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:22.071731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c5f2d-5787-4132-a822-f1fe7d94959d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22e60fc95af4a0a94b15f9ed9e3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:22.072519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c5f2d-5787-4132-a822-f1fe7d94959d service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:22.076884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c5f2d-5787-4132-a822-f1fe7d94959d service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:22.077276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c5f2d-5787-4132-a822-f1fe7d94959d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:22.213000 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a52c1-6e1e-46f1-a229-c6849e1c76fa None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:22.218806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c5f2d-5787-4132-a822-f1fe7d94959d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:22.221950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c5f2d-5787-4132-a822-f1fe7d94959d service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:22.239043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77025eb-e0fd-469b-a215-9100e489df3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:22.240318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77025eb-e0fd-469b-a215-9100e489df3e service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:22.240598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77025eb-e0fd-469b-a215-9100e489df3e service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:22.240871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77025eb-e0fd-469b-a215-9100e489df3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:22.258252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1377/2718] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:17:22.261205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77025eb-e0fd-469b-a215-9100e489df3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:22.267065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77025eb-e0fd-469b-a215-9100e489df3e service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:22.290070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1342/2719] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:22.478444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26806007-334d-4c24-a8f4-3d1593195843 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:22.478988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26806007-334d-4c24-a8f4-3d1593195843 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:22.479431 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26806007-334d-4c24-a8f4-3d1593195843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:22.508401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-26806007-334d-4c24-a8f4-3d1593195843 None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:22.509817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-26806007-334d-4c24-a8f4-3d1593195843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:22.618216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1378/2720] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:17:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:22.652237 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77025eb-e0fd-469b-a215-9100e489df3e service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:22.859699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77025eb-e0fd-469b-a215-9100e489df3e service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:22.865602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f97e05-4941-452d-877e-841f74ed5c77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:22.866344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f97e05-4941-452d-877e-841f74ed5c77 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:22.866685 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f97e05-4941-452d-877e-841f74ed5c77 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:22.867162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f97e05-4941-452d-877e-841f74ed5c77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:22.877871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f97e05-4941-452d-877e-841f74ed5c77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:22.879702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f97e05-4941-452d-877e-841f74ed5c77 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:22.904456 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1343/2721] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:17:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:17:25.314928 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eafd46-c09f-4690-95e5-9fc9a0615312 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:25.316215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eafd46-c09f-4690-95e5-9fc9a0615312 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:25.316869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eafd46-c09f-4690-95e5-9fc9a0615312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:25.365618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-47eafd46-c09f-4690-95e5-9fc9a0615312 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:25.367895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-47eafd46-c09f-4690-95e5-9fc9a0615312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:25.392184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1379/2722] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 22 22:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:25.405201 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f97e05-4941-452d-877e-841f74ed5c77 service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:25.407016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-06f97e05-4941-452d-877e-841f74ed5c77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:25.429715 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:25.448219 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f97e05-4941-452d-877e-841f74ed5c77 service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:25.464672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51f9ca-fa3b-4a82-a0e1-ccc299090414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:25.466011 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51f9ca-fa3b-4a82-a0e1-ccc299090414 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:25.466472 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51f9ca-fa3b-4a82-a0e1-ccc299090414 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:25.466907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51f9ca-fa3b-4a82-a0e1-ccc299090414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:25.479432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51f9ca-fa3b-4a82-a0e1-ccc299090414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:25.481313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51f9ca-fa3b-4a82-a0e1-ccc299090414 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:25.497645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1344/2723] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:25.792437 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eafd46-c09f-4690-95e5-9fc9a0615312 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:26.003387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eafd46-c09f-4690-95e5-9fc9a0615312 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:26.013902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6fa59-5f0a-46f3-bb3e-f113cc9ec7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:26.017156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fa59-5f0a-46f3-bb3e-f113cc9ec7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:26.018582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fa59-5f0a-46f3-bb3e-f113cc9ec7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:26.019173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fa59-5f0a-46f3-bb3e-f113cc9ec7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:26.027715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-99c6fa59-5f0a-46f3-bb3e-f113cc9ec7c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:26.060535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6fa59-5f0a-46f3-bb3e-f113cc9ec7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:26.062713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6fa59-5f0a-46f3-bb3e-f113cc9ec7c3 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:26.093424 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1380/2724] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:28.584592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2938ce-0ebf-41b3-98e8-8a62f241b013 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:28.585468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2938ce-0ebf-41b3-98e8-8a62f241b013 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:28.585924 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2938ce-0ebf-41b3-98e8-8a62f241b013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:28.643006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-cc2938ce-0ebf-41b3-98e8-8a62f241b013 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:28.644283 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cc2938ce-0ebf-41b3-98e8-8a62f241b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:28.676464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1345/2725] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 22 22:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:28.694981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6fa59-5f0a-46f3-bb3e-f113cc9ec7c3 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:28.716736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6fa59-5f0a-46f3-bb3e-f113cc9ec7c3 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:28.735137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ddc56-93c3-45f0-8ef4-394babf0e7de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:28.736225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ddc56-93c3-45f0-8ef4-394babf0e7de service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:28.737141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ddc56-93c3-45f0-8ef4-394babf0e7de service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:28.737486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ddc56-93c3-45f0-8ef4-394babf0e7de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:28.762954 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ddc56-93c3-45f0-8ef4-394babf0e7de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:28.777873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ddc56-93c3-45f0-8ef4-394babf0e7de service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:28.814406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1381/2726] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:31.913677 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4394375-115d-42d8-8103-06b009697482 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:31.914463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4394375-115d-42d8-8103-06b009697482 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:31.914463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4394375-115d-42d8-8103-06b009697482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:32.003203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e4394375-115d-42d8-8103-06b009697482 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:32.004441 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e4394375-115d-42d8-8103-06b009697482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:32.033877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1346/2727] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 22 22:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:17:32.050156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ddc56-93c3-45f0-8ef4-394babf0e7de service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:32.070536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ddc56-93c3-45f0-8ef4-394babf0e7de service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:32.087567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049f423-b51c-4519-86f7-b2bb7ec0f3b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:32.088275 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049f423-b51c-4519-86f7-b2bb7ec0f3b9 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:32.088553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049f423-b51c-4519-86f7-b2bb7ec0f3b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:32.088879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049f423-b51c-4519-86f7-b2bb7ec0f3b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:32.103054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:32.109094 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049f423-b51c-4519-86f7-b2bb7ec0f3b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:32.112968 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049f423-b51c-4519-86f7-b2bb7ec0f3b9 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:32.148787 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1382/2728] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:32.665352 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4394375-115d-42d8-8103-06b009697482 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:32.666846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e4394375-115d-42d8-8103-06b009697482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:32.789623 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049f423-b51c-4519-86f7-b2bb7ec0f3b9 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:32.792049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3049f423-b51c-4519-86f7-b2bb7ec0f3b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:32.818227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049f423-b51c-4519-86f7-b2bb7ec0f3b9 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:32.836452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039797d1-cfd6-4074-90c3-1a39db159d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:32.837267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039797d1-cfd6-4074-90c3-1a39db159d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:32.837625 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039797d1-cfd6-4074-90c3-1a39db159d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:32.841677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039797d1-cfd6-4074-90c3-1a39db159d58 admin admin] PATH_INFO: `/v3/users/fb6cbee941b24530bb6c1bfd61a64a30` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:32.855721 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039797d1-cfd6-4074-90c3-1a39db159d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6cbee941b24530bb6c1bfd61a64a30)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:32.868074 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039797d1-cfd6-4074-90c3-1a39db159d58 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:32.869468 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4394375-115d-42d8-8103-06b009697482 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:32.899412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dbd3d-2c1b-44ad-b7eb-6fc4ef791b40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:32.900046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dbd3d-2c1b-44ad-b7eb-6fc4ef791b40 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:32.900359 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dbd3d-2c1b-44ad-b7eb-6fc4ef791b40 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:32.900688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dbd3d-2c1b-44ad-b7eb-6fc4ef791b40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:32.902883 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c79dbd3d-2c1b-44ad-b7eb-6fc4ef791b40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:32.917181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dbd3d-2c1b-44ad-b7eb-6fc4ef791b40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:32.919184 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dbd3d-2c1b-44ad-b7eb-6fc4ef791b40 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:32.932377 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1347/2729] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:32.961001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-039797d1-cfd6-4074-90c3-1a39db159d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6cbee941b24530bb6c1bfd61a64a30'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:32.972974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-039797d1-cfd6-4074-90c3-1a39db159d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6cbee941b24530bb6c1bfd61a64a30'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:32.973714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-039797d1-cfd6-4074-90c3-1a39db159d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6cbee941b24530bb6c1bfd61a64a30'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:32.995224 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-039797d1-cfd6-4074-90c3-1a39db159d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6cbee941b24530bb6c1bfd61a64a30'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:33.024142 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-039797d1-cfd6-4074-90c3-1a39db159d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6cbee941b24530bb6c1bfd61a64a30'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:33.040856 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1383/2730] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:17:32 2022] DELETE /identity/v3/users/fb6cbee941b24530bb6c1bfd61a64a30 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:17:33.378647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dbd3d-2c1b-44ad-b7eb-6fc4ef791b40 service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:33.407588 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dbd3d-2c1b-44ad-b7eb-6fc4ef791b40 service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:33.524113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:33.525818 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:33.526361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:33.526869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] PATH_INFO: `/v3/projects/43f41f8eaf9e414a8eca5e39763c9455` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:33.528253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f41f8eaf9e414a8eca5e39763c9455)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:33.530854 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:33.636666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f41f8eaf9e414a8eca5e39763c9455', 'request_id': 'req-16971714-d1b3-49e6-9584-c82692aee617'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:33.646517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f41f8eaf9e414a8eca5e39763c9455', 'request_id': 'req-16971714-d1b3-49e6-9584-c82692aee617'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:33.658635 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f41f8eaf9e414a8eca5e39763c9455', 'request_id': 'req-16971714-d1b3-49e6-9584-c82692aee617'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:33.662091 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:33.679645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] The token cache is being invalidate because project 43f41f8eaf9e414a8eca5e39763c9455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:17:33.681526 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:33.684181 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-16971714-d1b3-49e6-9584-c82692aee617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:33.690999 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1348/2731] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:17:33 2022] DELETE /identity/v3/projects/43f41f8eaf9e414a8eca5e39763c9455 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:33.692006 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79da934-be54-46fb-9ca3-88d79c827c50 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:33.692534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79da934-be54-46fb-9ca3-88d79c827c50 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:33.692534 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79da934-be54-46fb-9ca3-88d79c827c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:33.729565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c79da934-be54-46fb-9ca3-88d79c827c50 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:33.731763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c79da934-be54-46fb-9ca3-88d79c827c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:33.907552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1384/2732] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:33.915592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71878b-0357-4710-9b1f-bfad67d71794 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:33.915880 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71878b-0357-4710-9b1f-bfad67d71794 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:33.916151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71878b-0357-4710-9b1f-bfad67d71794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:33.940308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9d71878b-0357-4710-9b1f-bfad67d71794 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:33.941629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9d71878b-0357-4710-9b1f-bfad67d71794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:33.953345 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1349/2733] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:33.957291 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79da934-be54-46fb-9ca3-88d79c827c50 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:33.969386 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79da934-be54-46fb-9ca3-88d79c827c50 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:33.975796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f62671-e30a-4a9d-bf0d-4f44df6cbf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:33.976561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f62671-e30a-4a9d-bf0d-4f44df6cbf47 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:33.976837 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f62671-e30a-4a9d-bf0d-4f44df6cbf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:33.977105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f62671-e30a-4a9d-bf0d-4f44df6cbf47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:33.977764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f62671-e30a-4a9d-bf0d-4f44df6cbf47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:17:33.978099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f62671-e30a-4a9d-bf0d-4f44df6cbf47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:33.979940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f62671-e30a-4a9d-bf0d-4f44df6cbf47 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:33.999194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1385/2734] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:17:34.000753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71878b-0357-4710-9b1f-bfad67d71794 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:34.013208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71878b-0357-4710-9b1f-bfad67d71794 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:34.020430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afcfa9-72a7-4a02-84f5-35d9655c35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:34.021140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afcfa9-72a7-4a02-84f5-35d9655c35f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:34.021494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afcfa9-72a7-4a02-84f5-35d9655c35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:34.022166 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afcfa9-72a7-4a02-84f5-35d9655c35f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:34.023261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afcfa9-72a7-4a02-84f5-35d9655c35f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:34.025236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afcfa9-72a7-4a02-84f5-35d9655c35f6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:34.071500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1350/2735] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:33 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:34.072609 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f62671-e30a-4a9d-bf0d-4f44df6cbf47 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:34.084732 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f62671-e30a-4a9d-bf0d-4f44df6cbf47 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:34.187751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:34.200669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c718e16-e54e-4e93-ab03-37dad0d2d0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:34.201381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c718e16-e54e-4e93-ab03-37dad0d2d0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:34.201867 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c718e16-e54e-4e93-ab03-37dad0d2d0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:34.203257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c718e16-e54e-4e93-ab03-37dad0d2d0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:34.203257 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c718e16-e54e-4e93-ab03-37dad0d2d0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:34.205406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c718e16-e54e-4e93-ab03-37dad0d2d0f9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:34.239731 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1386/2736] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:34 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:34.240964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afcfa9-72a7-4a02-84f5-35d9655c35f6 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:34.254670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afcfa9-72a7-4a02-84f5-35d9655c35f6 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:34.259670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec10a28-4280-41f6-aab4-f86b25922c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:34.260478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec10a28-4280-41f6-aab4-f86b25922c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:34.261030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec10a28-4280-41f6-aab4-f86b25922c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:34.261460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec10a28-4280-41f6-aab4-f86b25922c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:34.262162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec10a28-4280-41f6-aab4-f86b25922c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:34.263947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec10a28-4280-41f6-aab4-f86b25922c98 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:34.279360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1351/2737] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:34.280964 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c718e16-e54e-4e93-ab03-37dad0d2d0f9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:34.294921 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c718e16-e54e-4e93-ab03-37dad0d2d0f9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:34.304488 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504346fd-6739-4d81-b0e0-fa661462d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:34.305414 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504346fd-6739-4d81-b0e0-fa661462d3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:34.305772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504346fd-6739-4d81-b0e0-fa661462d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:34.306262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504346fd-6739-4d81-b0e0-fa661462d3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:34.307055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504346fd-6739-4d81-b0e0-fa661462d3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:34.308770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504346fd-6739-4d81-b0e0-fa661462d3d3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:34.326914 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1387/2738] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:34.328513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec10a28-4280-41f6-aab4-f86b25922c98 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:34.340493 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec10a28-4280-41f6-aab4-f86b25922c98 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:34.346302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14cfc0-2b67-48d4-8a25-bdc3c60e5937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:34.347117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14cfc0-2b67-48d4-8a25-bdc3c60e5937 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:34.347402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14cfc0-2b67-48d4-8a25-bdc3c60e5937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:34.347678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14cfc0-2b67-48d4-8a25-bdc3c60e5937 admin admin] PATH_INFO: `/v3/projects/0b56f2ffb30c4ec1971bef329269f59b/users/fdf64ce00abf4f67b5b03bbcdf86453c/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:34.365688 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14cfc0-2b67-48d4-8a25-bdc3c60e5937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b56f2ffb30c4ec1971bef329269f59b, user_id=fdf64ce00abf4f67b5b03bbcdf86453c, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:34.368407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14cfc0-2b67-48d4-8a25-bdc3c60e5937 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:34.396390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1352/2739] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:34 2022] PUT /identity/v3/projects/0b56f2ffb30c4ec1971bef329269f59b/users/fdf64ce00abf4f67b5b03bbcdf86453c/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:34.399200 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddce196-f249-4dcc-a458-0319faff91fe None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:34.399646 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddce196-f249-4dcc-a458-0319faff91fe None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:34.400073 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddce196-f249-4dcc-a458-0319faff91fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:34.435215 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-eddce196-f249-4dcc-a458-0319faff91fe None None] MFA Rules not processed for user `fdf64ce00abf4f67b5b03bbcdf86453c`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:34.436552 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-eddce196-f249-4dcc-a458-0319faff91fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:34.520923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1388/2740] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:34.525648 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14cfc0-2b67-48d4-8a25-bdc3c60e5937 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:34.607076 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14cfc0-2b67-48d4-8a25-bdc3c60e5937 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:34.613701 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d75351-b9c6-4890-8d05-388ba85b9baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:34.614379 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d75351-b9c6-4890-8d05-388ba85b9baf admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:34.614653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d75351-b9c6-4890-8d05-388ba85b9baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:34.614921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d75351-b9c6-4890-8d05-388ba85b9baf admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:34.615591 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d75351-b9c6-4890-8d05-388ba85b9baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:34.617482 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d75351-b9c6-4890-8d05-388ba85b9baf admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:34.657449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1353/2741] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:34 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:17:34.658695 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddce196-f249-4dcc-a458-0319faff91fe None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:34.670531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddce196-f249-4dcc-a458-0319faff91fe None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:34.743254 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f5b6-f414-400d-be4e-afa555e047e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:34.743975 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f5b6-f414-400d-be4e-afa555e047e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:34.744235 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f5b6-f414-400d-be4e-afa555e047e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:34.744409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f5b6-f414-400d-be4e-afa555e047e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:34.745033 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18f5b6-f414-400d-be4e-afa555e047e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:34.747182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18f5b6-f414-400d-be4e-afa555e047e9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:34.776902 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1389/2742] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:34 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:34.780083 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d75351-b9c6-4890-8d05-388ba85b9baf admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:34.791729 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d75351-b9c6-4890-8d05-388ba85b9baf admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:34.799084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9ab83-b6c6-4e81-9509-1ee3b2deebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:34.799710 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9ab83-b6c6-4e81-9509-1ee3b2deebcc admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:34.799984 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9ab83-b6c6-4e81-9509-1ee3b2deebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:34.800253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9ab83-b6c6-4e81-9509-1ee3b2deebcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:34.800903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9ab83-b6c6-4e81-9509-1ee3b2deebcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:34.802539 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9ab83-b6c6-4e81-9509-1ee3b2deebcc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:34.814965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1354/2743] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:34.819446 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f5b6-f414-400d-be4e-afa555e047e9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:34.831125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f5b6-f414-400d-be4e-afa555e047e9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:34.848890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c673d-3cbc-4532-bbdc-f7a7666d5201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:34.853692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c673d-3cbc-4532-bbdc-f7a7666d5201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:34.854057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c673d-3cbc-4532-bbdc-f7a7666d5201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:34.854423 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c673d-3cbc-4532-bbdc-f7a7666d5201 admin admin] PATH_INFO: `/v3/projects/8837d2f776a048fb948d51faad33512a/users/2d861847144a40049515618170d5632f/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:34.879897 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c673d-3cbc-4532-bbdc-f7a7666d5201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8837d2f776a048fb948d51faad33512a, user_id=2d861847144a40049515618170d5632f, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:34.883209 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c673d-3cbc-4532-bbdc-f7a7666d5201 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:34.918036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9ab83-b6c6-4e81-9509-1ee3b2deebcc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:34.927647 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1390/2744] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:34 2022] PUT /identity/v3/projects/8837d2f776a048fb948d51faad33512a/users/2d861847144a40049515618170d5632f/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:17:34.934257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9ab83-b6c6-4e81-9509-1ee3b2deebcc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:35.019598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d3240-1756-435e-ae99-f288d27223a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:35.020361 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3240-1756-435e-ae99-f288d27223a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:35.020779 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3240-1756-435e-ae99-f288d27223a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:35.021043 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3240-1756-435e-ae99-f288d27223a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:35.021693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d3240-1756-435e-ae99-f288d27223a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:35.023489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d3240-1756-435e-ae99-f288d27223a0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:35.036699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1355/2745] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:35.041158 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c673d-3cbc-4532-bbdc-f7a7666d5201 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:35.055224 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c673d-3cbc-4532-bbdc-f7a7666d5201 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:35.061478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9eca55-7456-4091-a693-1230229fc4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:35.062361 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eca55-7456-4091-a693-1230229fc4ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:35.062704 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eca55-7456-4091-a693-1230229fc4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:35.063040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eca55-7456-4091-a693-1230229fc4ca admin admin] PATH_INFO: `/v3/projects/8837d2f776a048fb948d51faad33512a/users/2d861847144a40049515618170d5632f/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:35.065062 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9eca55-7456-4091-a693-1230229fc4ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8837d2f776a048fb948d51faad33512a, user_id=2d861847144a40049515618170d5632f, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:35.067810 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9eca55-7456-4091-a693-1230229fc4ca admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:35.094432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1391/2746] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:35 2022] PUT /identity/v3/projects/8837d2f776a048fb948d51faad33512a/users/2d861847144a40049515618170d5632f/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:17:35.106458 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eb92b-f7e0-4c63-9044-0402043ad833 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:35.107082 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eb92b-f7e0-4c63-9044-0402043ad833 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:35.107518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eb92b-f7e0-4c63-9044-0402043ad833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:35.119226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:35.170464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-621eb92b-f7e0-4c63-9044-0402043ad833 None None] MFA Rules not processed for user `2d861847144a40049515618170d5632f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:35.171931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-621eb92b-f7e0-4c63-9044-0402043ad833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:35.235830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de853b-6852-41b0-b612-2d1e83dca639 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:35.236555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de853b-6852-41b0-b612-2d1e83dca639 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:35.236730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de853b-6852-41b0-b612-2d1e83dca639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:35.302284 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-33de853b-6852-41b0-b612-2d1e83dca639 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:35.306299 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-33de853b-6852-41b0-b612-2d1e83dca639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:35.327665 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:35.360666 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1356/2747] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:35.362523 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b65b-0eb5-493d-8017-0703c550d7ea None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:35.362810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b65b-0eb5-493d-8017-0703c550d7ea None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:35.363085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b65b-0eb5-493d-8017-0703c550d7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:35.385490 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b4d0b65b-0eb5-493d-8017-0703c550d7ea None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:35.386679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b4d0b65b-0eb5-493d-8017-0703c550d7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:35.409371 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1392/2748] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 22 22:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:35.410716 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de853b-6852-41b0-b612-2d1e83dca639 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:35.412567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-33de853b-6852-41b0-b612-2d1e83dca639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:35.456989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1357/2749] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 22 22:17:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:35.457996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0b65b-0eb5-493d-8017-0703c550d7ea None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:35.459374 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b4d0b65b-0eb5-493d-8017-0703c550d7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:35.483940 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de853b-6852-41b0-b612-2d1e83dca639 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:35.488478 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aabc5f-f45c-4aa3-941f-3edb2d0d8b14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:35.489105 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aabc5f-f45c-4aa3-941f-3edb2d0d8b14 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:35.489388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aabc5f-f45c-4aa3-941f-3edb2d0d8b14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:35.489657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aabc5f-f45c-4aa3-941f-3edb2d0d8b14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:35.500007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aabc5f-f45c-4aa3-941f-3edb2d0d8b14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:35.501385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aabc5f-f45c-4aa3-941f-3edb2d0d8b14 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:35.512093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1393/2750] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:35.512728 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aabc5f-f45c-4aa3-941f-3edb2d0d8b14 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:35.514076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-20aabc5f-f45c-4aa3-941f-3edb2d0d8b14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:35.549311 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0b65b-0eb5-493d-8017-0703c550d7ea None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:35.556419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b48cc-d6ed-42a2-b493-bebb90e98d92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:35.557147 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b48cc-d6ed-42a2-b493-bebb90e98d92 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:35.557428 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b48cc-d6ed-42a2-b493-bebb90e98d92 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:35.557799 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b48cc-d6ed-42a2-b493-bebb90e98d92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:35.567684 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b48cc-d6ed-42a2-b493-bebb90e98d92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:35.569532 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b48cc-d6ed-42a2-b493-bebb90e98d92 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:35.580947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1358/2751] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:35.591211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b48cc-d6ed-42a2-b493-bebb90e98d92 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:35.592408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-667b48cc-d6ed-42a2-b493-bebb90e98d92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:35.607602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aabc5f-f45c-4aa3-941f-3edb2d0d8b14 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:35.609118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b48cc-d6ed-42a2-b493-bebb90e98d92 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:35.614153 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4bcdd-a006-4415-84be-923174554b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:35.615691 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f7edd-cc68-4d23-8209-804a3fd3c446 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:35.616440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f7edd-cc68-4d23-8209-804a3fd3c446 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:35.617004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f7edd-cc68-4d23-8209-804a3fd3c446 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:35.617422 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f7edd-cc68-4d23-8209-804a3fd3c446 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:35.618058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4bcdd-a006-4415-84be-923174554b8a service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:35.618343 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4bcdd-a006-4415-84be-923174554b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:35.618617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4bcdd-a006-4415-84be-923174554b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:35.629281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f7edd-cc68-4d23-8209-804a3fd3c446 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:35.632269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f7edd-cc68-4d23-8209-804a3fd3c446 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:35.636411 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:35.644363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1394/2752] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:17:35.705278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4bcdd-a006-4415-84be-923174554b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:35.707080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4bcdd-a006-4415-84be-923174554b8a service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:35.725007 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1359/2753] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:17:37.016087 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c531102-1faa-498a-a3e8-88ddfab32947 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:37.016748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c531102-1faa-498a-a3e8-88ddfab32947 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:37.016748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c531102-1faa-498a-a3e8-88ddfab32947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:37.041636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3c531102-1faa-498a-a3e8-88ddfab32947 None None] MFA Rules not processed for user `dc21667714ed48ca9f616d561ca9bc95`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:37.042922 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3c531102-1faa-498a-a3e8-88ddfab32947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:37.087323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:37.103112 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1395/2754] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:37.623524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4bcdd-a006-4415-84be-923174554b8a service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:37.625945 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-59c4bcdd-a006-4415-84be-923174554b8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:37.689741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4bcdd-a006-4415-84be-923174554b8a service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:37.693907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4fed5-9784-417a-85e0-2d321877b31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:37.694525 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4fed5-9784-417a-85e0-2d321877b31a service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:37.694820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4fed5-9784-417a-85e0-2d321877b31a service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:37.695079 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4fed5-9784-417a-85e0-2d321877b31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:37.697068 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-18e4fed5-9784-417a-85e0-2d321877b31a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:37.708788 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4fed5-9784-417a-85e0-2d321877b31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:37.710384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4fed5-9784-417a-85e0-2d321877b31a service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:37.719882 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1360/2755] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:17:38.151580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c531102-1faa-498a-a3e8-88ddfab32947 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:38.153012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3c531102-1faa-498a-a3e8-88ddfab32947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:38.229072 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c531102-1faa-498a-a3e8-88ddfab32947 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:38.235334 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9094f-b0ba-4997-a0d5-baa2b55e33a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:38.236418 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9094f-b0ba-4997-a0d5-baa2b55e33a1 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:38.236711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9094f-b0ba-4997-a0d5-baa2b55e33a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:38.237191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9094f-b0ba-4997-a0d5-baa2b55e33a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:38.239075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-06f9094f-b0ba-4997-a0d5-baa2b55e33a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:38.251092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4fed5-9784-417a-85e0-2d321877b31a service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:38.252013 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9094f-b0ba-4997-a0d5-baa2b55e33a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:38.252675 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-18e4fed5-9784-417a-85e0-2d321877b31a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:38.254992 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9094f-b0ba-4997-a0d5-baa2b55e33a1 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:38.266935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1396/2756] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:38.268134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4fed5-9784-417a-85e0-2d321877b31a service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:38.272834 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49b976-61ec-4ce5-bc15-d8b741f516da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:38.273464 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49b976-61ec-4ce5-bc15-d8b741f516da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:38.273772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49b976-61ec-4ce5-bc15-d8b741f516da admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:38.274241 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49b976-61ec-4ce5-bc15-d8b741f516da admin admin] PATH_INFO: `/v3/users/dcb015b42c2340bda57a3a3eb361de50` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:38.275606 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49b976-61ec-4ce5-bc15-d8b741f516da admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb015b42c2340bda57a3a3eb361de50)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:38.277586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49b976-61ec-4ce5-bc15-d8b741f516da admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:38.365140 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1b49b976-61ec-4ce5-bc15-d8b741f516da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb015b42c2340bda57a3a3eb361de50'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:38.366583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1b49b976-61ec-4ce5-bc15-d8b741f516da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb015b42c2340bda57a3a3eb361de50'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:38.376661 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1b49b976-61ec-4ce5-bc15-d8b741f516da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb015b42c2340bda57a3a3eb361de50'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:38.385629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1b49b976-61ec-4ce5-bc15-d8b741f516da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb015b42c2340bda57a3a3eb361de50'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:38.386396 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1b49b976-61ec-4ce5-bc15-d8b741f516da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb015b42c2340bda57a3a3eb361de50'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:38.407480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1361/2757] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:17:38 2022] DELETE /identity/v3/users/dcb015b42c2340bda57a3a3eb361de50 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:38.617444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9094f-b0ba-4997-a0d5-baa2b55e33a1 service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:38.630305 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9094f-b0ba-4997-a0d5-baa2b55e33a1 service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:38.713007 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:38.713917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:38.714263 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:38.714694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] PATH_INFO: `/v3/projects/b906c93a04b242b39c10475541341dab` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:38.715965 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b906c93a04b242b39c10475541341dab)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:38.717984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:38.775297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b906c93a04b242b39c10475541341dab', 'request_id': 'req-31652c4d-b2b8-400b-b8f5-50e8e850ed10'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:38.784572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b906c93a04b242b39c10475541341dab', 'request_id': 'req-31652c4d-b2b8-400b-b8f5-50e8e850ed10'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:38.793249 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b906c93a04b242b39c10475541341dab', 'request_id': 'req-31652c4d-b2b8-400b-b8f5-50e8e850ed10'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:38.806218 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] The token cache is being invalidate because project b906c93a04b242b39c10475541341dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:17:38.806507 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:38.807262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-31652c4d-b2b8-400b-b8f5-50e8e850ed10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:38.809887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1397/2758] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:17:38 2022] DELETE /identity/v3/projects/b906c93a04b242b39c10475541341dab => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:38.815928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79a310-7ea0-486f-b4f8-ca4d20d37f26 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:38.816448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79a310-7ea0-486f-b4f8-ca4d20d37f26 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:38.820991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79a310-7ea0-486f-b4f8-ca4d20d37f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:38.846463 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4d79a310-7ea0-486f-b4f8-ca4d20d37f26 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:38.848002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4d79a310-7ea0-486f-b4f8-ca4d20d37f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:38.876731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:38.930332 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1362/2759] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:39.004884 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c4b8-b32d-4504-87a7-430754db1c89 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.005169 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c4b8-b32d-4504-87a7-430754db1c89 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.005440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c4b8-b32d-4504-87a7-430754db1c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.029233 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6bc3c4b8-b32d-4504-87a7-430754db1c89 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:39.030385 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6bc3c4b8-b32d-4504-87a7-430754db1c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:39.039849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1398/2760] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:39.044336 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79a310-7ea0-486f-b4f8-ca4d20d37f26 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:39.055161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79a310-7ea0-486f-b4f8-ca4d20d37f26 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:39.059699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def4c18-9cdd-4cf9-a644-400bcbb632da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:39.060320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4c18-9cdd-4cf9-a644-400bcbb632da admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.060567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4c18-9cdd-4cf9-a644-400bcbb632da admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.060833 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4c18-9cdd-4cf9-a644-400bcbb632da admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.061474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def4c18-9cdd-4cf9-a644-400bcbb632da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:17:39.061801 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def4c18-9cdd-4cf9-a644-400bcbb632da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:39.063563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def4c18-9cdd-4cf9-a644-400bcbb632da admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:39.078276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1363/2761] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:17:39.080372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3c4b8-b32d-4504-87a7-430754db1c89 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:39.085971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:39.090194 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3c4b8-b32d-4504-87a7-430754db1c89 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:39.096711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358e6cd-b2d9-4c3a-ac07-2566f3b4d5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:39.097323 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e6cd-b2d9-4c3a-ac07-2566f3b4d5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.097601 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e6cd-b2d9-4c3a-ac07-2566f3b4d5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.097908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e6cd-b2d9-4c3a-ac07-2566f3b4d5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.098587 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358e6cd-b2d9-4c3a-ac07-2566f3b4d5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:39.100652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358e6cd-b2d9-4c3a-ac07-2566f3b4d5f5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:39.137887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1399/2762] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:39 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:39.139847 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def4c18-9cdd-4cf9-a644-400bcbb632da admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:39.150783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def4c18-9cdd-4cf9-a644-400bcbb632da admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:39.224891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b1e0-f3ed-429f-9ddd-5cc6348e67bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:39.225505 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b1e0-f3ed-429f-9ddd-5cc6348e67bc admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.225781 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b1e0-f3ed-429f-9ddd-5cc6348e67bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.226308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b1e0-f3ed-429f-9ddd-5cc6348e67bc admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.226796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b1e0-f3ed-429f-9ddd-5cc6348e67bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:39.228961 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b1e0-f3ed-429f-9ddd-5cc6348e67bc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:39.254374 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1364/2763] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:39 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:39.258256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358e6cd-b2d9-4c3a-ac07-2566f3b4d5f5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:39.271615 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358e6cd-b2d9-4c3a-ac07-2566f3b4d5f5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:39.277059 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86ab48-f402-4e47-846b-6cd92fb43f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:39.277752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86ab48-f402-4e47-846b-6cd92fb43f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.278149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86ab48-f402-4e47-846b-6cd92fb43f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.278484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86ab48-f402-4e47-846b-6cd92fb43f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.279341 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86ab48-f402-4e47-846b-6cd92fb43f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:39.288897 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86ab48-f402-4e47-846b-6cd92fb43f53 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:39.294716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b1e0-f3ed-429f-9ddd-5cc6348e67bc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:39.297065 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0149b1e0-f3ed-429f-9ddd-5cc6348e67bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:39.306725 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1400/2764] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:39.313795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86ab48-f402-4e47-846b-6cd92fb43f53 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:39.313968 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b1e0-f3ed-429f-9ddd-5cc6348e67bc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:39.319258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cfefc-0976-4b87-a72a-3e0116d56b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:39.319919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cfefc-0976-4b87-a72a-3e0116d56b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.320196 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cfefc-0976-4b87-a72a-3e0116d56b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.320469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cfefc-0976-4b87-a72a-3e0116d56b0f admin admin] PATH_INFO: `/v3/users/fdf64ce00abf4f67b5b03bbcdf86453c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.321623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cfefc-0976-4b87-a72a-3e0116d56b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf64ce00abf4f67b5b03bbcdf86453c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:39.323460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86ab48-f402-4e47-846b-6cd92fb43f53 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:39.323598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cfefc-0976-4b87-a72a-3e0116d56b0f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:39.329172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c905e68-bfee-43d0-a305-cb0bf2fc2a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:39.329776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c905e68-bfee-43d0-a305-cb0bf2fc2a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.330081 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c905e68-bfee-43d0-a305-cb0bf2fc2a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.330451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c905e68-bfee-43d0-a305-cb0bf2fc2a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.331742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c905e68-bfee-43d0-a305-cb0bf2fc2a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:39.332857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c905e68-bfee-43d0-a305-cb0bf2fc2a6b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:39.344858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1401/2765] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:17:39.348896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c905e68-bfee-43d0-a305-cb0bf2fc2a6b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:39.359864 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c905e68-bfee-43d0-a305-cb0bf2fc2a6b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:39.366109 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89aa32-d2ab-45b0-bb0f-e5938d277882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:39.367111 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89aa32-d2ab-45b0-bb0f-e5938d277882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.367337 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89aa32-d2ab-45b0-bb0f-e5938d277882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.367666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89aa32-d2ab-45b0-bb0f-e5938d277882 admin admin] PATH_INFO: `/v3/projects/46544377b6764b37a9743d2d2f59524b/users/b6a85ed8a8a744ddaca15a7ba838cfa3/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.387742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89aa32-d2ab-45b0-bb0f-e5938d277882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46544377b6764b37a9743d2d2f59524b, user_id=b6a85ed8a8a744ddaca15a7ba838cfa3, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:39.389776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-745cfefc-0976-4b87-a72a-3e0116d56b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf64ce00abf4f67b5b03bbcdf86453c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:39.390543 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-745cfefc-0976-4b87-a72a-3e0116d56b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf64ce00abf4f67b5b03bbcdf86453c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:39.391477 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89aa32-d2ab-45b0-bb0f-e5938d277882 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:39.400836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-745cfefc-0976-4b87-a72a-3e0116d56b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf64ce00abf4f67b5b03bbcdf86453c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:39.411508 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-745cfefc-0976-4b87-a72a-3e0116d56b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf64ce00abf4f67b5b03bbcdf86453c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:39.412313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-745cfefc-0976-4b87-a72a-3e0116d56b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf64ce00abf4f67b5b03bbcdf86453c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:39.413377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1402/2766] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:39 2022] PUT /identity/v3/projects/46544377b6764b37a9743d2d2f59524b/users/b6a85ed8a8a744ddaca15a7ba838cfa3/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:17:39.423999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbbaa5-0830-4249-ad09-6c3964aba944 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.424272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbbaa5-0830-4249-ad09-6c3964aba944 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.424543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbbaa5-0830-4249-ad09-6c3964aba944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.453660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1365/2767] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:17:39 2022] DELETE /identity/v3/users/fdf64ce00abf4f67b5b03bbcdf86453c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:39.455342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cc98e-cfc0-45a7-85df-77b91d1f6974 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.455627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cc98e-cfc0-45a7-85df-77b91d1f6974 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.455896 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cc98e-cfc0-45a7-85df-77b91d1f6974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.463380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2fcbbaa5-0830-4249-ad09-6c3964aba944 None None] MFA Rules not processed for user `b6a85ed8a8a744ddaca15a7ba838cfa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:39.465790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2fcbbaa5-0830-4249-ad09-6c3964aba944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:39.478670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ed7cc98e-cfc0-45a7-85df-77b91d1f6974 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:39.480023 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ed7cc98e-cfc0-45a7-85df-77b91d1f6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:39.497457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:39.561886 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1403/2768] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:39.564125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1366/2769] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:39.577164 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbbaa5-0830-4249-ad09-6c3964aba944 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:39.578619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2fcbbaa5-0830-4249-ad09-6c3964aba944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:39.582307 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cc98e-cfc0-45a7-85df-77b91d1f6974 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:39.586398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ed7cc98e-cfc0-45a7-85df-77b91d1f6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:39.660852 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cc98e-cfc0-45a7-85df-77b91d1f6974 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:39.663826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbbaa5-0830-4249-ad09-6c3964aba944 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:39.664662 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e2149-a5a8-4fe3-b74b-1983c90a1211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:39.665659 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2149-a5a8-4fe3-b74b-1983c90a1211 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.665939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2149-a5a8-4fe3-b74b-1983c90a1211 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.666356 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2149-a5a8-4fe3-b74b-1983c90a1211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.673189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba148558-5376-4b43-a14f-c7bc3787760c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:39.674456 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba148558-5376-4b43-a14f-c7bc3787760c service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.674742 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba148558-5376-4b43-a14f-c7bc3787760c service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.675016 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba148558-5376-4b43-a14f-c7bc3787760c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.676782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e2149-a5a8-4fe3-b74b-1983c90a1211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:39.678360 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e2149-a5a8-4fe3-b74b-1983c90a1211 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:39.689460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1367/2770] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:39.696997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba148558-5376-4b43-a14f-c7bc3787760c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:39.698551 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba148558-5376-4b43-a14f-c7bc3787760c service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:39.711051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1404/2771] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:39.724142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163e388-a635-4dd9-ba17-9b92764cbe1a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:39.724429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163e388-a635-4dd9-ba17-9b92764cbe1a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:39.724697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163e388-a635-4dd9-ba17-9b92764cbe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:39.750350 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1163e388-a635-4dd9-ba17-9b92764cbe1a None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:39.751926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1163e388-a635-4dd9-ba17-9b92764cbe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:39.836341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1368/2772] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:39.852911 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba148558-5376-4b43-a14f-c7bc3787760c service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:39.859826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ba148558-5376-4b43-a14f-c7bc3787760c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:39.945409 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:40.007092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba148558-5376-4b43-a14f-c7bc3787760c service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:40.012854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebd9a2-0e49-4545-85cd-7b9aed624949 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:40.013602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebd9a2-0e49-4545-85cd-7b9aed624949 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:40.014020 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebd9a2-0e49-4545-85cd-7b9aed624949 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:40.014388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebd9a2-0e49-4545-85cd-7b9aed624949 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:40.024388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebd9a2-0e49-4545-85cd-7b9aed624949 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:40.026189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebd9a2-0e49-4545-85cd-7b9aed624949 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:40.037228 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1405/2773] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:17:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:17:40.153630 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163e388-a635-4dd9-ba17-9b92764cbe1a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:40.156286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1163e388-a635-4dd9-ba17-9b92764cbe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:40.194786 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163e388-a635-4dd9-ba17-9b92764cbe1a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:40.199939 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:40.200713 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:40.201049 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:40.201297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] PATH_INFO: `/v3/projects/0b56f2ffb30c4ec1971bef329269f59b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:40.202683 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b56f2ffb30c4ec1971bef329269f59b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:40.204511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:40.331004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b56f2ffb30c4ec1971bef329269f59b', 'request_id': 'req-d69a24ea-a015-490f-951f-ebc2099922c2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:40.341705 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b56f2ffb30c4ec1971bef329269f59b', 'request_id': 'req-d69a24ea-a015-490f-951f-ebc2099922c2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:40.345989 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:40.364217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b56f2ffb30c4ec1971bef329269f59b', 'request_id': 'req-d69a24ea-a015-490f-951f-ebc2099922c2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:40.387829 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] The token cache is being invalidate because project 0b56f2ffb30c4ec1971bef329269f59b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:17:40.388227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:40.389136 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:40.391566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1369/2774] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:17:40 2022] DELETE /identity/v3/projects/0b56f2ffb30c4ec1971bef329269f59b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:40.395575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebd9a2-0e49-4545-85cd-7b9aed624949 service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:40.408969 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebd9a2-0e49-4545-85cd-7b9aed624949 service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:40.517966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2881-de19-465a-9d8a-3ca4e80e57d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:40.518761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2881-de19-465a-9d8a-3ca4e80e57d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:40.519127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2881-de19-465a-9d8a-3ca4e80e57d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:40.519489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2881-de19-465a-9d8a-3ca4e80e57d3 admin admin] PATH_INFO: `/v3/users/2d861847144a40049515618170d5632f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:40.520736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce2881-de19-465a-9d8a-3ca4e80e57d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d861847144a40049515618170d5632f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:40.522896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce2881-de19-465a-9d8a-3ca4e80e57d3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:40.592347 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-58ce2881-de19-465a-9d8a-3ca4e80e57d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d861847144a40049515618170d5632f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:40.600892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-58ce2881-de19-465a-9d8a-3ca4e80e57d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d861847144a40049515618170d5632f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:40.601698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-58ce2881-de19-465a-9d8a-3ca4e80e57d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d861847144a40049515618170d5632f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:40.609411 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-58ce2881-de19-465a-9d8a-3ca4e80e57d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d861847144a40049515618170d5632f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:40.622197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-58ce2881-de19-465a-9d8a-3ca4e80e57d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d861847144a40049515618170d5632f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:40.629392 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1406/2775] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:17:40 2022] DELETE /identity/v3/users/2d861847144a40049515618170d5632f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:40.916402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:40.917958 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:40.932917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a24ea-a015-490f-951f-ebc2099922c2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:40.991227 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:40.991848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:40.992125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:40.992394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] PATH_INFO: `/v3/projects/8837d2f776a048fb948d51faad33512a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:40.993551 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8837d2f776a048fb948d51faad33512a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:40.995500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:41.045319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8837d2f776a048fb948d51faad33512a', 'request_id': 'req-247ced50-5650-43d6-b22c-5fd9d8e0842d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:41.050605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8837d2f776a048fb948d51faad33512a', 'request_id': 'req-247ced50-5650-43d6-b22c-5fd9d8e0842d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:41.059929 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8837d2f776a048fb948d51faad33512a', 'request_id': 'req-247ced50-5650-43d6-b22c-5fd9d8e0842d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:41.071809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] The token cache is being invalidate because project 8837d2f776a048fb948d51faad33512a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:17:41.072092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:41.072731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-247ced50-5650-43d6-b22c-5fd9d8e0842d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:41.074363 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1370/2776] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:17:40 2022] DELETE /identity/v3/projects/8837d2f776a048fb948d51faad33512a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:41.079624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75fe77-d501-428b-a079-d3101ff8536d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.079909 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75fe77-d501-428b-a079-d3101ff8536d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.080185 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75fe77-d501-428b-a079-d3101ff8536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.101491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6c75fe77-d501-428b-a079-d3101ff8536d None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:41.102743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6c75fe77-d501-428b-a079-d3101ff8536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:41.136510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:41.166650 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1407/2777] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:41.174893 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338590ca-88d7-44c5-b6fd-99695bdd1a96 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.175171 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338590ca-88d7-44c5-b6fd-99695bdd1a96 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.175438 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338590ca-88d7-44c5-b6fd-99695bdd1a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.196736 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-338590ca-88d7-44c5-b6fd-99695bdd1a96 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:41.198003 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-338590ca-88d7-44c5-b6fd-99695bdd1a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:41.214859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1371/2778] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:41.219612 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75fe77-d501-428b-a079-d3101ff8536d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:41.230546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75fe77-d501-428b-a079-d3101ff8536d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:41.252122 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46da870-c183-4be3-93c7-821eaddf0155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:41.252733 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6eb7-e175-4fe6-8c51-58f1489851bd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.252845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46da870-c183-4be3-93c7-821eaddf0155 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.253007 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6eb7-e175-4fe6-8c51-58f1489851bd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.253116 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46da870-c183-4be3-93c7-821eaddf0155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.253278 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46da870-c183-4be3-93c7-821eaddf0155 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.253386 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6eb7-e175-4fe6-8c51-58f1489851bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.254235 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46da870-c183-4be3-93c7-821eaddf0155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:17:41.254545 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46da870-c183-4be3-93c7-821eaddf0155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:41.256155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46da870-c183-4be3-93c7-821eaddf0155 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:41.269031 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1408/2779] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:17:41.273241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46da870-c183-4be3-93c7-821eaddf0155 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:41.274700 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-dd7a6eb7-e175-4fe6-8c51-58f1489851bd None None] MFA Rules not processed for user `b6a85ed8a8a744ddaca15a7ba838cfa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:41.276745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-dd7a6eb7-e175-4fe6-8c51-58f1489851bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:41.283702 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46da870-c183-4be3-93c7-821eaddf0155 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:41.288915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d918c6b-e00a-411b-b4b2-e52ef8bb7776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:41.289586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d918c6b-e00a-411b-b4b2-e52ef8bb7776 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.290028 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d918c6b-e00a-411b-b4b2-e52ef8bb7776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.290360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d918c6b-e00a-411b-b4b2-e52ef8bb7776 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.291056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d918c6b-e00a-411b-b4b2-e52ef8bb7776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:41.293021 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d918c6b-e00a-411b-b4b2-e52ef8bb7776 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:41.331862 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1409/2780] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:41 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:17:41.336772 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d918c6b-e00a-411b-b4b2-e52ef8bb7776 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:41.349739 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1372/2781] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:17:41.404093 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d918c6b-e00a-411b-b4b2-e52ef8bb7776 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:41.409038 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcafe51-2155-48b2-a046-5c09ef13cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:41.409642 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcafe51-2155-48b2-a046-5c09ef13cc98 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.410141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcafe51-2155-48b2-a046-5c09ef13cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.410349 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcafe51-2155-48b2-a046-5c09ef13cc98 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.410897 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcafe51-2155-48b2-a046-5c09ef13cc98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:41.412794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcafe51-2155-48b2-a046-5c09ef13cc98 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:41.435801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1410/2782] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:41 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:41.440643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a6eb7-e175-4fe6-8c51-58f1489851bd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:41.452108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a6eb7-e175-4fe6-8c51-58f1489851bd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:41.457426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859e8e-bf15-4ed0-a1dc-206120ae9715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:41.458075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859e8e-bf15-4ed0-a1dc-206120ae9715 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.458349 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859e8e-bf15-4ed0-a1dc-206120ae9715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.458610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859e8e-bf15-4ed0-a1dc-206120ae9715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.459252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b859e8e-bf15-4ed0-a1dc-206120ae9715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:41.460843 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b859e8e-bf15-4ed0-a1dc-206120ae9715 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:41.471965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1373/2783] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:41.476182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcafe51-2155-48b2-a046-5c09ef13cc98 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:41.486766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcafe51-2155-48b2-a046-5c09ef13cc98 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:41.491306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505c303-92f3-4a64-86ce-0ff1ff0b3798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:41.491907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c303-92f3-4a64-86ce-0ff1ff0b3798 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.492184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c303-92f3-4a64-86ce-0ff1ff0b3798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.492451 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c303-92f3-4a64-86ce-0ff1ff0b3798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.493095 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505c303-92f3-4a64-86ce-0ff1ff0b3798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:41.494755 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505c303-92f3-4a64-86ce-0ff1ff0b3798 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:41.509497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1411/2784] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:41.510873 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859e8e-bf15-4ed0-a1dc-206120ae9715 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:41.522390 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859e8e-bf15-4ed0-a1dc-206120ae9715 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:41.527046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b58c8-d975-436c-b6e9-cf7baf86ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:41.527725 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b58c8-d975-436c-b6e9-cf7baf86ec86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.527991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b58c8-d975-436c-b6e9-cf7baf86ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.528262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b58c8-d975-436c-b6e9-cf7baf86ec86 admin admin] PATH_INFO: `/v3/projects/57208cc3b3f944fba70e1e94d0f7da26/users/b315607c91bf4440b2f4cad2bdf9cfde/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.531616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:41.546123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b58c8-d975-436c-b6e9-cf7baf86ec86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57208cc3b3f944fba70e1e94d0f7da26, user_id=b315607c91bf4440b2f4cad2bdf9cfde, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:41.548914 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b58c8-d975-436c-b6e9-cf7baf86ec86 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:41.563544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1374/2785] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:41 2022] PUT /identity/v3/projects/57208cc3b3f944fba70e1e94d0f7da26/users/b315607c91bf4440b2f4cad2bdf9cfde/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:41.575057 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e066-6401-4219-8548-fabb2d36e42a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.575342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e066-6401-4219-8548-fabb2d36e42a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.575774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e066-6401-4219-8548-fabb2d36e42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.612762 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c7f1e066-6401-4219-8548-fabb2d36e42a None None] MFA Rules not processed for user `b315607c91bf4440b2f4cad2bdf9cfde`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:41.614551 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c7f1e066-6401-4219-8548-fabb2d36e42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:41.680851 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1412/2786] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:17:41.685334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b58c8-d975-436c-b6e9-cf7baf86ec86 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:41.763412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b58c8-d975-436c-b6e9-cf7baf86ec86 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:41.769509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c751e-06c2-41c4-b0dd-f08c5f46d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:41.769928 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c751e-06c2-41c4-b0dd-f08c5f46d6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.770213 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c751e-06c2-41c4-b0dd-f08c5f46d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.770511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c751e-06c2-41c4-b0dd-f08c5f46d6f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.771110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c751e-06c2-41c4-b0dd-f08c5f46d6f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:41.773051 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c751e-06c2-41c4-b0dd-f08c5f46d6f0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:41.811514 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1375/2787] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:41 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:41.812554 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1e066-6401-4219-8548-fabb2d36e42a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:41.824266 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1e066-6401-4219-8548-fabb2d36e42a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:41.833489 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:41.893401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796b901-bf5b-4572-aa08-c9ec9bd81a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:41.894061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b901-bf5b-4572-aa08-c9ec9bd81a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.894362 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b901-bf5b-4572-aa08-c9ec9bd81a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.894630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b901-bf5b-4572-aa08-c9ec9bd81a86 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.895262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796b901-bf5b-4572-aa08-c9ec9bd81a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:41.897160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796b901-bf5b-4572-aa08-c9ec9bd81a86 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:41.922801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1413/2788] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:41 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:41.924107 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c751e-06c2-41c4-b0dd-f08c5f46d6f0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:41.936374 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c751e-06c2-41c4-b0dd-f08c5f46d6f0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:41.942524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6dcac-2571-4262-bbb2-a1439abd0851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:41.943144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6dcac-2571-4262-bbb2-a1439abd0851 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.943480 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6dcac-2571-4262-bbb2-a1439abd0851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.943742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6dcac-2571-4262-bbb2-a1439abd0851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.944513 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6dcac-2571-4262-bbb2-a1439abd0851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:41.946161 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6dcac-2571-4262-bbb2-a1439abd0851 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:41.962207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1376/2789] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:41.963449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796b901-bf5b-4572-aa08-c9ec9bd81a86 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:41.973893 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796b901-bf5b-4572-aa08-c9ec9bd81a86 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:41.979141 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99895f0a-bff2-436c-8115-15db436aeab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:41.979814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99895f0a-bff2-436c-8115-15db436aeab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:41.980152 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99895f0a-bff2-436c-8115-15db436aeab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:41.980424 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99895f0a-bff2-436c-8115-15db436aeab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:41.981068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99895f0a-bff2-436c-8115-15db436aeab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:41.982683 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99895f0a-bff2-436c-8115-15db436aeab0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:41.993808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1414/2790] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:41.999031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6dcac-2571-4262-bbb2-a1439abd0851 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:42.009559 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6dcac-2571-4262-bbb2-a1439abd0851 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:42.014201 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f55f4-9672-457e-9603-f0e9fb13df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:42.014851 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f55f4-9672-457e-9603-f0e9fb13df64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:42.016052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f55f4-9672-457e-9603-f0e9fb13df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:42.016052 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f55f4-9672-457e-9603-f0e9fb13df64 admin admin] PATH_INFO: `/v3/projects/674a70740ab045998128da982757cad4/users/641b3b97ccf54a57935639047588b113/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:42.035058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f55f4-9672-457e-9603-f0e9fb13df64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674a70740ab045998128da982757cad4, user_id=641b3b97ccf54a57935639047588b113, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:42.037650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f55f4-9672-457e-9603-f0e9fb13df64 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:42.053221 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1377/2791] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:41 2022] PUT /identity/v3/projects/674a70740ab045998128da982757cad4/users/641b3b97ccf54a57935639047588b113/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:42.065397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65c67c-d2c5-4467-9afb-8545673e4b55 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:42.065685 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65c67c-d2c5-4467-9afb-8545673e4b55 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:42.065991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65c67c-d2c5-4467-9afb-8545673e4b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:42.096620 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3c65c67c-d2c5-4467-9afb-8545673e4b55 None None] MFA Rules not processed for user `641b3b97ccf54a57935639047588b113`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:42.097892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3c65c67c-d2c5-4467-9afb-8545673e4b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:42.168226 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1415/2792] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:42.173372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f55f4-9672-457e-9603-f0e9fb13df64 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:42.236730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f55f4-9672-457e-9603-f0e9fb13df64 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:42.241335 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd70405-4877-4a0b-838f-f669f0ceb96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:42.241986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70405-4877-4a0b-838f-f669f0ceb96e admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:42.242265 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70405-4877-4a0b-838f-f669f0ceb96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:42.242535 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70405-4877-4a0b-838f-f669f0ceb96e admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:42.243165 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd70405-4877-4a0b-838f-f669f0ceb96e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:42.245045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd70405-4877-4a0b-838f-f669f0ceb96e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:42.275114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1378/2793] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:42 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:42.279348 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65c67c-d2c5-4467-9afb-8545673e4b55 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:42.291283 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65c67c-d2c5-4467-9afb-8545673e4b55 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:42.347496 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78abf89-5edf-4c0b-8a02-c6734d784e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:42.348151 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78abf89-5edf-4c0b-8a02-c6734d784e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:42.348429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78abf89-5edf-4c0b-8a02-c6734d784e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:42.348782 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78abf89-5edf-4c0b-8a02-c6734d784e50 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:42.349331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78abf89-5edf-4c0b-8a02-c6734d784e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:42.351295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78abf89-5edf-4c0b-8a02-c6734d784e50 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:42.382136 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1416/2794] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:42 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:17:42.386307 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd70405-4877-4a0b-838f-f669f0ceb96e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:42.396766 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd70405-4877-4a0b-838f-f669f0ceb96e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:42.402231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1109c-62ce-4f48-b07a-3f944d58b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:42.402837 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1109c-62ce-4f48-b07a-3f944d58b539 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:42.403104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1109c-62ce-4f48-b07a-3f944d58b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:42.403370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1109c-62ce-4f48-b07a-3f944d58b539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:42.404012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1109c-62ce-4f48-b07a-3f944d58b539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:42.405733 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1109c-62ce-4f48-b07a-3f944d58b539 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:42.417634 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1379/2795] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:42.422970 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78abf89-5edf-4c0b-8a02-c6734d784e50 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:42.433428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78abf89-5edf-4c0b-8a02-c6734d784e50 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:42.438961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24594005-397d-4eea-95bd-c7297251b800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:42.439713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594005-397d-4eea-95bd-c7297251b800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:42.439983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594005-397d-4eea-95bd-c7297251b800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:42.440373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594005-397d-4eea-95bd-c7297251b800 admin admin] PATH_INFO: `/v3/projects/917514b2d48047d8b72c552a39f26a32/users/cc5d64dd1d8b490eba89a606578cacda/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:42.444454 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:42.460137 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24594005-397d-4eea-95bd-c7297251b800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917514b2d48047d8b72c552a39f26a32, user_id=cc5d64dd1d8b490eba89a606578cacda, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:42.462949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24594005-397d-4eea-95bd-c7297251b800 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:42.478374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1417/2796] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:42 2022] PUT /identity/v3/projects/917514b2d48047d8b72c552a39f26a32/users/cc5d64dd1d8b490eba89a606578cacda/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:42.482403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1109c-62ce-4f48-b07a-3f944d58b539 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:42.492986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1109c-62ce-4f48-b07a-3f944d58b539 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:42.497714 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:42.558731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ae541-c745-404e-aef5-cf53e6a30f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:42.559344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ae541-c745-404e-aef5-cf53e6a30f61 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:42.559619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ae541-c745-404e-aef5-cf53e6a30f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:42.559887 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ae541-c745-404e-aef5-cf53e6a30f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:42.560527 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ae541-c745-404e-aef5-cf53e6a30f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:42.562225 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ae541-c745-404e-aef5-cf53e6a30f61 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:42.572178 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1380/2797] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:17:42.576331 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24594005-397d-4eea-95bd-c7297251b800 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:42.586916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24594005-397d-4eea-95bd-c7297251b800 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:42.591335 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4718b-fe4d-41d3-a3d5-b510eb595770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:42.591980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4718b-fe4d-41d3-a3d5-b510eb595770 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:42.592253 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4718b-fe4d-41d3-a3d5-b510eb595770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:42.592524 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4718b-fe4d-41d3-a3d5-b510eb595770 admin admin] PATH_INFO: `/v3/projects/917514b2d48047d8b72c552a39f26a32/users/cc5d64dd1d8b490eba89a606578cacda/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:42.594555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4718b-fe4d-41d3-a3d5-b510eb595770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917514b2d48047d8b72c552a39f26a32, user_id=cc5d64dd1d8b490eba89a606578cacda, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:42.597180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4718b-fe4d-41d3-a3d5-b510eb595770 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:42.607003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1418/2798] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:42 2022] PUT /identity/v3/projects/917514b2d48047d8b72c552a39f26a32/users/cc5d64dd1d8b490eba89a606578cacda/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:42.618064 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57402249-23bc-42b0-b838-053837adc1cf None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:42.618347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57402249-23bc-42b0-b838-053837adc1cf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:42.618618 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57402249-23bc-42b0-b838-053837adc1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:42.648753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-57402249-23bc-42b0-b838-053837adc1cf None None] MFA Rules not processed for user `cc5d64dd1d8b490eba89a606578cacda`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:42.649919 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-57402249-23bc-42b0-b838-053837adc1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:42.738107 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1381/2799] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:42.750237 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4718b-fe4d-41d3-a3d5-b510eb595770 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:42.752139 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-95e4718b-fe4d-41d3-a3d5-b510eb595770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:42.813544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4718b-fe4d-41d3-a3d5-b510eb595770 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:42.817956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b5413-170e-4315-afd5-f9cd34e6a038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:42.818564 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b5413-170e-4315-afd5-f9cd34e6a038 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:42.818842 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b5413-170e-4315-afd5-f9cd34e6a038 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:42.819120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b5413-170e-4315-afd5-f9cd34e6a038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:42.830150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b5413-170e-4315-afd5-f9cd34e6a038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:42.831634 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b5413-170e-4315-afd5-f9cd34e6a038 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:42.841651 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1419/2800] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:42.891997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57402249-23bc-42b0-b838-053837adc1cf None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:42.893421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-57402249-23bc-42b0-b838-053837adc1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:42.905716 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57402249-23bc-42b0-b838-053837adc1cf None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:42.909657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba6dae-397b-4610-8d12-4b1aa8d2f028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:42.910318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba6dae-397b-4610-8d12-4b1aa8d2f028 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:42.910593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba6dae-397b-4610-8d12-4b1aa8d2f028 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:42.910856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba6dae-397b-4610-8d12-4b1aa8d2f028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:42.970007 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba6dae-397b-4610-8d12-4b1aa8d2f028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:42.971447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba6dae-397b-4610-8d12-4b1aa8d2f028 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:42.980276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1382/2801] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:46.054729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b5413-170e-4315-afd5-f9cd34e6a038 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:46.158935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b5413-170e-4315-afd5-f9cd34e6a038 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:46.164270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:46.165242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:46.165581 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:46.165950 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] PATH_INFO: `/v3/users/b315607c91bf4440b2f4cad2bdf9cfde` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:46.167175 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b315607c91bf4440b2f4cad2bdf9cfde)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:46.169174 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:46.245332 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b315607c91bf4440b2f4cad2bdf9cfde'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:46.255161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b315607c91bf4440b2f4cad2bdf9cfde'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:46.255890 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b315607c91bf4440b2f4cad2bdf9cfde'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:46.265674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b315607c91bf4440b2f4cad2bdf9cfde'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:46.278099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:46.280641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b315607c91bf4440b2f4cad2bdf9cfde'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:46.288180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1420/2802] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:17:46 2022] DELETE /identity/v3/users/b315607c91bf4440b2f4cad2bdf9cfde => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:46.292898 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e88b3-2657-4de1-ab92-2311d92b8c3f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:46.293409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e88b3-2657-4de1-ab92-2311d92b8c3f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:46.293607 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e88b3-2657-4de1-ab92-2311d92b8c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:46.319333 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-261e88b3-2657-4de1-ab92-2311d92b8c3f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:46.320669 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-261e88b3-2657-4de1-ab92-2311d92b8c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:46.346915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:46.396747 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1383/2803] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:46.405544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:46.407448 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:46.510240 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eb0bd-92b4-49f9-a652-e2ddf5cca427 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:46.516544 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0692b-892b-4e98-a5a9-7f3fdcc70c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:46.517467 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0692b-892b-4e98-a5a9-7f3fdcc70c31 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:46.517895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0692b-892b-4e98-a5a9-7f3fdcc70c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:46.518224 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0692b-892b-4e98-a5a9-7f3fdcc70c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:46.538892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0692b-892b-4e98-a5a9-7f3fdcc70c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:46.558367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0692b-892b-4e98-a5a9-7f3fdcc70c31 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:46.570916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1421/2804] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:46.955284 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e88b3-2657-4de1-ab92-2311d92b8c3f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:46.956820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-261e88b3-2657-4de1-ab92-2311d92b8c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:46.970991 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e88b3-2657-4de1-ab92-2311d92b8c3f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:46.975816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:46.977859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:46.977859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:46.977859 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] PATH_INFO: `/v3/projects/57208cc3b3f944fba70e1e94d0f7da26` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:46.981006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57208cc3b3f944fba70e1e94d0f7da26)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:46.983507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:47.053088 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57208cc3b3f944fba70e1e94d0f7da26', 'request_id': 'req-5e251297-0d51-45b4-a887-0281024616f5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.059364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57208cc3b3f944fba70e1e94d0f7da26', 'request_id': 'req-5e251297-0d51-45b4-a887-0281024616f5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.070610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57208cc3b3f944fba70e1e94d0f7da26', 'request_id': 'req-5e251297-0d51-45b4-a887-0281024616f5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.083494 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] The token cache is being invalidate because project 57208cc3b3f944fba70e1e94d0f7da26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:17:47.083780 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.084416 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.086128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1384/2805] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:17:46 2022] DELETE /identity/v3/projects/57208cc3b3f944fba70e1e94d0f7da26 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:47.090401 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0692b-892b-4e98-a5a9-7f3fdcc70c31 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:47.100951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0692b-892b-4e98-a5a9-7f3fdcc70c31 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:47.169583 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:47.171264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:47.171264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:47.171264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] PATH_INFO: `/v3/users/641b3b97ccf54a57935639047588b113` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:47.172204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=641b3b97ccf54a57935639047588b113)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:47.174927 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:47.243359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641b3b97ccf54a57935639047588b113'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.253662 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641b3b97ccf54a57935639047588b113'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.254607 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641b3b97ccf54a57935639047588b113'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.262985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641b3b97ccf54a57935639047588b113'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.275624 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641b3b97ccf54a57935639047588b113'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.285306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1422/2806] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:17:47 2022] DELETE /identity/v3/users/641b3b97ccf54a57935639047588b113 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:47.707203 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:47.716577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:47.744378 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e251297-0d51-45b4-a887-0281024616f5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:47.843447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:47.844097 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:47.845035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:47.845316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] PATH_INFO: `/v3/projects/674a70740ab045998128da982757cad4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:47.846857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674a70740ab045998128da982757cad4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:47.849261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:47.934772 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674a70740ab045998128da982757cad4', 'request_id': 'req-99ae1dd1-f010-4c61-9367-90f99190e701'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.938771 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:47.941127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674a70740ab045998128da982757cad4', 'request_id': 'req-99ae1dd1-f010-4c61-9367-90f99190e701'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.950809 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674a70740ab045998128da982757cad4', 'request_id': 'req-99ae1dd1-f010-4c61-9367-90f99190e701'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.964254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] The token cache is being invalidate because project 674a70740ab045998128da982757cad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:17:47.964844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.965503 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:47.967252 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1385/2807] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:17:47 2022] DELETE /identity/v3/projects/674a70740ab045998128da982757cad4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:47.972204 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:47.973739 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:47.991367 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c7b9-f342-474e-9e48-11fbd62e09f2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:48.005376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:48.058190 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6840ea4-b568-4dde-aef3-65d52a5391f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:48.058846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6840ea4-b568-4dde-aef3-65d52a5391f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:48.059124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6840ea4-b568-4dde-aef3-65d52a5391f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:48.059396 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6840ea4-b568-4dde-aef3-65d52a5391f5 admin admin] PATH_INFO: `/v3/users/cc5d64dd1d8b490eba89a606578cacda` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:48.060530 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6840ea4-b568-4dde-aef3-65d52a5391f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5d64dd1d8b490eba89a606578cacda)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:48.062491 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6840ea4-b568-4dde-aef3-65d52a5391f5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:48.115397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f6840ea4-b568-4dde-aef3-65d52a5391f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5d64dd1d8b490eba89a606578cacda'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:48.127538 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f6840ea4-b568-4dde-aef3-65d52a5391f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5d64dd1d8b490eba89a606578cacda'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:48.128440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f6840ea4-b568-4dde-aef3-65d52a5391f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5d64dd1d8b490eba89a606578cacda'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:48.138576 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f6840ea4-b568-4dde-aef3-65d52a5391f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5d64dd1d8b490eba89a606578cacda'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:48.153695 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f6840ea4-b568-4dde-aef3-65d52a5391f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5d64dd1d8b490eba89a606578cacda'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:48.159591 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1423/2808] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:17:47 2022] DELETE /identity/v3/users/cc5d64dd1d8b490eba89a606578cacda => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:17:48.464087 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:48.465697 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:48.492844 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae1dd1-f010-4c61-9367-90f99190e701 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:48.633045 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:48.633617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:48.633925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:48.634201 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] PATH_INFO: `/v3/projects/917514b2d48047d8b72c552a39f26a32` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:48.635367 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=917514b2d48047d8b72c552a39f26a32)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:48.638434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:48.741964 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917514b2d48047d8b72c552a39f26a32', 'request_id': 'req-018336c9-38a3-464c-a616-4f75cb831eb2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:48.748332 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917514b2d48047d8b72c552a39f26a32', 'request_id': 'req-018336c9-38a3-464c-a616-4f75cb831eb2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:48.760996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917514b2d48047d8b72c552a39f26a32', 'request_id': 'req-018336c9-38a3-464c-a616-4f75cb831eb2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:48.787074 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] The token cache is being invalidate because project 917514b2d48047d8b72c552a39f26a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:17:48.787486 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:48.788856 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-018336c9-38a3-464c-a616-4f75cb831eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:48.791186 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1386/2809] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:17:48 2022] DELETE /identity/v3/projects/917514b2d48047d8b72c552a39f26a32 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:48.798154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069abb6-16dd-4b8d-b296-7bb58b10abee None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:48.798713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069abb6-16dd-4b8d-b296-7bb58b10abee None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:48.799167 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069abb6-16dd-4b8d-b296-7bb58b10abee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:48.821061 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c069abb6-16dd-4b8d-b296-7bb58b10abee None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:48.822724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c069abb6-16dd-4b8d-b296-7bb58b10abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:48.928633 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1424/2810] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:48.940112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feea80-fb97-4189-aa8c-96c0912fc05c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:48.940477 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feea80-fb97-4189-aa8c-96c0912fc05c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:48.940823 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feea80-fb97-4189-aa8c-96c0912fc05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:48.980610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-55feea80-fb97-4189-aa8c-96c0912fc05c None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:48.982421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-55feea80-fb97-4189-aa8c-96c0912fc05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:48.994802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1387/2811] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:49.006042 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069abb6-16dd-4b8d-b296-7bb58b10abee None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:49.015600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069abb6-16dd-4b8d-b296-7bb58b10abee None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:49.021882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00285fa4-a034-4345-b466-366058d36f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:49.022628 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00285fa4-a034-4345-b466-366058d36f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:49.022912 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00285fa4-a034-4345-b466-366058d36f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:49.023186 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00285fa4-a034-4345-b466-366058d36f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:49.023857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00285fa4-a034-4345-b466-366058d36f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:17:49.024163 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00285fa4-a034-4345-b466-366058d36f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:49.025780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00285fa4-a034-4345-b466-366058d36f29 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:49.065947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1425/2812] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:17:49.070172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55feea80-fb97-4189-aa8c-96c0912fc05c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:49.079474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55feea80-fb97-4189-aa8c-96c0912fc05c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:49.085067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da0c25-5cd4-4c39-9e7c-bc8c608fdfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:49.085698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da0c25-5cd4-4c39-9e7c-bc8c608fdfdc admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:49.086038 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da0c25-5cd4-4c39-9e7c-bc8c608fdfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:49.086308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da0c25-5cd4-4c39-9e7c-bc8c608fdfdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:49.086947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da0c25-5cd4-4c39-9e7c-bc8c608fdfdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:49.088857 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da0c25-5cd4-4c39-9e7c-bc8c608fdfdc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:49.127305 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1388/2813] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:49 2022] POST /identity/v3/projects => generated 359 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:49.131232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00285fa4-a034-4345-b466-366058d36f29 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:49.141811 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00285fa4-a034-4345-b466-366058d36f29 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:49.161776 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:49.203148 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32046b1-33f9-49f9-91d9-6e7353850675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:49.203801 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32046b1-33f9-49f9-91d9-6e7353850675 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:49.204075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32046b1-33f9-49f9-91d9-6e7353850675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:49.204486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32046b1-33f9-49f9-91d9-6e7353850675 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:49.205133 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32046b1-33f9-49f9-91d9-6e7353850675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:49.207100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32046b1-33f9-49f9-91d9-6e7353850675 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:49.238211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1426/2814] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:49 2022] POST /identity/v3/users => generated 280 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:49.239579 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da0c25-5cd4-4c39-9e7c-bc8c608fdfdc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:49.250511 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da0c25-5cd4-4c39-9e7c-bc8c608fdfdc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:49.255680 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3e147-9d13-4184-b326-40afb066bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:49.256319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e147-9d13-4184-b326-40afb066bc31 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:49.256592 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e147-9d13-4184-b326-40afb066bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:49.256901 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e147-9d13-4184-b326-40afb066bc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:49.257498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3e147-9d13-4184-b326-40afb066bc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:49.259156 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3e147-9d13-4184-b326-40afb066bc31 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:49.270084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1389/2815] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:49.274342 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32046b1-33f9-49f9-91d9-6e7353850675 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:49.285165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32046b1-33f9-49f9-91d9-6e7353850675 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:49.290139 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338452be-5cf0-49cf-8ed5-2e6cb78bf7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:49.290764 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338452be-5cf0-49cf-8ed5-2e6cb78bf7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:49.291039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338452be-5cf0-49cf-8ed5-2e6cb78bf7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:49.291354 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338452be-5cf0-49cf-8ed5-2e6cb78bf7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:49.292127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338452be-5cf0-49cf-8ed5-2e6cb78bf7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:49.293763 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338452be-5cf0-49cf-8ed5-2e6cb78bf7bf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:49.309410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1427/2816] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:49.313942 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3e147-9d13-4184-b326-40afb066bc31 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:49.324792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3e147-9d13-4184-b326-40afb066bc31 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:49.330048 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78258fe-3e3c-4567-a86e-0bf30578d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:49.330738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78258fe-3e3c-4567-a86e-0bf30578d5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:49.331058 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78258fe-3e3c-4567-a86e-0bf30578d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:49.331325 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78258fe-3e3c-4567-a86e-0bf30578d5b9 admin admin] PATH_INFO: `/v3/projects/bb4cd450d43049cfb0f43e6fae0932be/users/a734d078986d4b3d9028f2239d2ef9ee/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:49.347975 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78258fe-3e3c-4567-a86e-0bf30578d5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4cd450d43049cfb0f43e6fae0932be, user_id=a734d078986d4b3d9028f2239d2ef9ee, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:49.350785 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78258fe-3e3c-4567-a86e-0bf30578d5b9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:49.365695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1390/2817] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:49 2022] PUT /identity/v3/projects/bb4cd450d43049cfb0f43e6fae0932be/users/a734d078986d4b3d9028f2239d2ef9ee/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:49.379433 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3630-9724-4308-89b5-41833e51f6ce None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:49.379697 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3630-9724-4308-89b5-41833e51f6ce None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:49.380060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3630-9724-4308-89b5-41833e51f6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:49.418313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-629a3630-9724-4308-89b5-41833e51f6ce None None] MFA Rules not processed for user `a734d078986d4b3d9028f2239d2ef9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:49.419709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-629a3630-9724-4308-89b5-41833e51f6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:49.491234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1428/2818] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:49.529129 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78258fe-3e3c-4567-a86e-0bf30578d5b9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:49.530909 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f78258fe-3e3c-4567-a86e-0bf30578d5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:49.543308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:49.597651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78258fe-3e3c-4567-a86e-0bf30578d5b9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:49.601524 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c17742-50ec-4339-918c-9442b2296627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:49.602172 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c17742-50ec-4339-918c-9442b2296627 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:49.602447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c17742-50ec-4339-918c-9442b2296627 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:49.602709 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c17742-50ec-4339-918c-9442b2296627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:49.613005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c17742-50ec-4339-918c-9442b2296627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:49.614698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c17742-50ec-4339-918c-9442b2296627 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:49.624424 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1391/2819] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:49.641388 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a3630-9724-4308-89b5-41833e51f6ce None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:49.712452 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a3630-9724-4308-89b5-41833e51f6ce None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:49.720643 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:49.721350 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:49.721577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:49.721874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] PATH_INFO: `/v3/users/a734d078986d4b3d9028f2239d2ef9ee` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:49.723035 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a734d078986d4b3d9028f2239d2ef9ee)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:49.724999 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:49.776806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:49.790520 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a734d078986d4b3d9028f2239d2ef9ee'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:49.799926 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a734d078986d4b3d9028f2239d2ef9ee'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:49.800561 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a734d078986d4b3d9028f2239d2ef9ee'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:49.808906 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a734d078986d4b3d9028f2239d2ef9ee'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:49.822535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a734d078986d4b3d9028f2239d2ef9ee'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:49.829455 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1429/2820] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:17:49 2022] DELETE /identity/v3/users/a734d078986d4b3d9028f2239d2ef9ee => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:49.834372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb8e3-2e4c-430c-a6df-17e51a45cbb5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:49.835319 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb8e3-2e4c-430c-a6df-17e51a45cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:49.835864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb8e3-2e4c-430c-a6df-17e51a45cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:49.857776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5ceeb8e3-2e4c-430c-a6df-17e51a45cbb5 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:49.859077 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5ceeb8e3-2e4c-430c-a6df-17e51a45cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:49.927108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1392/2821] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:49.949713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:49.951250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:50.046116 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e6f8f-6b6a-405b-9ae6-f907a29726b6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:50.050068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a368a53-2cbf-42ac-b7bc-7c2436997b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:50.050762 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a368a53-2cbf-42ac-b7bc-7c2436997b86 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:50.051135 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a368a53-2cbf-42ac-b7bc-7c2436997b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:50.051472 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a368a53-2cbf-42ac-b7bc-7c2436997b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:50.060966 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a368a53-2cbf-42ac-b7bc-7c2436997b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:50.062441 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a368a53-2cbf-42ac-b7bc-7c2436997b86 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:50.076189 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1430/2822] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:50.437189 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb8e3-2e4c-430c-a6df-17e51a45cbb5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:50.442234 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5ceeb8e3-2e4c-430c-a6df-17e51a45cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:50.458445 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb8e3-2e4c-430c-a6df-17e51a45cbb5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:50.463980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:50.464830 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:50.465186 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:50.465492 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] PATH_INFO: `/v3/projects/bb4cd450d43049cfb0f43e6fae0932be` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:50.466660 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4cd450d43049cfb0f43e6fae0932be)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:50.468664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:50.526620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4cd450d43049cfb0f43e6fae0932be', 'request_id': 'req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:50.533080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4cd450d43049cfb0f43e6fae0932be', 'request_id': 'req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:50.541952 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4cd450d43049cfb0f43e6fae0932be', 'request_id': 'req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:50.557623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] The token cache is being invalidate because project bb4cd450d43049cfb0f43e6fae0932be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:17:50.557912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:50.558561 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fcf2c1a-a20e-4a9f-a04e-434b801653d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:50.560100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1393/2823] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:17:50 2022] DELETE /identity/v3/projects/bb4cd450d43049cfb0f43e6fae0932be => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:50.566250 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fc0cf-6349-48ac-bc33-41f38b3a3cec None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:50.567048 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fc0cf-6349-48ac-bc33-41f38b3a3cec None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:50.567222 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fc0cf-6349-48ac-bc33-41f38b3a3cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:50.590577 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e82fc0cf-6349-48ac-bc33-41f38b3a3cec None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:50.591843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e82fc0cf-6349-48ac-bc33-41f38b3a3cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:50.655055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1431/2824] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:50.663193 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56d741-f62c-487e-a9d4-1f7cd7c9cf96 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:50.663499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56d741-f62c-487e-a9d4-1f7cd7c9cf96 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:50.663803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56d741-f62c-487e-a9d4-1f7cd7c9cf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:50.691060 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-da56d741-f62c-487e-a9d4-1f7cd7c9cf96 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:50.692295 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-da56d741-f62c-487e-a9d4-1f7cd7c9cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:50.708853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1394/2825] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:50.713267 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fc0cf-6349-48ac-bc33-41f38b3a3cec None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:50.723871 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fc0cf-6349-48ac-bc33-41f38b3a3cec None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:50.729617 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785d6c-9a85-4f11-8ff4-937c3791ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:50.730294 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785d6c-9a85-4f11-8ff4-937c3791ff3c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:50.730568 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785d6c-9a85-4f11-8ff4-937c3791ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:50.730838 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785d6c-9a85-4f11-8ff4-937c3791ff3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:50.731556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785d6c-9a85-4f11-8ff4-937c3791ff3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:17:50.731861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785d6c-9a85-4f11-8ff4-937c3791ff3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:50.733502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785d6c-9a85-4f11-8ff4-937c3791ff3c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:50.752472 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56d741-f62c-487e-a9d4-1f7cd7c9cf96 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:50.755172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1432/2826] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 22:17:50.762975 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56d741-f62c-487e-a9d4-1f7cd7c9cf96 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:50.774014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a4a0-f698-48ec-9414-248353feb32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:50.774706 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a4a0-f698-48ec-9414-248353feb32c admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:50.775103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a4a0-f698-48ec-9414-248353feb32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:50.775434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a4a0-f698-48ec-9414-248353feb32c admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:50.776210 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7a4a0-f698-48ec-9414-248353feb32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:50.778217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7a4a0-f698-48ec-9414-248353feb32c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:50.810194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1395/2827] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:50 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:50.814709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785d6c-9a85-4f11-8ff4-937c3791ff3c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:50.826208 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785d6c-9a85-4f11-8ff4-937c3791ff3c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:50.867351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:50.890034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfca3a1-05e7-4bae-bf5e-2c5dd32991f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:50.890674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca3a1-05e7-4bae-bf5e-2c5dd32991f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:50.891182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca3a1-05e7-4bae-bf5e-2c5dd32991f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:50.891461 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca3a1-05e7-4bae-bf5e-2c5dd32991f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:50.892231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfca3a1-05e7-4bae-bf5e-2c5dd32991f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:50.894282 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfca3a1-05e7-4bae-bf5e-2c5dd32991f4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:50.920480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1433/2828] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:50 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:50.925103 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a4a0-f698-48ec-9414-248353feb32c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:50.935990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a4a0-f698-48ec-9414-248353feb32c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:50.941192 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec0d49-171a-4a47-a038-37a9b802cc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:50.941803 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0d49-171a-4a47-a038-37a9b802cc4e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:50.942104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0d49-171a-4a47-a038-37a9b802cc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:50.942423 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0d49-171a-4a47-a038-37a9b802cc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:50.943207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec0d49-171a-4a47-a038-37a9b802cc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:50.945070 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec0d49-171a-4a47-a038-37a9b802cc4e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:50.946940 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:50.962273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1396/2829] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:17:50.963444 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfca3a1-05e7-4bae-bf5e-2c5dd32991f4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:50.973822 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfca3a1-05e7-4bae-bf5e-2c5dd32991f4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:50.978521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db190b-17db-458a-b486-ca4dbe4088ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:50.979131 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db190b-17db-458a-b486-ca4dbe4088ac admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:50.979406 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db190b-17db-458a-b486-ca4dbe4088ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:50.979674 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db190b-17db-458a-b486-ca4dbe4088ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:50.980321 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db190b-17db-458a-b486-ca4dbe4088ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:50.981982 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db190b-17db-458a-b486-ca4dbe4088ac admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:50.994669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1434/2830] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:17:50.999651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec0d49-171a-4a47-a038-37a9b802cc4e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:51.014469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec0d49-171a-4a47-a038-37a9b802cc4e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:51.022313 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5aec9-0990-4510-8514-99c8f988efdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:51.023362 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5aec9-0990-4510-8514-99c8f988efdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:51.023800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5aec9-0990-4510-8514-99c8f988efdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:51.024167 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5aec9-0990-4510-8514-99c8f988efdf admin admin] PATH_INFO: `/v3/projects/bf139573d315472a89ec6d0c1fb15885/users/79f64778b5f94d828a51949b7bb61599/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:51.045460 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5aec9-0990-4510-8514-99c8f988efdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf139573d315472a89ec6d0c1fb15885, user_id=79f64778b5f94d828a51949b7bb61599, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:51.048846 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5aec9-0990-4510-8514-99c8f988efdf admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:51.065720 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1397/2831] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:50 2022] PUT /identity/v3/projects/bf139573d315472a89ec6d0c1fb15885/users/79f64778b5f94d828a51949b7bb61599/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:51.079795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd7bd-65c6-4749-b799-090b2533af6f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:51.079795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd7bd-65c6-4749-b799-090b2533af6f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:51.079795 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd7bd-65c6-4749-b799-090b2533af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:51.126138 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f44bd7bd-65c6-4749-b799-090b2533af6f None None] MFA Rules not processed for user `79f64778b5f94d828a51949b7bb61599`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:51.127391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f44bd7bd-65c6-4749-b799-090b2533af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:51.200060 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1435/2832] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:17:51.205128 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5aec9-0990-4510-8514-99c8f988efdf admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:51.293408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5aec9-0990-4510-8514-99c8f988efdf admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:51.303001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fd505-b34c-48d0-846b-2c13000ebbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:51.303636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd505-b34c-48d0-846b-2c13000ebbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:51.303914 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd505-b34c-48d0-846b-2c13000ebbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:51.304262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd505-b34c-48d0-846b-2c13000ebbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:51.304961 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fd505-b34c-48d0-846b-2c13000ebbc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:51.307500 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fd505-b34c-48d0-846b-2c13000ebbc9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:51.354112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1398/2833] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:51 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:51.358713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bd7bd-65c6-4749-b799-090b2533af6f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:51.370932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bd7bd-65c6-4749-b799-090b2533af6f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:51.448273 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24b98e-ec84-4799-b110-6d530a97ddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:51.449159 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24b98e-ec84-4799-b110-6d530a97ddba admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:51.449572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24b98e-ec84-4799-b110-6d530a97ddba admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:51.449952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24b98e-ec84-4799-b110-6d530a97ddba admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:51.450656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24b98e-ec84-4799-b110-6d530a97ddba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:51.452877 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24b98e-ec84-4799-b110-6d530a97ddba admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:51.479398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1436/2834] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:51 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:51.483499 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fd505-b34c-48d0-846b-2c13000ebbc9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:51.501872 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fd505-b34c-48d0-846b-2c13000ebbc9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:51.511849 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c0851-afe5-46e8-8497-b0dea31e4d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:51.512651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c0851-afe5-46e8-8497-b0dea31e4d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:51.512993 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c0851-afe5-46e8-8497-b0dea31e4d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:51.513388 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c0851-afe5-46e8-8497-b0dea31e4d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:51.514297 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c0851-afe5-46e8-8497-b0dea31e4d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:51.516258 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c0851-afe5-46e8-8497-b0dea31e4d23 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:51.532344 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1399/2835] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:51.533532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24b98e-ec84-4799-b110-6d530a97ddba admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:51.546797 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24b98e-ec84-4799-b110-6d530a97ddba admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:51.553553 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf6d27-2f23-4ea3-9643-7808738fe067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:51.554216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf6d27-2f23-4ea3-9643-7808738fe067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:51.554494 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf6d27-2f23-4ea3-9643-7808738fe067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:51.554759 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf6d27-2f23-4ea3-9643-7808738fe067 admin admin] PATH_INFO: `/v3/projects/089029f5d77a46e38f89ccf39accdb9d/users/0781b5c6769d46c08172b03bb482beaa/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:51.573679 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf6d27-2f23-4ea3-9643-7808738fe067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=089029f5d77a46e38f89ccf39accdb9d, user_id=0781b5c6769d46c08172b03bb482beaa, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:51.576357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf6d27-2f23-4ea3-9643-7808738fe067 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:51.605223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1437/2836] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:51 2022] PUT /identity/v3/projects/089029f5d77a46e38f89ccf39accdb9d/users/0781b5c6769d46c08172b03bb482beaa/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:51.605364 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c0851-afe5-46e8-8497-b0dea31e4d23 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:51.609969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c0851-afe5-46e8-8497-b0dea31e4d23 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:51.676149 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eee6d6-c8a7-459c-a47a-781017c7d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:51.676756 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eee6d6-c8a7-459c-a47a-781017c7d64e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:51.677029 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eee6d6-c8a7-459c-a47a-781017c7d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:51.677298 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eee6d6-c8a7-459c-a47a-781017c7d64e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:51.677976 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eee6d6-c8a7-459c-a47a-781017c7d64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:51.679690 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eee6d6-c8a7-459c-a47a-781017c7d64e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:51.690370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1400/2837] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:51.694901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf6d27-2f23-4ea3-9643-7808738fe067 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:51.705869 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf6d27-2f23-4ea3-9643-7808738fe067 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:51.711252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34099c64-d0f6-40c7-8944-60489b012962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:51.711896 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099c64-d0f6-40c7-8944-60489b012962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:51.712171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099c64-d0f6-40c7-8944-60489b012962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:51.712442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099c64-d0f6-40c7-8944-60489b012962 admin admin] PATH_INFO: `/v3/projects/089029f5d77a46e38f89ccf39accdb9d/users/0781b5c6769d46c08172b03bb482beaa/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:51.714428 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34099c64-d0f6-40c7-8944-60489b012962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=089029f5d77a46e38f89ccf39accdb9d, user_id=0781b5c6769d46c08172b03bb482beaa, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:51.718037 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34099c64-d0f6-40c7-8944-60489b012962 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:51.726936 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:51.732184 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1438/2838] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:51 2022] PUT /identity/v3/projects/089029f5d77a46e38f89ccf39accdb9d/users/0781b5c6769d46c08172b03bb482beaa/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:51.743694 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64797f6-e415-4eb1-a2ff-f60f3ab9eaf7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:51.743980 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64797f6-e415-4eb1-a2ff-f60f3ab9eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:51.744269 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64797f6-e415-4eb1-a2ff-f60f3ab9eaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:51.772560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a64797f6-e415-4eb1-a2ff-f60f3ab9eaf7 None None] MFA Rules not processed for user `0781b5c6769d46c08172b03bb482beaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:51.773754 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a64797f6-e415-4eb1-a2ff-f60f3ab9eaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:51.805408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:51.846643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1401/2839] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:51.859052 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34099c64-d0f6-40c7-8944-60489b012962 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:51.861580 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-34099c64-d0f6-40c7-8944-60489b012962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:51.926813 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34099c64-d0f6-40c7-8944-60489b012962 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:51.932198 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b23db-b508-4f23-8df1-d79ff3f9c6ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:51.933077 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b23db-b508-4f23-8df1-d79ff3f9c6ee service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:51.933387 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b23db-b508-4f23-8df1-d79ff3f9c6ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:51.933799 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b23db-b508-4f23-8df1-d79ff3f9c6ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:51.995416 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b23db-b508-4f23-8df1-d79ff3f9c6ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:51.996857 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b23db-b508-4f23-8df1-d79ff3f9c6ee service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:52.006023 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1439/2840] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:54.650194 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64797f6-e415-4eb1-a2ff-f60f3ab9eaf7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:54.716692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64797f6-e415-4eb1-a2ff-f60f3ab9eaf7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:54.738036 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:54.739022 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:54.739518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:54.740112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] PATH_INFO: `/v3/users/79f64778b5f94d828a51949b7bb61599` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:54.741643 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f64778b5f94d828a51949b7bb61599)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:54.744268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:54.806276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f64778b5f94d828a51949b7bb61599'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:54.806678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f64778b5f94d828a51949b7bb61599'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:54.817802 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f64778b5f94d828a51949b7bb61599'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:54.831029 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f64778b5f94d828a51949b7bb61599'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:54.832001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f64778b5f94d828a51949b7bb61599'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:54.869012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1402/2841] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:17:54 2022] DELETE /identity/v3/users/79f64778b5f94d828a51949b7bb61599 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:54.873512 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a758e-913d-4120-8110-007f991680a8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:54.874059 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a758e-913d-4120-8110-007f991680a8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:54.874710 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a758e-913d-4120-8110-007f991680a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:54.901009 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ba8a758e-913d-4120-8110-007f991680a8 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:54.903166 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ba8a758e-913d-4120-8110-007f991680a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:55.021991 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1440/2842] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:55.077651 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:55.079632 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:55.170010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:55.177937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d47a26-94ea-4103-bdd2-88d34f67efe2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:55.186024 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52288578-69ed-4cf7-8f76-271756cb100b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:55.186645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52288578-69ed-4cf7-8f76-271756cb100b service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:55.187245 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52288578-69ed-4cf7-8f76-271756cb100b service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:55.188085 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52288578-69ed-4cf7-8f76-271756cb100b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:55.199813 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52288578-69ed-4cf7-8f76-271756cb100b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:55.202021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52288578-69ed-4cf7-8f76-271756cb100b service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:55.220930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1403/2843] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:17:55.749750 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a758e-913d-4120-8110-007f991680a8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:55.751363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ba8a758e-913d-4120-8110-007f991680a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:55.763858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a758e-913d-4120-8110-007f991680a8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:55.779930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:55.780783 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:55.781281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:55.781665 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] PATH_INFO: `/v3/projects/bf139573d315472a89ec6d0c1fb15885` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:55.783211 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf139573d315472a89ec6d0c1fb15885)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:55.785758 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:55.834808 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf139573d315472a89ec6d0c1fb15885', 'request_id': 'req-50151dea-b65f-4253-b950-65588dc9e076'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:55.836637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:55.845083 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf139573d315472a89ec6d0c1fb15885', 'request_id': 'req-50151dea-b65f-4253-b950-65588dc9e076'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:55.851569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf139573d315472a89ec6d0c1fb15885', 'request_id': 'req-50151dea-b65f-4253-b950-65588dc9e076'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:55.863661 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] The token cache is being invalidate because project bf139573d315472a89ec6d0c1fb15885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:17:55.863958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:55.864614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:55.866160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1441/2844] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:17:55 2022] DELETE /identity/v3/projects/bf139573d315472a89ec6d0c1fb15885 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:55.870337 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52288578-69ed-4cf7-8f76-271756cb100b service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:55.880698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52288578-69ed-4cf7-8f76-271756cb100b service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:55.941573 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5648d-040c-4dde-9919-e6d522494126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:55.942154 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5648d-040c-4dde-9919-e6d522494126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:55.942432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5648d-040c-4dde-9919-e6d522494126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:55.942702 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5648d-040c-4dde-9919-e6d522494126 admin admin] PATH_INFO: `/v3/users/0781b5c6769d46c08172b03bb482beaa` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:55.943816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5648d-040c-4dde-9919-e6d522494126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0781b5c6769d46c08172b03bb482beaa)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:55.945866 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5648d-040c-4dde-9919-e6d522494126 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:55.997611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c8a5648d-040c-4dde-9919-e6d522494126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0781b5c6769d46c08172b03bb482beaa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:55.998597 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c8a5648d-040c-4dde-9919-e6d522494126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0781b5c6769d46c08172b03bb482beaa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:56.007338 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c8a5648d-040c-4dde-9919-e6d522494126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0781b5c6769d46c08172b03bb482beaa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:56.015534 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c8a5648d-040c-4dde-9919-e6d522494126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0781b5c6769d46c08172b03bb482beaa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:56.016260 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c8a5648d-040c-4dde-9919-e6d522494126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0781b5c6769d46c08172b03bb482beaa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:56.035827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1404/2845] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:17:55 2022] DELETE /identity/v3/users/0781b5c6769d46c08172b03bb482beaa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:56.330854 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:56.332711 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:56.359666 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50151dea-b65f-4253-b950-65588dc9e076 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:56.418476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:56.419227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:56.419569 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:56.419938 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] PATH_INFO: `/v3/projects/089029f5d77a46e38f89ccf39accdb9d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:56.421153 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] RBAC: Authorizing `identity:delete_project(project_id=089029f5d77a46e38f89ccf39accdb9d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:56.423157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:56.474819 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '089029f5d77a46e38f89ccf39accdb9d', 'request_id': 'req-5b93a62d-5dfb-44c0-9010-72f2771f656a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:56.484058 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '089029f5d77a46e38f89ccf39accdb9d', 'request_id': 'req-5b93a62d-5dfb-44c0-9010-72f2771f656a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:56.491306 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '089029f5d77a46e38f89ccf39accdb9d', 'request_id': 'req-5b93a62d-5dfb-44c0-9010-72f2771f656a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:56.503849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] The token cache is being invalidate because project 089029f5d77a46e38f89ccf39accdb9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:17:56.504264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:56.504917 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5b93a62d-5dfb-44c0-9010-72f2771f656a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:17:56.506696 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1442/2846] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:17:56 2022] DELETE /identity/v3/projects/089029f5d77a46e38f89ccf39accdb9d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:56.512262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef3b3-ea7d-48a5-ab34-e25d6ef9569b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:56.512664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef3b3-ea7d-48a5-ab34-e25d6ef9569b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:56.512948 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef3b3-ea7d-48a5-ab34-e25d6ef9569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:56.538616 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-007ef3b3-ea7d-48a5-ab34-e25d6ef9569b None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:56.539915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-007ef3b3-ea7d-48a5-ab34-e25d6ef9569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:56.605201 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1405/2847] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:56.613272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd118d-81d6-4b7d-8c13-ea95e0ce38db None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:56.613892 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd118d-81d6-4b7d-8c13-ea95e0ce38db None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:56.614262 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd118d-81d6-4b7d-8c13-ea95e0ce38db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:56.636227 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-decd118d-81d6-4b7d-8c13-ea95e0ce38db None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:56.637613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-decd118d-81d6-4b7d-8c13-ea95e0ce38db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:56.649863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1443/2848] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:56.650983 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ef3b3-ea7d-48a5-ab34-e25d6ef9569b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:56.672489 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ef3b3-ea7d-48a5-ab34-e25d6ef9569b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:56.678061 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392895-25dd-49b6-824c-554edcdf718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:56.678402 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392895-25dd-49b6-824c-554edcdf718f admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:56.678679 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392895-25dd-49b6-824c-554edcdf718f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:56.678950 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392895-25dd-49b6-824c-554edcdf718f admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:56.679764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41392895-25dd-49b6-824c-554edcdf718f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:17:56.680318 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41392895-25dd-49b6-824c-554edcdf718f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:56.681979 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41392895-25dd-49b6-824c-554edcdf718f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:56.685421 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:56.699226 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1406/2849] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:17:56.702694 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd118d-81d6-4b7d-8c13-ea95e0ce38db None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:56.713930 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd118d-81d6-4b7d-8c13-ea95e0ce38db None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:56.722066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c667dd-d03d-4233-b1fc-90a43dda3749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:56.722692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c667dd-d03d-4233-b1fc-90a43dda3749 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:56.722974 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c667dd-d03d-4233-b1fc-90a43dda3749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:56.723241 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c667dd-d03d-4233-b1fc-90a43dda3749 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:56.724001 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c667dd-d03d-4233-b1fc-90a43dda3749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:56.726157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c667dd-d03d-4233-b1fc-90a43dda3749 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:56.755995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1444/2850] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:17:56 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:17:56.760430 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392895-25dd-49b6-824c-554edcdf718f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:56.771030 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392895-25dd-49b6-824c-554edcdf718f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:56.833118 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c52d96-7ba0-4397-9cbf-6d715412a945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:56.833734 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c52d96-7ba0-4397-9cbf-6d715412a945 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:56.834051 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c52d96-7ba0-4397-9cbf-6d715412a945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:56.834790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c52d96-7ba0-4397-9cbf-6d715412a945 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:56.834982 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c52d96-7ba0-4397-9cbf-6d715412a945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:56.837131 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c52d96-7ba0-4397-9cbf-6d715412a945 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:56.874864 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1407/2851] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:17:56 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:17:56.875635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c667dd-d03d-4233-b1fc-90a43dda3749 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:56.896345 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c667dd-d03d-4233-b1fc-90a43dda3749 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:56.905672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f25b74-1ace-4a6b-a9f9-eb2ce397df7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:56.906357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f25b74-1ace-4a6b-a9f9-eb2ce397df7b admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:56.906830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f25b74-1ace-4a6b-a9f9-eb2ce397df7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:56.906947 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f25b74-1ace-4a6b-a9f9-eb2ce397df7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:56.908014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f25b74-1ace-4a6b-a9f9-eb2ce397df7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:56.911100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f25b74-1ace-4a6b-a9f9-eb2ce397df7b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:56.931727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c52d96-7ba0-4397-9cbf-6d715412a945 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:56.942155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1445/2852] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:17:56.943426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c52d96-7ba0-4397-9cbf-6d715412a945 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:56.949903 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d562f51-0631-4898-9947-bed98b6e16a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:56.950745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d562f51-0631-4898-9947-bed98b6e16a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:56.951040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d562f51-0631-4898-9947-bed98b6e16a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:56.951334 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d562f51-0631-4898-9947-bed98b6e16a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:56.951998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d562f51-0631-4898-9947-bed98b6e16a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:56.953664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d562f51-0631-4898-9947-bed98b6e16a7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:56.968107 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1408/2853] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:17:56.972692 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f25b74-1ace-4a6b-a9f9-eb2ce397df7b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:56.985457 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f25b74-1ace-4a6b-a9f9-eb2ce397df7b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:56.991876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc03aa-93ba-476e-96ef-9ee09d860df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:56.992721 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc03aa-93ba-476e-96ef-9ee09d860df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:56.993068 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc03aa-93ba-476e-96ef-9ee09d860df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:56.993981 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc03aa-93ba-476e-96ef-9ee09d860df7 admin admin] PATH_INFO: `/v3/projects/50f414d9cbf84d64bfb583a0272ae220/users/3f8d221d7b1a40e3b6d2fc79c3e017e6/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:57.014016 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc03aa-93ba-476e-96ef-9ee09d860df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f414d9cbf84d64bfb583a0272ae220, user_id=3f8d221d7b1a40e3b6d2fc79c3e017e6, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:57.016858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc03aa-93ba-476e-96ef-9ee09d860df7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:57.033533 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1446/2854] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:17:56 2022] PUT /identity/v3/projects/50f414d9cbf84d64bfb583a0272ae220/users/3f8d221d7b1a40e3b6d2fc79c3e017e6/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:17:57.103165 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6468d7a-33f8-4e16-b069-74cedac9f33c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:57.103444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6468d7a-33f8-4e16-b069-74cedac9f33c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:57.103744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6468d7a-33f8-4e16-b069-74cedac9f33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:57.133098 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d6468d7a-33f8-4e16-b069-74cedac9f33c None None] MFA Rules not processed for user `3f8d221d7b1a40e3b6d2fc79c3e017e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:17:57.134380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d6468d7a-33f8-4e16-b069-74cedac9f33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:57.203733 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1409/2855] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:17:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:17:57.216270 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc03aa-93ba-476e-96ef-9ee09d860df7 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:17:57.218468 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d3cc03aa-93ba-476e-96ef-9ee09d860df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:17:57.226150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:57.285168 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc03aa-93ba-476e-96ef-9ee09d860df7 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:17:57.289223 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5a9cc-cbc1-4943-b4c3-8f2f262033f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:17:57.289868 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5a9cc-cbc1-4943-b4c3-8f2f262033f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:17:57.290149 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5a9cc-cbc1-4943-b4c3-8f2f262033f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:17:57.290407 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5a9cc-cbc1-4943-b4c3-8f2f262033f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:17:57.311380 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5a9cc-cbc1-4943-b4c3-8f2f262033f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:17:57.312839 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5a9cc-cbc1-4943-b4c3-8f2f262033f5 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:17:57.323656 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1447/2856] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:17:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:18:05.390276 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6468d7a-33f8-4e16-b069-74cedac9f33c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:05.392560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d6468d7a-33f8-4e16-b069-74cedac9f33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:05.488764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6468d7a-33f8-4e16-b069-74cedac9f33c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:05.498922 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b46c9-4c65-45c3-be5a-a33c5dea2b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:05.499623 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b46c9-4c65-45c3-be5a-a33c5dea2b44 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:05.499829 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b46c9-4c65-45c3-be5a-a33c5dea2b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:05.500104 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b46c9-4c65-45c3-be5a-a33c5dea2b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:05.502782 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-101b46c9-4c65-45c3-be5a-a33c5dea2b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:05.548253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:05.620895 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b46c9-4c65-45c3-be5a-a33c5dea2b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:05.622602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b46c9-4c65-45c3-be5a-a33c5dea2b44 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:05.637142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1410/2857] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:18:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:18:07.175879 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd483ea2-dcf9-418e-ad71-263dca1845ae None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:07.176398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd483ea2-dcf9-418e-ad71-263dca1845ae None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:07.176398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd483ea2-dcf9-418e-ad71-263dca1845ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:07.197129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fd483ea2-dcf9-418e-ad71-263dca1845ae None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:07.198375 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fd483ea2-dcf9-418e-ad71-263dca1845ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:07.258193 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1448/2858] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:18:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:18:07.280594 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b46c9-4c65-45c3-be5a-a33c5dea2b44 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:07.282372 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-101b46c9-4c65-45c3-be5a-a33c5dea2b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:07.364357 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b46c9-4c65-45c3-be5a-a33c5dea2b44 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:07.370236 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0637b-6220-42a9-8484-fa1d9ecb6b5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:07.370962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0637b-6220-42a9-8484-fa1d9ecb6b5a service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:07.371253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0637b-6220-42a9-8484-fa1d9ecb6b5a service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:07.371556 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0637b-6220-42a9-8484-fa1d9ecb6b5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:07.380509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0637b-6220-42a9-8484-fa1d9ecb6b5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:07.382156 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0637b-6220-42a9-8484-fa1d9ecb6b5a service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:07.391245 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1411/2859] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:18:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:18:08.091368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94b34c-6a4b-4190-a84f-86d1dbbf3ab9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:08.091658 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94b34c-6a4b-4190-a84f-86d1dbbf3ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:08.091932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94b34c-6a4b-4190-a84f-86d1dbbf3ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:08.117989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3d94b34c-6a4b-4190-a84f-86d1dbbf3ab9 None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:08.119040 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3d94b34c-6a4b-4190-a84f-86d1dbbf3ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:08.128937 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1449/2860] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 22 22:18:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:18:08.145375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0637b-6220-42a9-8484-fa1d9ecb6b5a service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:08.160263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0637b-6220-42a9-8484-fa1d9ecb6b5a service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:08.180162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6102-9ea1-4a7c-a66f-d33c09324543 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:08.180162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6102-9ea1-4a7c-a66f-d33c09324543 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:08.180162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6102-9ea1-4a7c-a66f-d33c09324543 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:08.180162 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6102-9ea1-4a7c-a66f-d33c09324543 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:08.187211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a6102-9ea1-4a7c-a66f-d33c09324543 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:08.189805 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a6102-9ea1-4a7c-a66f-d33c09324543 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:08.212117 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1412/2861] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:18:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:18:08.570883 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41d10d-a83e-4ad7-b7a7-6e5a9f32cc6a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:08.572460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41d10d-a83e-4ad7-b7a7-6e5a9f32cc6a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:08.572790 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41d10d-a83e-4ad7-b7a7-6e5a9f32cc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:08.598923 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ce41d10d-a83e-4ad7-b7a7-6e5a9f32cc6a None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:08.600563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ce41d10d-a83e-4ad7-b7a7-6e5a9f32cc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:08.608476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1450/2862] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 22 22:18:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:18:08.625913 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6102-9ea1-4a7c-a66f-d33c09324543 service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:08.638937 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6102-9ea1-4a7c-a66f-d33c09324543 service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:08.650549 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeaf2d-4c18-47de-85e7-9568af972017 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:08.651329 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeaf2d-4c18-47de-85e7-9568af972017 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:08.651670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeaf2d-4c18-47de-85e7-9568af972017 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:08.652025 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeaf2d-4c18-47de-85e7-9568af972017 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:08.668582 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeaf2d-4c18-47de-85e7-9568af972017 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:08.670784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeaf2d-4c18-47de-85e7-9568af972017 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:08.681190 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1413/2863] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:18:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:18:09.052466 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81afb-35ff-4840-9807-76ad82752472 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:09.052743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81afb-35ff-4840-9807-76ad82752472 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:09.053012 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81afb-35ff-4840-9807-76ad82752472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:09.073551 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b4f81afb-35ff-4840-9807-76ad82752472 None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:09.074891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b4f81afb-35ff-4840-9807-76ad82752472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:09.085988 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1451/2864] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 22 22:18:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:18:09.100558 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeaf2d-4c18-47de-85e7-9568af972017 service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:09.112016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeaf2d-4c18-47de-85e7-9568af972017 service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:09.117784 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc62565-075a-4269-a313-419b04c15b5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:09.118459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc62565-075a-4269-a313-419b04c15b5c service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:09.118738 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc62565-075a-4269-a313-419b04c15b5c service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:09.119006 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc62565-075a-4269-a313-419b04c15b5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:09.127789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc62565-075a-4269-a313-419b04c15b5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:09.129567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc62565-075a-4269-a313-419b04c15b5c service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:09.138981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1414/2865] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:18:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:18:09.363874 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81afb-35ff-4840-9807-76ad82752472 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:09.488520 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81afb-35ff-4840-9807-76ad82752472 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:09.496730 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:09.498197 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:09.498549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:09.498891 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] PATH_INFO: `/v3/users/3f8d221d7b1a40e3b6d2fc79c3e017e6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:09.501046 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8d221d7b1a40e3b6d2fc79c3e017e6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:09.507823 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:09.584399 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:09.624004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8d221d7b1a40e3b6d2fc79c3e017e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:09.642979 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8d221d7b1a40e3b6d2fc79c3e017e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:09.643967 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8d221d7b1a40e3b6d2fc79c3e017e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:09.655546 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8d221d7b1a40e3b6d2fc79c3e017e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:09.672206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8d221d7b1a40e3b6d2fc79c3e017e6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:09.681887 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1452/2866] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:18:09 2022] DELETE /identity/v3/users/3f8d221d7b1a40e3b6d2fc79c3e017e6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:09.683474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70876f-80f2-4fd0-9e25-60001104dcf4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:09.684282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70876f-80f2-4fd0-9e25-60001104dcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:09.684731 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70876f-80f2-4fd0-9e25-60001104dcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:09.724212 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5f70876f-80f2-4fd0-9e25-60001104dcf4 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:09.725987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5f70876f-80f2-4fd0-9e25-60001104dcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:09.809248 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1415/2867] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:18:09.823311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:09.826600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:09.898698 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b0ef8-b354-457d-9a08-ecf3c61ffa7f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:09.902610 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db49e1-33fe-4be4-b89a-83ad325bde35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:09.903232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db49e1-33fe-4be4-b89a-83ad325bde35 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:09.903510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db49e1-33fe-4be4-b89a-83ad325bde35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:09.903780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db49e1-33fe-4be4-b89a-83ad325bde35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:09.913637 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db49e1-33fe-4be4-b89a-83ad325bde35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:09.915127 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db49e1-33fe-4be4-b89a-83ad325bde35 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:09.926244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1453/2868] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:18:10.407393 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70876f-80f2-4fd0-9e25-60001104dcf4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:10.409200 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5f70876f-80f2-4fd0-9e25-60001104dcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:10.427970 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:10.433650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70876f-80f2-4fd0-9e25-60001104dcf4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:10.441663 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:10.442671 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:10.443164 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:10.443504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] PATH_INFO: `/v3/projects/50f414d9cbf84d64bfb583a0272ae220` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:10.444808 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f414d9cbf84d64bfb583a0272ae220)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:10.447907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:10.525211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f414d9cbf84d64bfb583a0272ae220', 'request_id': 'req-6fb6ca02-c27f-43ac-8359-345e4650190f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:10.536075 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f414d9cbf84d64bfb583a0272ae220', 'request_id': 'req-6fb6ca02-c27f-43ac-8359-345e4650190f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:10.548946 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f414d9cbf84d64bfb583a0272ae220', 'request_id': 'req-6fb6ca02-c27f-43ac-8359-345e4650190f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:10.563176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] The token cache is being invalidate because project 50f414d9cbf84d64bfb583a0272ae220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:18:10.563462 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:10.564186 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6fb6ca02-c27f-43ac-8359-345e4650190f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:10.566187 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1416/2869] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:18:10 2022] DELETE /identity/v3/projects/50f414d9cbf84d64bfb583a0272ae220 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:10.571806 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef98b-47ec-4985-ba36-c601a19ea14e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:10.572084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef98b-47ec-4985-ba36-c601a19ea14e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:10.572410 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef98b-47ec-4985-ba36-c601a19ea14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:10.594443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-971ef98b-47ec-4985-ba36-c601a19ea14e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:10.595672 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-971ef98b-47ec-4985-ba36-c601a19ea14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:10.674457 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1454/2870] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:18:10.684095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119e954-965e-405f-b54b-b8b8a5d4a44e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:10.684615 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119e954-965e-405f-b54b-b8b8a5d4a44e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:10.684711 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119e954-965e-405f-b54b-b8b8a5d4a44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:10.709328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6119e954-965e-405f-b54b-b8b8a5d4a44e None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:10.710816 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6119e954-965e-405f-b54b-b8b8a5d4a44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:10.722916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1417/2871] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:18:10.727606 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ef98b-47ec-4985-ba36-c601a19ea14e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:10.739487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ef98b-47ec-4985-ba36-c601a19ea14e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:10.744830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ff6b2-2d83-4d3d-b15d-0c4d9b6059cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:10.745551 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ff6b2-2d83-4d3d-b15d-0c4d9b6059cc admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:10.745881 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ff6b2-2d83-4d3d-b15d-0c4d9b6059cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:10.746129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ff6b2-2d83-4d3d-b15d-0c4d9b6059cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:10.746784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ff6b2-2d83-4d3d-b15d-0c4d9b6059cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:18:10.747125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ff6b2-2d83-4d3d-b15d-0c4d9b6059cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:10.749129 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ff6b2-2d83-4d3d-b15d-0c4d9b6059cc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:10.764248 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1455/2872] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:18:10.769466 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119e954-965e-405f-b54b-b8b8a5d4a44e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:10.780669 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119e954-965e-405f-b54b-b8b8a5d4a44e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:10.786627 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868f70-1a82-49b0-988a-bb1a8a9808c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:10.787280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868f70-1a82-49b0-988a-bb1a8a9808c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:10.787558 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868f70-1a82-49b0-988a-bb1a8a9808c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:10.787827 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868f70-1a82-49b0-988a-bb1a8a9808c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:10.788484 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87868f70-1a82-49b0-988a-bb1a8a9808c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:10.790426 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87868f70-1a82-49b0-988a-bb1a8a9808c1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:10.822912 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1418/2873] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:18:10 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:18:10.827171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ff6b2-2d83-4d3d-b15d-0c4d9b6059cc admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:10.838673 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ff6b2-2d83-4d3d-b15d-0c4d9b6059cc admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:10.884160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:10.903686 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888c93-d9ea-4b1c-954c-8fafb638d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:10.904360 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888c93-d9ea-4b1c-954c-8fafb638d931 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:10.904632 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888c93-d9ea-4b1c-954c-8fafb638d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:10.904906 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888c93-d9ea-4b1c-954c-8fafb638d931 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:10.905602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888c93-d9ea-4b1c-954c-8fafb638d931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:10.907734 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888c93-d9ea-4b1c-954c-8fafb638d931 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:10.929307 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1456/2874] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:18:10 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:18:10.934307 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868f70-1a82-49b0-988a-bb1a8a9808c1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:10.945692 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868f70-1a82-49b0-988a-bb1a8a9808c1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:10.951273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0afff-1044-4fa9-887b-8aada80abf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:10.952105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0afff-1044-4fa9-887b-8aada80abf99 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:10.952469 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0afff-1044-4fa9-887b-8aada80abf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:10.952804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0afff-1044-4fa9-887b-8aada80abf99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:10.953595 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0afff-1044-4fa9-887b-8aada80abf99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:10.955870 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0afff-1044-4fa9-887b-8aada80abf99 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:10.967636 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1419/2875] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:18:10.971751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888c93-d9ea-4b1c-954c-8fafb638d931 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:10.982066 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888c93-d9ea-4b1c-954c-8fafb638d931 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:10.987486 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fab938-0a7d-4772-a520-d34b87e617c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:10.988160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fab938-0a7d-4772-a520-d34b87e617c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:10.988439 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fab938-0a7d-4772-a520-d34b87e617c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:10.988713 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fab938-0a7d-4772-a520-d34b87e617c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:10.989363 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fab938-0a7d-4772-a520-d34b87e617c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:10.991003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fab938-0a7d-4772-a520-d34b87e617c3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.002242 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1457/2876] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:18:11.006728 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0afff-1044-4fa9-887b-8aada80abf99 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.016987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0afff-1044-4fa9-887b-8aada80abf99 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.022355 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3247c1-70fd-4dd7-a0a9-78622aa3fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.023005 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3247c1-70fd-4dd7-a0a9-78622aa3fd95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.023278 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3247c1-70fd-4dd7-a0a9-78622aa3fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.023548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3247c1-70fd-4dd7-a0a9-78622aa3fd95 admin admin] PATH_INFO: `/v3/projects/a58722539d5343efbeda01e64bae27d7/users/2dd69582e5e64f1fb3a8ede458602794/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.038916 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3247c1-70fd-4dd7-a0a9-78622aa3fd95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58722539d5343efbeda01e64bae27d7, user_id=2dd69582e5e64f1fb3a8ede458602794, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.041590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3247c1-70fd-4dd7-a0a9-78622aa3fd95 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.058583 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1420/2877] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:18:11 2022] PUT /identity/v3/projects/a58722539d5343efbeda01e64bae27d7/users/2dd69582e5e64f1fb3a8ede458602794/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:11.070531 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab8421-9cfb-4896-bc63-7ca1ab5b9455 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.070817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab8421-9cfb-4896-bc63-7ca1ab5b9455 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.071091 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab8421-9cfb-4896-bc63-7ca1ab5b9455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.099140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-12ab8421-9cfb-4896-bc63-7ca1ab5b9455 None None] MFA Rules not processed for user `2dd69582e5e64f1fb3a8ede458602794`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:11.100369 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-12ab8421-9cfb-4896-bc63-7ca1ab5b9455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:11.170191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1458/2878] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:18:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:18:11.174962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3247c1-70fd-4dd7-a0a9-78622aa3fd95 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.240094 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3247c1-70fd-4dd7-a0a9-78622aa3fd95 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.245742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdf92d-7875-413f-8982-a39661adb8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.246375 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdf92d-7875-413f-8982-a39661adb8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.246650 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdf92d-7875-413f-8982-a39661adb8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.246915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdf92d-7875-413f-8982-a39661adb8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.247562 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdf92d-7875-413f-8982-a39661adb8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.249447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdf92d-7875-413f-8982-a39661adb8f6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.278672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1421/2879] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:18:11 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:18:11.282972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab8421-9cfb-4896-bc63-7ca1ab5b9455 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.294563 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab8421-9cfb-4896-bc63-7ca1ab5b9455 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.355682 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9e87a-578f-44d6-bccb-a6348bc6cf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.356535 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9e87a-578f-44d6-bccb-a6348bc6cf7f admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.356876 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9e87a-578f-44d6-bccb-a6348bc6cf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.357210 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9e87a-578f-44d6-bccb-a6348bc6cf7f admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.358202 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9e87a-578f-44d6-bccb-a6348bc6cf7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.361140 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9e87a-578f-44d6-bccb-a6348bc6cf7f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.386161 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1459/2880] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:18:11 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:18:11.390432 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdf92d-7875-413f-8982-a39661adb8f6 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.401002 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdf92d-7875-413f-8982-a39661adb8f6 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.405910 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399b22f-8f78-40da-929a-400b6f9f65d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.406580 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399b22f-8f78-40da-929a-400b6f9f65d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.406862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399b22f-8f78-40da-929a-400b6f9f65d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.407133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399b22f-8f78-40da-929a-400b6f9f65d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.407783 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399b22f-8f78-40da-929a-400b6f9f65d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.409382 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399b22f-8f78-40da-929a-400b6f9f65d0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.411586 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:11.422121 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1422/2881] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:18:11.425614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9e87a-578f-44d6-bccb-a6348bc6cf7f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.435765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9e87a-578f-44d6-bccb-a6348bc6cf7f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.440932 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb385f5e-7baf-4cd3-b2c3-3f6fcec10958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.441536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385f5e-7baf-4cd3-b2c3-3f6fcec10958 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.441821 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385f5e-7baf-4cd3-b2c3-3f6fcec10958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.442130 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385f5e-7baf-4cd3-b2c3-3f6fcec10958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.442760 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb385f5e-7baf-4cd3-b2c3-3f6fcec10958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.444346 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb385f5e-7baf-4cd3-b2c3-3f6fcec10958 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.454600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1460/2882] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:18:11.459342 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399b22f-8f78-40da-929a-400b6f9f65d0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.469444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399b22f-8f78-40da-929a-400b6f9f65d0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.474540 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425fc9-044d-4866-8b00-0035b02d9d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.475199 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425fc9-044d-4866-8b00-0035b02d9d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.475474 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425fc9-044d-4866-8b00-0035b02d9d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.475789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425fc9-044d-4866-8b00-0035b02d9d9f admin admin] PATH_INFO: `/v3/projects/ccec3b04e53b41208bd2a4a69c0cfe07/users/8c32d5e6f4e14d5fababe8317da2f793/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.491810 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70425fc9-044d-4866-8b00-0035b02d9d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccec3b04e53b41208bd2a4a69c0cfe07, user_id=8c32d5e6f4e14d5fababe8317da2f793, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.494447 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70425fc9-044d-4866-8b00-0035b02d9d9f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.512775 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1423/2883] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:18:11 2022] PUT /identity/v3/projects/ccec3b04e53b41208bd2a4a69c0cfe07/users/8c32d5e6f4e14d5fababe8317da2f793/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:11.526735 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ba049-14c4-4956-a383-97bfa83ce571 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.527059 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ba049-14c4-4956-a383-97bfa83ce571 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.527370 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ba049-14c4-4956-a383-97bfa83ce571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.559169 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-643ba049-14c4-4956-a383-97bfa83ce571 None None] MFA Rules not processed for user `8c32d5e6f4e14d5fababe8317da2f793`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:11.560384 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-643ba049-14c4-4956-a383-97bfa83ce571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:11.567811 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425fc9-044d-4866-8b00-0035b02d9d9f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.569744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-70425fc9-044d-4866-8b00-0035b02d9d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:11.578858 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:11.628743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1461/2884] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:18:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:18:11.633547 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ba049-14c4-4956-a383-97bfa83ce571 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.641639 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425fc9-044d-4866-8b00-0035b02d9d9f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.644384 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ba049-14c4-4956-a383-97bfa83ce571 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.646593 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb57bc-5807-44b7-838e-4ad4e2ed4a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.647233 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb57bc-5807-44b7-838e-4ad4e2ed4a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.647504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb57bc-5807-44b7-838e-4ad4e2ed4a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.647769 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb57bc-5807-44b7-838e-4ad4e2ed4a4b admin admin] PATH_INFO: `/v3/users/b6a85ed8a8a744ddaca15a7ba838cfa3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.648992 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb57bc-5807-44b7-838e-4ad4e2ed4a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a85ed8a8a744ddaca15a7ba838cfa3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.649420 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df85260-49d9-4008-b7c5-4128d8ceef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.650045 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85260-49d9-4008-b7c5-4128d8ceef05 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.650319 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85260-49d9-4008-b7c5-4128d8ceef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.650590 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85260-49d9-4008-b7c5-4128d8ceef05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.651010 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb57bc-5807-44b7-838e-4ad4e2ed4a4b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.651216 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df85260-49d9-4008-b7c5-4128d8ceef05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.653094 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df85260-49d9-4008-b7c5-4128d8ceef05 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.683980 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1462/2885] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:18:11 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:18:11.688778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df85260-49d9-4008-b7c5-4128d8ceef05 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.702742 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4bb57bc-5807-44b7-838e-4ad4e2ed4a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a85ed8a8a744ddaca15a7ba838cfa3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:11.704102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4bb57bc-5807-44b7-838e-4ad4e2ed4a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a85ed8a8a744ddaca15a7ba838cfa3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:11.714429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4bb57bc-5807-44b7-838e-4ad4e2ed4a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a85ed8a8a744ddaca15a7ba838cfa3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:11.722517 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4bb57bc-5807-44b7-838e-4ad4e2ed4a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a85ed8a8a744ddaca15a7ba838cfa3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:11.723262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b4bb57bc-5807-44b7-838e-4ad4e2ed4a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a85ed8a8a744ddaca15a7ba838cfa3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:11.742145 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1424/2886] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:18:11 2022] DELETE /identity/v3/users/b6a85ed8a8a744ddaca15a7ba838cfa3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:18:11.746387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f995a4-0a66-4593-b892-bc906a0819c3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.746664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f995a4-0a66-4593-b892-bc906a0819c3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.746931 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f995a4-0a66-4593-b892-bc906a0819c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.754172 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df85260-49d9-4008-b7c5-4128d8ceef05 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.766092 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f0f995a4-0a66-4593-b892-bc906a0819c3 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:11.767293 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f0f995a4-0a66-4593-b892-bc906a0819c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:11.811050 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc7bac-54c1-48d3-b1f8-e57b75549c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.811669 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc7bac-54c1-48d3-b1f8-e57b75549c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.812000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc7bac-54c1-48d3-b1f8-e57b75549c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.812274 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc7bac-54c1-48d3-b1f8-e57b75549c7b admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.812629 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:11.812918 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc7bac-54c1-48d3-b1f8-e57b75549c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.814852 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc7bac-54c1-48d3-b1f8-e57b75549c7b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.827459 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1425/2887] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 22:18:11.840457 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1463/2888] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:18:11 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:18:11.840619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f995a4-0a66-4593-b892-bc906a0819c3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.840619 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f0f995a4-0a66-4593-b892-bc906a0819c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:11.841429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc7bac-54c1-48d3-b1f8-e57b75549c7b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.843252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dabc7bac-54c1-48d3-b1f8-e57b75549c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:11.855502 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc7bac-54c1-48d3-b1f8-e57b75549c7b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.860190 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d84893-8d53-4b81-be81-57b20a81d64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.860793 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d84893-8d53-4b81-be81-57b20a81d64f admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.861075 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d84893-8d53-4b81-be81-57b20a81d64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.861354 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d84893-8d53-4b81-be81-57b20a81d64f admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.862378 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d84893-8d53-4b81-be81-57b20a81d64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.863983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d84893-8d53-4b81-be81-57b20a81d64f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.874303 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1464/2889] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:18:11.878207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d84893-8d53-4b81-be81-57b20a81d64f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.888505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d84893-8d53-4b81-be81-57b20a81d64f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.893354 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a42d6-51a6-45df-b5b4-bbc77afc56cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.894180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a42d6-51a6-45df-b5b4-bbc77afc56cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.897956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a42d6-51a6-45df-b5b4-bbc77afc56cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.897956 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a42d6-51a6-45df-b5b4-bbc77afc56cc admin admin] PATH_INFO: `/v3/projects/61eaa8d04e014bdc9f2b050846258c60/users/a23e5eff80b04128883a12f0529691ec/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.908160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f995a4-0a66-4593-b892-bc906a0819c3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:11.910701 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a42d6-51a6-45df-b5b4-bbc77afc56cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=61eaa8d04e014bdc9f2b050846258c60, user_id=a23e5eff80b04128883a12f0529691ec, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.912048 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fec38-69a0-46fa-bcf9-2fe788c907a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:11.912665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fec38-69a0-46fa-bcf9-2fe788c907a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:11.912941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fec38-69a0-46fa-bcf9-2fe788c907a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:11.913208 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fec38-69a0-46fa-bcf9-2fe788c907a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:11.913882 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a42d6-51a6-45df-b5b4-bbc77afc56cc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.922740 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fec38-69a0-46fa-bcf9-2fe788c907a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:11.924205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fec38-69a0-46fa-bcf9-2fe788c907a2 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:11.924343 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:11.933162 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1465/2890] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:18:11 2022] PUT /identity/v3/projects/61eaa8d04e014bdc9f2b050846258c60/users/a23e5eff80b04128883a12f0529691ec/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 22:18:11.937071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a42d6-51a6-45df-b5b4-bbc77afc56cc admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:11.937305 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1426/2891] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:18:11.998618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a42d6-51a6-45df-b5b4-bbc77afc56cc admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:12.003300 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557032d-ad20-451c-a56c-ddc1938619cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:12.003957 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557032d-ad20-451c-a56c-ddc1938619cf admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:12.004235 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557032d-ad20-451c-a56c-ddc1938619cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:12.004504 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557032d-ad20-451c-a56c-ddc1938619cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:12.005155 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557032d-ad20-451c-a56c-ddc1938619cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:12.006794 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557032d-ad20-451c-a56c-ddc1938619cf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:12.019709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1466/2892] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:18:12.021518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fec38-69a0-46fa-bcf9-2fe788c907a2 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:12.031670 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fec38-69a0-46fa-bcf9-2fe788c907a2 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:12.038886 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0d241-31ed-47fc-9b3f-bdd49f3eb904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:12.039563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d241-31ed-47fc-9b3f-bdd49f3eb904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:12.039836 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d241-31ed-47fc-9b3f-bdd49f3eb904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:12.040089 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d241-31ed-47fc-9b3f-bdd49f3eb904 admin admin] PATH_INFO: `/v3/projects/61eaa8d04e014bdc9f2b050846258c60/users/a23e5eff80b04128883a12f0529691ec/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:12.045911 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0d241-31ed-47fc-9b3f-bdd49f3eb904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61eaa8d04e014bdc9f2b050846258c60, user_id=a23e5eff80b04128883a12f0529691ec, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:12.048724 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0d241-31ed-47fc-9b3f-bdd49f3eb904 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:12.072409 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1427/2893] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:18:12 2022] PUT /identity/v3/projects/61eaa8d04e014bdc9f2b050846258c60/users/a23e5eff80b04128883a12f0529691ec/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:12.074636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df563-b649-41f0-a507-05f0fee98187 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:12.075117 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df563-b649-41f0-a507-05f0fee98187 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:12.075398 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df563-b649-41f0-a507-05f0fee98187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:12.106983 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-205df563-b649-41f0-a507-05f0fee98187 None None] MFA Rules not processed for user `a23e5eff80b04128883a12f0529691ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:12.108217 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-205df563-b649-41f0-a507-05f0fee98187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:12.163151 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0d241-31ed-47fc-9b3f-bdd49f3eb904 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:12.166695 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-faa0d241-31ed-47fc-9b3f-bdd49f3eb904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:12.197972 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1467/2894] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:18:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:18:12.209611 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205df563-b649-41f0-a507-05f0fee98187 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:12.211357 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-205df563-b649-41f0-a507-05f0fee98187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:12.255963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0d241-31ed-47fc-9b3f-bdd49f3eb904 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:12.260699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:12.261394 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:12.261604 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:12.261905 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] PATH_INFO: `/v3/projects/46544377b6764b37a9743d2d2f59524b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:12.263080 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] RBAC: Authorizing `identity:delete_project(project_id=46544377b6764b37a9743d2d2f59524b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:12.264988 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:12.277359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205df563-b649-41f0-a507-05f0fee98187 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:12.280989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4220ed2-5a8c-4235-8359-7eb0795d72ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:12.281603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220ed2-5a8c-4235-8359-7eb0795d72ee service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:12.281908 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220ed2-5a8c-4235-8359-7eb0795d72ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:12.282183 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220ed2-5a8c-4235-8359-7eb0795d72ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:12.284796 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c4220ed2-5a8c-4235-8359-7eb0795d72ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:12.318879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46544377b6764b37a9743d2d2f59524b', 'request_id': 'req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:12.324860 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:12.329764 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46544377b6764b37a9743d2d2f59524b', 'request_id': 'req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:12.340046 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46544377b6764b37a9743d2d2f59524b', 'request_id': 'req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:12.353138 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] The token cache is being invalidate because project 46544377b6764b37a9743d2d2f59524b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:18:12.353498 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:12.354251 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:12.354460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4220ed2-5a8c-4235-8359-7eb0795d72ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:12.356170 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4220ed2-5a8c-4235-8359-7eb0795d72ee service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:12.356286 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1428/2895] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:18:12 2022] DELETE /identity/v3/projects/46544377b6764b37a9743d2d2f59524b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:12.381201 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1468/2896] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:18:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 22:18:12.529420 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:12.531262 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:12.560105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:12.627160 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a45f-63c6-4d9b-8472-5bbb34e3a74d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:12.632879 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:12.633717 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:12.634168 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:12.634602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] PATH_INFO: `/v3/users/ecb55920b3334d0db3bb8934094ba28c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:12.636102 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb55920b3334d0db3bb8934094ba28c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:12.638429 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:12.690610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb55920b3334d0db3bb8934094ba28c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:12.691698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb55920b3334d0db3bb8934094ba28c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:12.702067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb55920b3334d0db3bb8934094ba28c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:12.710833 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb55920b3334d0db3bb8934094ba28c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:12.711436 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb55920b3334d0db3bb8934094ba28c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:12.731014 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1429/2897] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:18:12 2022] DELETE /identity/v3/users/ecb55920b3334d0db3bb8934094ba28c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:12.913054 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4220ed2-5a8c-4235-8359-7eb0795d72ee service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:12.914575 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c4220ed2-5a8c-4235-8359-7eb0795d72ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:12.928951 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4220ed2-5a8c-4235-8359-7eb0795d72ee service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:12.992160 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:12.992817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:12.993098 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:12.993372 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] PATH_INFO: `/v3/projects/4df97c5319df42d7a6534b5ca3b5c873` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:12.994560 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df97c5319df42d7a6534b5ca3b5c873)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:12.996505 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:13.049586 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df97c5319df42d7a6534b5ca3b5c873', 'request_id': 'req-6c623953-757e-42b9-8175-6d0f4298f522'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:13.059182 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df97c5319df42d7a6534b5ca3b5c873', 'request_id': 'req-6c623953-757e-42b9-8175-6d0f4298f522'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:13.065429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df97c5319df42d7a6534b5ca3b5c873', 'request_id': 'req-6c623953-757e-42b9-8175-6d0f4298f522'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:13.077861 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] The token cache is being invalidate because project 4df97c5319df42d7a6534b5ca3b5c873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:18:13.078187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:13.078907 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:13.080432 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1469/2898] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:18:12 2022] DELETE /identity/v3/projects/4df97c5319df42d7a6534b5ca3b5c873 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:14.005419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:14.007069 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:14.069472 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc006a-d04e-4fd4-8eaf-b334b2268d26 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:14.116205 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:14.123907 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbcc3d-71a5-46fc-932e-8fc06b3f6d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:14.124794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbcc3d-71a5-46fc-932e-8fc06b3f6d6f service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:14.125449 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbcc3d-71a5-46fc-932e-8fc06b3f6d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:14.126170 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbcc3d-71a5-46fc-932e-8fc06b3f6d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:14.129373 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f1bbcc3d-71a5-46fc-932e-8fc06b3f6d6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:14.191380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbcc3d-71a5-46fc-932e-8fc06b3f6d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:14.192838 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbcc3d-71a5-46fc-932e-8fc06b3f6d6f service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:14.202243 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1430/2899] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:18:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:18:14.770391 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:14.771922 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:14.784475 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623953-757e-42b9-8175-6d0f4298f522 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:14.789056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28639b7-3325-4487-a58b-542c1ae7437b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c639dece626449b9153943b388e52c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:14.789657 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28639b7-3325-4487-a58b-542c1ae7437b service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:14.789971 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28639b7-3325-4487-a58b-542c1ae7437b service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:14.790232 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28639b7-3325-4487-a58b-542c1ae7437b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:14.791985 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d28639b7-3325-4487-a58b-542c1ae7437b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:14.856369 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28639b7-3325-4487-a58b-542c1ae7437b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:14.857817 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28639b7-3325-4487-a58b-542c1ae7437b service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:14.861743 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:14.869484 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1470/2900] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:18:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:18:18.855084 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbcc3d-71a5-46fc-932e-8fc06b3f6d6f service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:18.856778 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f1bbcc3d-71a5-46fc-932e-8fc06b3f6d6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:18.992308 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbcc3d-71a5-46fc-932e-8fc06b3f6d6f service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:18.997457 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:18.998113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:18.998384 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:18.998647 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] PATH_INFO: `/v3/users/2dd69582e5e64f1fb3a8ede458602794` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:18.999820 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd69582e5e64f1fb3a8ede458602794)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:19.001759 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:19.051927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:19.054730 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd69582e5e64f1fb3a8ede458602794'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.055571 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd69582e5e64f1fb3a8ede458602794'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.064633 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd69582e5e64f1fb3a8ede458602794'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.072253 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd69582e5e64f1fb3a8ede458602794'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.072925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd69582e5e64f1fb3a8ede458602794'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.091551 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1431/2901] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:18:18 2022] DELETE /identity/v3/users/2dd69582e5e64f1fb3a8ede458602794 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:19.097099 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5e22a-838d-4e9e-aa63-981969aeeb68 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:19.097613 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5e22a-838d-4e9e-aa63-981969aeeb68 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:19.097721 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5e22a-838d-4e9e-aa63-981969aeeb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:19.132752 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b7e5e22a-838d-4e9e-aa63-981969aeeb68 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:18:19.133990 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b7e5e22a-838d-4e9e-aa63-981969aeeb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:19.197027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1471/2902] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:18:19.207114 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:19.208664 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:19.285328 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11445460-b2f9-416e-8ce7-a8976241b061 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:19.289908 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5b087-c114-4e07-96ab-7017910ba01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:19.290514 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b087-c114-4e07-96ab-7017910ba01a service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:19.290790 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b087-c114-4e07-96ab-7017910ba01a service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:19.291059 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b087-c114-4e07-96ab-7017910ba01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:19.301034 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5b087-c114-4e07-96ab-7017910ba01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:19.302512 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5b087-c114-4e07-96ab-7017910ba01a service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:19.312917 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1432/2903] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:18:19.596517 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5e22a-838d-4e9e-aa63-981969aeeb68 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:19.600708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b7e5e22a-838d-4e9e-aa63-981969aeeb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:19.616866 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5e22a-838d-4e9e-aa63-981969aeeb68 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:19.623187 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:19.623782 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:19.624029 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:19.624301 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] PATH_INFO: `/v3/projects/a58722539d5343efbeda01e64bae27d7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:19.625449 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58722539d5343efbeda01e64bae27d7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:19.627403 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:19.681120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58722539d5343efbeda01e64bae27d7', 'request_id': 'req-f041c4e9-4b74-48e1-814d-b3796d7fa026'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.691069 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58722539d5343efbeda01e64bae27d7', 'request_id': 'req-f041c4e9-4b74-48e1-814d-b3796d7fa026'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.697156 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58722539d5343efbeda01e64bae27d7', 'request_id': 'req-f041c4e9-4b74-48e1-814d-b3796d7fa026'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.708497 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] The token cache is being invalidate because project a58722539d5343efbeda01e64bae27d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:18:19.708784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.709429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.711252 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1472/2904] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:18:19 2022] DELETE /identity/v3/projects/a58722539d5343efbeda01e64bae27d7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:19.715281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5b087-c114-4e07-96ab-7017910ba01a service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:19.725271 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5b087-c114-4e07-96ab-7017910ba01a service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:19.786544 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:19.787073 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:19.787316 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:19.787699 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] PATH_INFO: `/v3/users/8c32d5e6f4e14d5fababe8317da2f793` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:19.789008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c32d5e6f4e14d5fababe8317da2f793)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:19.791179 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:19.853745 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c32d5e6f4e14d5fababe8317da2f793'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.854456 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c32d5e6f4e14d5fababe8317da2f793'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.857249 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:19.868044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c32d5e6f4e14d5fababe8317da2f793'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.877610 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c32d5e6f4e14d5fababe8317da2f793'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.878326 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c32d5e6f4e14d5fababe8317da2f793'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:19.902741 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1433/2905] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:18:19 2022] DELETE /identity/v3/users/8c32d5e6f4e14d5fababe8317da2f793 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:20.223157 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:20.224802 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:20.243846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041c4e9-4b74-48e1-814d-b3796d7fa026 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:20.339904 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:20.340630 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:20.341014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:20.341442 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] PATH_INFO: `/v3/projects/ccec3b04e53b41208bd2a4a69c0cfe07` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:20.343608 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccec3b04e53b41208bd2a4a69c0cfe07)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:20.346188 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:20.371875 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:20.413735 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccec3b04e53b41208bd2a4a69c0cfe07', 'request_id': 'req-cc1ede3d-4066-457c-8169-94d269ffb993'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:20.426886 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccec3b04e53b41208bd2a4a69c0cfe07', 'request_id': 'req-cc1ede3d-4066-457c-8169-94d269ffb993'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:20.435894 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccec3b04e53b41208bd2a4a69c0cfe07', 'request_id': 'req-cc1ede3d-4066-457c-8169-94d269ffb993'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:20.449677 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] The token cache is being invalidate because project ccec3b04e53b41208bd2a4a69c0cfe07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:18:20.451264 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:20.452047 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:20.453601 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1473/2906] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:18:20 2022] DELETE /identity/v3/projects/ccec3b04e53b41208bd2a4a69c0cfe07 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:20.457869 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:20.459509 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:20.473707 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265c819-8e7c-4be8-aaf9-e41e014e14ba admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:20.548476 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:20.549240 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:20.549514 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:20.549788 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] PATH_INFO: `/v3/users/a23e5eff80b04128883a12f0529691ec` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:20.551050 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23e5eff80b04128883a12f0529691ec)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:20.552981 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:20.625990 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23e5eff80b04128883a12f0529691ec'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:20.626575 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23e5eff80b04128883a12f0529691ec'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:20.636625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23e5eff80b04128883a12f0529691ec'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:20.645456 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23e5eff80b04128883a12f0529691ec'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:20.646150 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23e5eff80b04128883a12f0529691ec'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:20.666257 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1434/2907] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:18:20 2022] DELETE /identity/v3/users/a23e5eff80b04128883a12f0529691ec => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:20.986825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:20.988820 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:21.003377 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ede3d-4066-457c-8169-94d269ffb993 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:21.065056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:21.065056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:21.065056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:21.065056 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] PATH_INFO: `/v3/projects/61eaa8d04e014bdc9f2b050846258c60` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:21.065600 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61eaa8d04e014bdc9f2b050846258c60)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:21.066915 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:21.124901 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61eaa8d04e014bdc9f2b050846258c60', 'request_id': 'req-83d236cf-0f29-4e3b-95ec-e142ded7e645'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:21.134828 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61eaa8d04e014bdc9f2b050846258c60', 'request_id': 'req-83d236cf-0f29-4e3b-95ec-e142ded7e645'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:21.142778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61eaa8d04e014bdc9f2b050846258c60', 'request_id': 'req-83d236cf-0f29-4e3b-95ec-e142ded7e645'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:21.157709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] The token cache is being invalidate because project 61eaa8d04e014bdc9f2b050846258c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:18:21.158034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:21.158770 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-83d236cf-0f29-4e3b-95ec-e142ded7e645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:18:21.160397 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1474/2908] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:18:20 2022] DELETE /identity/v3/projects/61eaa8d04e014bdc9f2b050846258c60 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:18:24.558753 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:18:24.560299 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:24.617105 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:24.661653 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d762cf5-bc8e-4172-a3ea-0356a52c9013 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:18:24.728884 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff3813-acfe-40d0-9db8-c4532e957fcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:18:24.729501 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3813-acfe-40d0-9db8-c4532e957fcd service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:18:24.729804 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3813-acfe-40d0-9db8-c4532e957fcd service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:18:24.730099 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3813-acfe-40d0-9db8-c4532e957fcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:18:24.732021 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-57ff3813-acfe-40d0-9db8-c4532e957fcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:18:24.743894 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff3813-acfe-40d0-9db8-c4532e957fcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:18:24.745547 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff3813-acfe-40d0-9db8-c4532e957fcd service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:18:24.755341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1435/2909] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:18:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:18:31.154429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:34.751158 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=46 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:36.762773 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922094f-7938-45f5-b27f-707eb68346c8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:36.763286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922094f-7938-45f5-b27f-707eb68346c8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:36.763286 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922094f-7938-45f5-b27f-707eb68346c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:36.793225 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3922094f-7938-45f5-b27f-707eb68346c8 None None] MFA Rules not processed for user `d51d2b73c22747f2b40bccc45352135f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:19:36.794465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3922094f-7938-45f5-b27f-707eb68346c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:36.858404 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1475/2910] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 22 22:19:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:19:36.912759 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff3813-acfe-40d0-9db8-c4532e957fcd service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:36.914387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-57ff3813-acfe-40d0-9db8-c4532e957fcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:36.986969 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff3813-acfe-40d0-9db8-c4532e957fcd service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:36.992516 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fcb1d-0ac2-4c64-b17d-cec9d7c35328 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9967ef46a464ff2b5f7e4c459f8abd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:36.993141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fcb1d-0ac2-4c64-b17d-cec9d7c35328 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:36.993408 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fcb1d-0ac2-4c64-b17d-cec9d7c35328 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:36.993669 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fcb1d-0ac2-4c64-b17d-cec9d7c35328 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:37.002590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fcb1d-0ac2-4c64-b17d-cec9d7c35328 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:37.004223 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fcb1d-0ac2-4c64-b17d-cec9d7c35328 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:37.012986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1436/2911] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 22 22:19:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 22:19:43.744121 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922094f-7938-45f5-b27f-707eb68346c8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:43.747564 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3922094f-7938-45f5-b27f-707eb68346c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:43.811946 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922094f-7938-45f5-b27f-707eb68346c8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:43.816366 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:43.817004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:43.817282 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:43.817557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] PATH_INFO: `/v3/users/dc21667714ed48ca9f616d561ca9bc95` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:43.818726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc21667714ed48ca9f616d561ca9bc95)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:43.820652 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:43.872976 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc21667714ed48ca9f616d561ca9bc95'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:43.880984 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc21667714ed48ca9f616d561ca9bc95'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:43.881751 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc21667714ed48ca9f616d561ca9bc95'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:43.888549 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc21667714ed48ca9f616d561ca9bc95'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:43.900989 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc21667714ed48ca9f616d561ca9bc95'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:43.907440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1476/2912] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:19:43 2022] DELETE /identity/v3/users/dc21667714ed48ca9f616d561ca9bc95 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:19:44.084347 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fcb1d-0ac2-4c64-b17d-cec9d7c35328 service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:44.095602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fcb1d-0ac2-4c64-b17d-cec9d7c35328 service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:44.159625 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:44.160280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:44.160538 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:44.160822 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] PATH_INFO: `/v3/projects/a319629d43b94fccbafcd26017b6d4ee` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:44.162090 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a319629d43b94fccbafcd26017b6d4ee)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:44.164008 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:44.213665 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a319629d43b94fccbafcd26017b6d4ee', 'request_id': 'req-8964a53f-eda2-457f-a3b6-42c8b0e26b90'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.219900 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a319629d43b94fccbafcd26017b6d4ee', 'request_id': 'req-8964a53f-eda2-457f-a3b6-42c8b0e26b90'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.228678 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a319629d43b94fccbafcd26017b6d4ee', 'request_id': 'req-8964a53f-eda2-457f-a3b6-42c8b0e26b90'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.240281 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] The token cache is being invalidate because project a319629d43b94fccbafcd26017b6d4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:19:44.240567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.241211 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.242759 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1437/2913] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:19:44 2022] DELETE /identity/v3/projects/a319629d43b94fccbafcd26017b6d4ee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:19:44.246934 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:44.248777 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:44.262165 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef7456-e557-4be7-b073-e0de523928e1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:44.267128 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:44.323863 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a5379-42fb-49e8-8fbf-f65bfacc5eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:44.324503 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5379-42fb-49e8-8fbf-f65bfacc5eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:44.324784 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5379-42fb-49e8-8fbf-f65bfacc5eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:44.325055 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5379-42fb-49e8-8fbf-f65bfacc5eae admin admin] PATH_INFO: `/v3/users/f634630f68ae4ede97e083eb7731e0f6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:44.326244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a5379-42fb-49e8-8fbf-f65bfacc5eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f634630f68ae4ede97e083eb7731e0f6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:44.328244 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a5379-42fb-49e8-8fbf-f65bfacc5eae admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:44.382849 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-922a5379-42fb-49e8-8fbf-f65bfacc5eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f634630f68ae4ede97e083eb7731e0f6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.391532 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-922a5379-42fb-49e8-8fbf-f65bfacc5eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f634630f68ae4ede97e083eb7731e0f6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.392231 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-922a5379-42fb-49e8-8fbf-f65bfacc5eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f634630f68ae4ede97e083eb7731e0f6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.399767 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-922a5379-42fb-49e8-8fbf-f65bfacc5eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f634630f68ae4ede97e083eb7731e0f6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.412381 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-922a5379-42fb-49e8-8fbf-f65bfacc5eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f634630f68ae4ede97e083eb7731e0f6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.418765 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1477/2914] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:19:44 2022] DELETE /identity/v3/users/f634630f68ae4ede97e083eb7731e0f6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:19:44.596504 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:44.598467 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:44.614346 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964a53f-eda2-457f-a3b6-42c8b0e26b90 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:44.633397 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:44.677800 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:44.678483 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:44.678759 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:44.679031 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] PATH_INFO: `/v3/projects/82f7a72f93b14ea49780f2133f574cea` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:44.680197 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f7a72f93b14ea49780f2133f574cea)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:44.682141 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:44.732133 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f7a72f93b14ea49780f2133f574cea', 'request_id': 'req-42b1051a-aaed-4108-9cec-908822d7c8ba'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.738531 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f7a72f93b14ea49780f2133f574cea', 'request_id': 'req-42b1051a-aaed-4108-9cec-908822d7c8ba'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.748155 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f7a72f93b14ea49780f2133f574cea', 'request_id': 'req-42b1051a-aaed-4108-9cec-908822d7c8ba'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.760380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] The token cache is being invalidate because project 82f7a72f93b14ea49780f2133f574cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:19:44.760891 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.761628 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-42b1051a-aaed-4108-9cec-908822d7c8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:19:44.763287 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1438/2915] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:19:44 2022] DELETE /identity/v3/projects/82f7a72f93b14ea49780f2133f574cea => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:19:44.768641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac93c6-8042-4f0e-ad94-f64e8ea5c581 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:44.769246 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac93c6-8042-4f0e-ad94-f64e8ea5c581 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:44.769521 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac93c6-8042-4f0e-ad94-f64e8ea5c581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:44.819826 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5aac93c6-8042-4f0e-ad94-f64e8ea5c581 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:19:44.821053 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5aac93c6-8042-4f0e-ad94-f64e8ea5c581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:44.882386 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1478/2916] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:19:44.890927 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bb694-20bf-4e2b-95e5-8ade187886f9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:44.891207 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bb694-20bf-4e2b-95e5-8ade187886f9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:44.891478 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bb694-20bf-4e2b-95e5-8ade187886f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:44.913657 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a92bb694-20bf-4e2b-95e5-8ade187886f9 None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:19:44.914906 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a92bb694-20bf-4e2b-95e5-8ade187886f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:44.924434 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1439/2917] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:19:44.928997 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac93c6-8042-4f0e-ad94-f64e8ea5c581 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:44.935176 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:44.939234 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac93c6-8042-4f0e-ad94-f64e8ea5c581 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:44.945374 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae3153-a3f7-4b6e-901d-2669e5323c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:44.946100 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3153-a3f7-4b6e-901d-2669e5323c39 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:44.946589 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3153-a3f7-4b6e-901d-2669e5323c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:44.947084 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3153-a3f7-4b6e-901d-2669e5323c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:44.948071 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae3153-a3f7-4b6e-901d-2669e5323c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 22:19:44.948439 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae3153-a3f7-4b6e-901d-2669e5323c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:44.950144 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae3153-a3f7-4b6e-901d-2669e5323c39 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:44.962684 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1479/2918] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 22 22:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 22:19:44.967368 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bb694-20bf-4e2b-95e5-8ade187886f9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:44.976954 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bb694-20bf-4e2b-95e5-8ade187886f9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:44.982624 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e804cf-823d-4d2c-91a7-d1504a16e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:44.983217 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e804cf-823d-4d2c-91a7-d1504a16e849 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:44.983518 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e804cf-823d-4d2c-91a7-d1504a16e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:44.983770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e804cf-823d-4d2c-91a7-d1504a16e849 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:44.984491 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e804cf-823d-4d2c-91a7-d1504a16e849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:44.986557 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e804cf-823d-4d2c-91a7-d1504a16e849 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:45.017996 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1440/2919] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:19:44 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:19:45.022376 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae3153-a3f7-4b6e-901d-2669e5323c39 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:45.032619 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae3153-a3f7-4b6e-901d-2669e5323c39 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:45.095840 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83820d88-1443-4a46-a44c-6e730157b128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:45.096443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83820d88-1443-4a46-a44c-6e730157b128 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:45.096714 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83820d88-1443-4a46-a44c-6e730157b128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:45.096976 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83820d88-1443-4a46-a44c-6e730157b128 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:45.097640 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83820d88-1443-4a46-a44c-6e730157b128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:45.099629 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83820d88-1443-4a46-a44c-6e730157b128 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:45.125373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1480/2920] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:19:45 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:19:45.130016 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e804cf-823d-4d2c-91a7-d1504a16e849 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:45.140847 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e804cf-823d-4d2c-91a7-d1504a16e849 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:45.146358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39f0b0-0e82-45a5-9e15-6f7105df2e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:45.146967 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39f0b0-0e82-45a5-9e15-6f7105df2e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:45.147268 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39f0b0-0e82-45a5-9e15-6f7105df2e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:45.147533 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39f0b0-0e82-45a5-9e15-6f7105df2e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:45.148177 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39f0b0-0e82-45a5-9e15-6f7105df2e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:45.149777 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39f0b0-0e82-45a5-9e15-6f7105df2e05 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:45.160292 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1441/2921] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:19:45.164536 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83820d88-1443-4a46-a44c-6e730157b128 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:45.175256 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83820d88-1443-4a46-a44c-6e730157b128 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:45.181120 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a076b56-646d-4f2b-990b-16849934c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:45.181771 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076b56-646d-4f2b-990b-16849934c666 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:45.182119 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076b56-646d-4f2b-990b-16849934c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:45.182417 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076b56-646d-4f2b-990b-16849934c666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:45.183103 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a076b56-646d-4f2b-990b-16849934c666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:45.184717 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a076b56-646d-4f2b-990b-16849934c666 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:45.195919 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1481/2922] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:19:45.200387 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39f0b0-0e82-45a5-9e15-6f7105df2e05 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:45.210998 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39f0b0-0e82-45a5-9e15-6f7105df2e05 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:45.216176 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879458-a5d0-4c0e-be8c-19a8e6e57029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:45.216848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879458-a5d0-4c0e-be8c-19a8e6e57029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:45.217127 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879458-a5d0-4c0e-be8c-19a8e6e57029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:45.217413 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879458-a5d0-4c0e-be8c-19a8e6e57029 admin admin] PATH_INFO: `/v3/projects/7a9b5f557c874e4eab81f1fc3a61f718/users/73d9604713994d9a8943238af2ae05a6/roles/92f2004a6ac04948af8cd639d0d09f09` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:45.233811 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879458-a5d0-4c0e-be8c-19a8e6e57029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9b5f557c874e4eab81f1fc3a61f718, user_id=73d9604713994d9a8943238af2ae05a6, role_id=92f2004a6ac04948af8cd639d0d09f09)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:45.236590 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879458-a5d0-4c0e-be8c-19a8e6e57029 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:45.257755 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1442/2923] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:19:45 2022] PUT /identity/v3/projects/7a9b5f557c874e4eab81f1fc3a61f718/users/73d9604713994d9a8943238af2ae05a6/roles/92f2004a6ac04948af8cd639d0d09f09 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:19:45.264659 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd7e04-bf01-4f35-8427-11b20e72a75f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:45.265310 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd7e04-bf01-4f35-8427-11b20e72a75f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:45.265916 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd7e04-bf01-4f35-8427-11b20e72a75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:45.285724 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-43bd7e04-bf01-4f35-8427-11b20e72a75f None None] MFA Rules not processed for user `55aadc9862fd4d0e93e5113dacf48de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:19:45.286958 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-43bd7e04-bf01-4f35-8427-11b20e72a75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:45.349311 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1482/2924] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:19:45.359407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879458-a5d0-4c0e-be8c-19a8e6e57029 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:45.361320 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-98879458-a5d0-4c0e-be8c-19a8e6e57029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:45.415941 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:45.445987 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879458-a5d0-4c0e-be8c-19a8e6e57029 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:45.449862 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0718d-f6b4-437b-a77c-25558b11fbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:45.450479 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0718d-f6b4-437b-a77c-25558b11fbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:45.450758 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0718d-f6b4-437b-a77c-25558b11fbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:45.451026 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0718d-f6b4-437b-a77c-25558b11fbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:45.460926 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0718d-f6b4-437b-a77c-25558b11fbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:45.462406 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0718d-f6b4-437b-a77c-25558b11fbc6 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:45.472125 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1443/2925] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:19:49.444235 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23638c0f-3a4d-4369-b201-9bd2b88384c1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:49.444709 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23638c0f-3a4d-4369-b201-9bd2b88384c1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:49.444830 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23638c0f-3a4d-4369-b201-9bd2b88384c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:49.474191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-23638c0f-3a4d-4369-b201-9bd2b88384c1 None None] MFA Rules not processed for user `73d9604713994d9a8943238af2ae05a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:19:49.475426 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-23638c0f-3a4d-4369-b201-9bd2b88384c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:49.541766 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:49.554012 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0718d-f6b4-437b-a77c-25558b11fbc6 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:49.554595 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1483/2926] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:19:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:19:49.564955 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0718d-f6b4-437b-a77c-25558b11fbc6 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:49.569947 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28482ff2-cee9-446d-9b90-7c26a4da99c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:49.570686 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28482ff2-cee9-446d-9b90-7c26a4da99c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:49.570962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28482ff2-cee9-446d-9b90-7c26a4da99c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:49.571229 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28482ff2-cee9-446d-9b90-7c26a4da99c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:49.571865 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28482ff2-cee9-446d-9b90-7c26a4da99c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:49.573853 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28482ff2-cee9-446d-9b90-7c26a4da99c2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:49.604787 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1444/2927] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 22 22:19:49 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 22:19:49.609336 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23638c0f-3a4d-4369-b201-9bd2b88384c1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:49.621236 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23638c0f-3a4d-4369-b201-9bd2b88384c1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:49.680729 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a2e0d-851e-45f0-9052-0ab8de7ac5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:49.681330 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a2e0d-851e-45f0-9052-0ab8de7ac5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:49.681602 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a2e0d-851e-45f0-9052-0ab8de7ac5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:49.681898 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a2e0d-851e-45f0-9052-0ab8de7ac5a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:49.682538 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a2e0d-851e-45f0-9052-0ab8de7ac5a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:49.684440 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a2e0d-851e-45f0-9052-0ab8de7ac5a8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:49.709014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1484/2928] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 22 22:19:49 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 22:19:49.713067 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28482ff2-cee9-446d-9b90-7c26a4da99c2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:49.724921 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28482ff2-cee9-446d-9b90-7c26a4da99c2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:49.729776 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee003db8-44ae-4c97-b323-702377f1bb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:49.730577 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003db8-44ae-4c97-b323-702377f1bb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:49.730848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003db8-44ae-4c97-b323-702377f1bb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:49.731113 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003db8-44ae-4c97-b323-702377f1bb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:49.731767 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee003db8-44ae-4c97-b323-702377f1bb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:49.733605 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee003db8-44ae-4c97-b323-702377f1bb9e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:49.745978 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1445/2929] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 22:19:49.750859 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a2e0d-851e-45f0-9052-0ab8de7ac5a8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:49.761705 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a2e0d-851e-45f0-9052-0ab8de7ac5a8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:49.768041 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f53f-1079-4997-8801-b2063f40c813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:49.768726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f53f-1079-4997-8801-b2063f40c813 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:49.769003 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f53f-1079-4997-8801-b2063f40c813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:49.769276 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f53f-1079-4997-8801-b2063f40c813 admin admin] PATH_INFO: `/v3/projects/4f872080d0f742caaba4b5f236ce5cdc/users/fd357256024745d78fe474b2c210bec6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:49.787618 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f53f-1079-4997-8801-b2063f40c813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f872080d0f742caaba4b5f236ce5cdc, user_id=fd357256024745d78fe474b2c210bec6, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:49.790281 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f53f-1079-4997-8801-b2063f40c813 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:49.804825 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1485/2930] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:19:49 2022] PUT /identity/v3/projects/4f872080d0f742caaba4b5f236ce5cdc/users/fd357256024745d78fe474b2c210bec6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:19:49.808727 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee003db8-44ae-4c97-b323-702377f1bb9e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:49.819520 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee003db8-44ae-4c97-b323-702377f1bb9e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:49.879965 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2ae82-5d9b-4420-b06a-adc0e830e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:49.880572 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2ae82-5d9b-4420-b06a-adc0e830e7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:49.880848 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2ae82-5d9b-4420-b06a-adc0e830e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:49.881121 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2ae82-5d9b-4420-b06a-adc0e830e7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:49.881768 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2ae82-5d9b-4420-b06a-adc0e830e7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:49.883398 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2ae82-5d9b-4420-b06a-adc0e830e7c5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:49.893821 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1446/2931] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 22 22:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 22:19:49.898113 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f53f-1079-4997-8801-b2063f40c813 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:49.908557 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f53f-1079-4997-8801-b2063f40c813 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:49.913269 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b6036-67ff-4d7c-906d-8ae0294adf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:49.913995 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b6036-67ff-4d7c-906d-8ae0294adf45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:49.914228 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b6036-67ff-4d7c-906d-8ae0294adf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:49.914490 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b6036-67ff-4d7c-906d-8ae0294adf45 admin admin] PATH_INFO: `/v3/projects/4f872080d0f742caaba4b5f236ce5cdc/users/fd357256024745d78fe474b2c210bec6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:49.916400 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b6036-67ff-4d7c-906d-8ae0294adf45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f872080d0f742caaba4b5f236ce5cdc, user_id=fd357256024745d78fe474b2c210bec6, role_id=3eaaa9f7ef504bb1a19bd39eb5232f97)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:49.919076 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b6036-67ff-4d7c-906d-8ae0294adf45 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:49.929761 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1486/2932] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 22 22:19:49 2022] PUT /identity/v3/projects/4f872080d0f742caaba4b5f236ce5cdc/users/fd357256024745d78fe474b2c210bec6/roles/3eaaa9f7ef504bb1a19bd39eb5232f97 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:19:54.118259 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ba9e-f2de-42a0-a62e-306ed7b56fa2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:54.119123 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ba9e-f2de-42a0-a62e-306ed7b56fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:54.119563 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ba9e-f2de-42a0-a62e-306ed7b56fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:54.162560 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2752ba9e-f2de-42a0-a62e-306ed7b56fa2 None None] MFA Rules not processed for user `fd357256024745d78fe474b2c210bec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:19:54.164095 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2752ba9e-f2de-42a0-a62e-306ed7b56fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:54.281263 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1447/2933] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:19:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:19:54.292460 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b6036-67ff-4d7c-906d-8ae0294adf45 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:19:54.294641 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-384b6036-67ff-4d7c-906d-8ae0294adf45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:54.415961 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b6036-67ff-4d7c-906d-8ae0294adf45 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:19:54.422715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6a686-dcf1-4908-83fb-1e40dd365de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:19:54.423359 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a686-dcf1-4908-83fb-1e40dd365de3 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:54.423633 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a686-dcf1-4908-83fb-1e40dd365de3 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:54.423900 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a686-dcf1-4908-83fb-1e40dd365de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:54.467166 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:54.513582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6a686-dcf1-4908-83fb-1e40dd365de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:19:54.516206 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6a686-dcf1-4908-83fb-1e40dd365de3 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:19:54.527014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1487/2934] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:19:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:19:55.620267 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e23ede-a202-4d63-b9aa-b29e12f6f1ef None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:19:55.621110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e23ede-a202-4d63-b9aa-b29e12f6f1ef None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:19:55.621110 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e23ede-a202-4d63-b9aa-b29e12f6f1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:19:55.641770 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-94e23ede-a202-4d63-b9aa-b29e12f6f1ef None None] MFA Rules not processed for user `73d9604713994d9a8943238af2ae05a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 22:19:55.642997 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-94e23ede-a202-4d63-b9aa-b29e12f6f1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:19:55.650789 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1448/2935] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 22 22:19:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 22:20:04.522297 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=14 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:20:05.635645 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:20:21.805004 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6a686-dcf1-4908-83fb-1e40dd365de3 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:20:21.866368 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6a686-dcf1-4908-83fb-1e40dd365de3 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:20:21.873018 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd5d43-132f-4207-814b-16f042f03929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:20:21.874009 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd5d43-132f-4207-814b-16f042f03929 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:20:21.874373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd5d43-132f-4207-814b-16f042f03929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:20:21.874744 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd5d43-132f-4207-814b-16f042f03929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:20:21.887952 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd5d43-132f-4207-814b-16f042f03929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:20:21.889384 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd5d43-132f-4207-814b-16f042f03929 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:20:21.901780 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1488/2936] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:20:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:20:31.894834 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=26 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:31.276566 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e23ede-a202-4d63-b9aa-b29e12f6f1ef None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:21:31.278254 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-94e23ede-a202-4d63-b9aa-b29e12f6f1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:21:31.292794 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e23ede-a202-4d63-b9aa-b29e12f6f1ef None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:21:31.297358 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddc489-6552-4e27-bf1c-44382164766a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:21:31.298004 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddc489-6552-4e27-bf1c-44382164766a service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:21:31.298280 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddc489-6552-4e27-bf1c-44382164766a service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:21:31.298548 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddc489-6552-4e27-bf1c-44382164766a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:21:31.300528 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e9ddc489-6552-4e27-bf1c-44382164766a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:21:31.311017 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddc489-6552-4e27-bf1c-44382164766a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:21:31.312448 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddc489-6552-4e27-bf1c-44382164766a service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:21:31.320915 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1449/2937] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:21:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:21:41.317121 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:17.988080 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd5d43-132f-4207-814b-16f042f03929 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:22:17.997567 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd5d43-132f-4207-814b-16f042f03929 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:22:18.001774 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f00d5-74a0-4062-8834-123e7159b04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:22:18.002501 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f00d5-74a0-4062-8834-123e7159b04c service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:22:18.002778 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f00d5-74a0-4062-8834-123e7159b04c service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:22:18.003051 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f00d5-74a0-4062-8834-123e7159b04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:22:18.004949 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f22f00d5-74a0-4062-8834-123e7159b04c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:22:18.019043 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f00d5-74a0-4062-8834-123e7159b04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:22:18.020474 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f00d5-74a0-4062-8834-123e7159b04c service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:22:18.032992 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1489/2938] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:22:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:22:19.232380 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddc489-6552-4e27-bf1c-44382164766a service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:22:19.246617 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddc489-6552-4e27-bf1c-44382164766a service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:22:19.251698 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02abf9-398b-4343-b45a-5acb900ff84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:22:19.252296 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02abf9-398b-4343-b45a-5acb900ff84a service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:22:19.252568 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02abf9-398b-4343-b45a-5acb900ff84a service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:22:19.252831 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02abf9-398b-4343-b45a-5acb900ff84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:22:19.254963 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7c02abf9-398b-4343-b45a-5acb900ff84a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:22:19.269672 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02abf9-398b-4343-b45a-5acb900ff84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:22:19.271144 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02abf9-398b-4343-b45a-5acb900ff84a service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:22:19.283001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1450/2939] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:22:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:22:28.027173 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:29.277435 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:31.527180 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f00d5-74a0-4062-8834-123e7159b04c service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:22:31.536224 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f00d5-74a0-4062-8834-123e7159b04c service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:22:31.540171 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7cfb8-0ee5-42bf-94ef-8cf75043db67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:22:31.540885 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7cfb8-0ee5-42bf-94ef-8cf75043db67 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:22:31.541230 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7cfb8-0ee5-42bf-94ef-8cf75043db67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:22:31.541555 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7cfb8-0ee5-42bf-94ef-8cf75043db67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:22:31.544285 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d2d7cfb8-0ee5-42bf-94ef-8cf75043db67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:22:31.556124 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7cfb8-0ee5-42bf-94ef-8cf75043db67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:22:31.557572 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7cfb8-0ee5-42bf-94ef-8cf75043db67 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:22:31.566154 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1490/2940] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:22:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:22:31.644925 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02abf9-398b-4343-b45a-5acb900ff84a service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:22:31.653620 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02abf9-398b-4343-b45a-5acb900ff84a service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:22:31.657379 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e2e2f-ddad-4827-82c8-7b5f8d50ac96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd512b60a42ed456a82dff11d17b77c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:22:31.658011 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e2e2f-ddad-4827-82c8-7b5f8d50ac96 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:22:31.658282 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e2e2f-ddad-4827-82c8-7b5f8d50ac96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:22:31.658546 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e2e2f-ddad-4827-82c8-7b5f8d50ac96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:22:31.660231 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-763e2e2f-ddad-4827-82c8-7b5f8d50ac96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:22:31.673444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e2e2f-ddad-4827-82c8-7b5f8d50ac96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:22:31.674904 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e2e2f-ddad-4827-82c8-7b5f8d50ac96 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:22:31.685858 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1451/2941] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:22:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:22:31.747014 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7cfb8-0ee5-42bf-94ef-8cf75043db67 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:22:31.748519 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d2d7cfb8-0ee5-42bf-94ef-8cf75043db67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:22:31.820939 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7cfb8-0ee5-42bf-94ef-8cf75043db67 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:22:31.827260 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea9896-3eb9-4e79-9e04-2e668506aa79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:22:31.827873 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea9896-3eb9-4e79-9e04-2e668506aa79 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:22:31.828150 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea9896-3eb9-4e79-9e04-2e668506aa79 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:22:31.828447 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea9896-3eb9-4e79-9e04-2e668506aa79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:22:31.830596 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a4ea9896-3eb9-4e79-9e04-2e668506aa79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:22:31.843708 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea9896-3eb9-4e79-9e04-2e668506aa79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:22:31.845424 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea9896-3eb9-4e79-9e04-2e668506aa79 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:22:31.855788 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1491/2942] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:22:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:22:33.791930 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e2e2f-ddad-4827-82c8-7b5f8d50ac96 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:22:33.804275 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e2e2f-ddad-4827-82c8-7b5f8d50ac96 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:22:33.810100 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df6590-a223-44eb-b877-de6aeddce759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:22:33.810693 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df6590-a223-44eb-b877-de6aeddce759 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:22:33.811035 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df6590-a223-44eb-b877-de6aeddce759 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:22:33.811269 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df6590-a223-44eb-b877-de6aeddce759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:22:33.813218 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-88df6590-a223-44eb-b877-de6aeddce759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:22:33.826142 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df6590-a223-44eb-b877-de6aeddce759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:22:33.827744 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df6590-a223-44eb-b877-de6aeddce759 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:22:33.838611 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1452/2943] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:22:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:22:41.851582 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=38 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:43.834279 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=12 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:28.569238 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea9896-3eb9-4e79-9e04-2e668506aa79 service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:23:28.580429 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea9896-3eb9-4e79-9e04-2e668506aa79 service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:23:28.586092 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8f6f8-0296-4fb2-a6ad-60957ab637f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:23:28.586736 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8f6f8-0296-4fb2-a6ad-60957ab637f6 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:23:28.586986 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8f6f8-0296-4fb2-a6ad-60957ab637f6 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:23:28.587288 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8f6f8-0296-4fb2-a6ad-60957ab637f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:23:28.589435 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1ab8f6f8-0296-4fb2-a6ad-60957ab637f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:23:28.601543 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8f6f8-0296-4fb2-a6ad-60957ab637f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:23:28.603207 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8f6f8-0296-4fb2-a6ad-60957ab637f6 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:23:28.613614 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1492/2944] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:23:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:23:38.609049 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:46.652972 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df6590-a223-44eb-b877-de6aeddce759 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:23:46.666407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df6590-a223-44eb-b877-de6aeddce759 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:23:46.672412 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c074655-0ea8-452b-8ffc-461a3e4368c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:23:46.673124 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c074655-0ea8-452b-8ffc-461a3e4368c8 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:23:46.673669 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c074655-0ea8-452b-8ffc-461a3e4368c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:23:46.673798 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c074655-0ea8-452b-8ffc-461a3e4368c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:23:46.676986 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3c074655-0ea8-452b-8ffc-461a3e4368c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:23:46.688542 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c074655-0ea8-452b-8ffc-461a3e4368c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:23:46.690370 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c074655-0ea8-452b-8ffc-461a3e4368c8 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:23:46.706507 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1453/2945] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:23:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:23:49.614832 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8f6f8-0296-4fb2-a6ad-60957ab637f6 service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:23:49.629715 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8f6f8-0296-4fb2-a6ad-60957ab637f6 service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:23:49.636039 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f8bd-e6e5-4fd2-b22d-5e2f539682f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a044973e9e84495dbf8d14e19fc84716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:23:49.636895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f8bd-e6e5-4fd2-b22d-5e2f539682f7 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:23:49.637212 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f8bd-e6e5-4fd2-b22d-5e2f539682f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:23:49.637480 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f8bd-e6e5-4fd2-b22d-5e2f539682f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:23:49.639636 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c668f8bd-e6e5-4fd2-b22d-5e2f539682f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:23:49.653748 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668f8bd-e6e5-4fd2-b22d-5e2f539682f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:23:49.655373 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668f8bd-e6e5-4fd2-b22d-5e2f539682f7 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:23:49.668025 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1493/2946] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:23:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:23:54.679273 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c074655-0ea8-452b-8ffc-461a3e4368c8 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:23:54.691861 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c074655-0ea8-452b-8ffc-461a3e4368c8 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:23:54.698302 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fff6d-c376-44db-b8b3-eaf967617c4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:23:54.701935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fff6d-c376-44db-b8b3-eaf967617c4e service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:23:54.701935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fff6d-c376-44db-b8b3-eaf967617c4e service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:23:54.701935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fff6d-c376-44db-b8b3-eaf967617c4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:23:54.701935 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-376fff6d-c376-44db-b8b3-eaf967617c4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:23:54.719001 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fff6d-c376-44db-b8b3-eaf967617c4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:23:54.720796 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fff6d-c376-44db-b8b3-eaf967617c4e service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:23:54.745315 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1454/2947] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:23:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:23:57.947635 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f8bd-e6e5-4fd2-b22d-5e2f539682f7 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:23:58.016846 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f8bd-e6e5-4fd2-b22d-5e2f539682f7 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:23:58.021344 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:23:58.022015 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:23:58.022295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:23:58.022565 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] PATH_INFO: `/v3/users/73d9604713994d9a8943238af2ae05a6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:23:58.023845 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d9604713994d9a8943238af2ae05a6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:23:58.034843 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:23:58.094058 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d9604713994d9a8943238af2ae05a6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.103603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d9604713994d9a8943238af2ae05a6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.104351 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d9604713994d9a8943238af2ae05a6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.111443 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d9604713994d9a8943238af2ae05a6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.124487 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d9604713994d9a8943238af2ae05a6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.130579 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1494/2948] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:23:57 2022] DELETE /identity/v3/users/73d9604713994d9a8943238af2ae05a6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:23:58.319584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fff6d-c376-44db-b8b3-eaf967617c4e service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:23:58.332962 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fff6d-c376-44db-b8b3-eaf967617c4e service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:23:58.398932 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:23:58.399567 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:23:58.399845 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:23:58.400112 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] PATH_INFO: `/v3/projects/7a9b5f557c874e4eab81f1fc3a61f718` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:23:58.401261 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9b5f557c874e4eab81f1fc3a61f718)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:23:58.403204 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:23:58.453341 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9b5f557c874e4eab81f1fc3a61f718', 'request_id': 'req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.459381 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9b5f557c874e4eab81f1fc3a61f718', 'request_id': 'req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.469602 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9b5f557c874e4eab81f1fc3a61f718', 'request_id': 'req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.482044 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] The token cache is being invalidate because project 7a9b5f557c874e4eab81f1fc3a61f718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:23:58.482330 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.482957 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.484422 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1455/2949] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:23:58 2022] DELETE /identity/v3/projects/7a9b5f557c874e4eab81f1fc3a61f718 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:23:58.488510 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:23:58.490089 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:23:58.503814 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9b5d-ceed-4f0c-b17f-3ff9794af7da admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:23:58.565034 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:23:58.565699 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:23:58.566000 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:23:58.566272 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] PATH_INFO: `/v3/users/fd357256024745d78fe474b2c210bec6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:23:58.567458 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd357256024745d78fe474b2c210bec6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:23:58.569415 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:23:58.574934 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:58.621631 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd357256024745d78fe474b2c210bec6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.630287 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd357256024745d78fe474b2c210bec6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.630935 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd357256024745d78fe474b2c210bec6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.639027 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd357256024745d78fe474b2c210bec6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.651720 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd357256024745d78fe474b2c210bec6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.657603 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1495/2950] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 22 22:23:58 2022] DELETE /identity/v3/users/fd357256024745d78fe474b2c210bec6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:23:58.835598 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:23:58.837419 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:23:58.852472 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cc3bd-4a52-480e-b2d2-27c5ddab7f77 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:23:58.913407 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aadc9862fd4d0e93e5113dacf48de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af96ba5f937450aabed914f12909978', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:23:58.914165 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:23:58.914444 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:23:58.914839 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] PATH_INFO: `/v3/projects/4f872080d0f742caaba4b5f236ce5cdc` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:23:58.916101 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f872080d0f742caaba4b5f236ce5cdc)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:23:58.918108 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:23:58.924877 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:58.969871 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f872080d0f742caaba4b5f236ce5cdc', 'request_id': 'req-582a71e9-10be-4bf1-9167-28328795d108'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.976040 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f872080d0f742caaba4b5f236ce5cdc', 'request_id': 'req-582a71e9-10be-4bf1-9167-28328795d108'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.984584 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f872080d0f742caaba4b5f236ce5cdc', 'request_id': 'req-582a71e9-10be-4bf1-9167-28328795d108'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.996845 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] The token cache is being invalidate because project 4f872080d0f742caaba4b5f236ce5cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 22:23:58.997134 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.997792 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-582a71e9-10be-4bf1-9167-28328795d108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 22:23:58.999403 dv-cinder-849143-6-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1456/2951] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 22 22:23:58 2022] DELETE /identity/v3/projects/4f872080d0f742caaba4b5f236ce5cdc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 22:24:08.654465 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:24:08.993793 dv-cinder-849143-6-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:28:34.589476 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 22:28:34.591313 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:28:34.743962 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d496a-f918-472e-8d1a-dc978f70fc79 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 22:28:34.806556 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4e60f-bebb-4a7e-93fd-4cde74cf6591 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7f2566918b4c719486d1ce285724e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a83f1ce24f41099c068f186df634b8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 22:28:34.807191 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4e60f-bebb-4a7e-93fd-4cde74cf6591 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 22:28:34.807464 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4e60f-bebb-4a7e-93fd-4cde74cf6591 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 22:28:34.807726 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4e60f-bebb-4a7e-93fd-4cde74cf6591 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 22:28:34.809895 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aab4e60f-bebb-4a7e-93fd-4cde74cf6591 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 22:28:34.822125 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4e60f-bebb-4a7e-93fd-4cde74cf6591 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 22:28:34.823695 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4e60f-bebb-4a7e-93fd-4cde74cf6591 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 22:28:34.833903 dv-cinder-849143-6-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1496/2952] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 22 22:28:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 22:28:44.830295 dv-cinder-849143-6-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}